-- Logs begin at Thu 2022-07-28 02:36:35 UTC, end at Thu 2022-07-28 04:20:18 UTC. -- Jul 28 03:40:52.372693 dv-cinder-851279-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 28 03:40:52.382050 dv-cinder-851279-1-smb devstack@keystone.service[86882]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 28 03:40:52.384817 dv-cinder-851279-1-smb devstack@keystone.service[86882]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 03:40:52 2022] *** Jul 28 03:40:52.385045 dv-cinder-851279-1-smb devstack@keystone.service[86882]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 03:40:52.385045 dv-cinder-851279-1-smb devstack@keystone.service[86882]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 03:40:52.385045 dv-cinder-851279-1-smb devstack@keystone.service[86882]: nodename: dv-cinder-851279-1-smb Jul 28 03:40:52.385045 dv-cinder-851279-1-smb devstack@keystone.service[86882]: machine: x86_64 Jul 28 03:40:52.385045 dv-cinder-851279-1-smb devstack@keystone.service[86882]: clock source: unix Jul 28 03:40:52.385045 dv-cinder-851279-1-smb devstack@keystone.service[86882]: pcre jit disabled Jul 28 03:40:52.385045 dv-cinder-851279-1-smb devstack@keystone.service[86882]: detected number of CPU cores: 4 Jul 28 03:40:52.385045 dv-cinder-851279-1-smb devstack@keystone.service[86882]: current working directory: / Jul 28 03:40:52.385045 dv-cinder-851279-1-smb devstack@keystone.service[86882]: detected binary path: /usr/bin/uwsgi-core Jul 28 03:40:52.385045 dv-cinder-851279-1-smb devstack@keystone.service[86882]: your processes number limit is 47680 Jul 28 03:40:52.385045 dv-cinder-851279-1-smb devstack@keystone.service[86882]: your memory page size is 4096 bytes Jul 28 03:40:52.385624 dv-cinder-851279-1-smb devstack@keystone.service[86882]: detected max file descriptor number: 2048 Jul 28 03:40:52.385624 dv-cinder-851279-1-smb devstack@keystone.service[86882]: lock engine: pthread robust mutexes Jul 28 03:40:52.385624 dv-cinder-851279-1-smb devstack@keystone.service[86882]: thunder lock: enabled Jul 28 03:40:52.385624 dv-cinder-851279-1-smb devstack@keystone.service[86882]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 28 03:40:52.385624 dv-cinder-851279-1-smb devstack@keystone.service[86882]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 03:40:52.428024 dv-cinder-851279-1-smb devstack@keystone.service[86882]: Python main interpreter initialized at 0x5591d1cd79c0 Jul 28 03:40:52.428024 dv-cinder-851279-1-smb devstack@keystone.service[86882]: python threads support enabled Jul 28 03:40:52.428024 dv-cinder-851279-1-smb devstack@keystone.service[86882]: your server socket listen backlog is limited to 100 connections Jul 28 03:40:52.428024 dv-cinder-851279-1-smb devstack@keystone.service[86882]: your mercy for graceful operations on workers is 90 seconds Jul 28 03:40:52.428441 dv-cinder-851279-1-smb devstack@keystone.service[86882]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 03:40:52.428516 dv-cinder-851279-1-smb devstack@keystone.service[86882]: *** Operational MODE: preforking *** Jul 28 03:40:52.428828 dv-cinder-851279-1-smb devstack@keystone.service[86882]: *** uWSGI is running in multiple interpreter mode *** Jul 28 03:40:52.428828 dv-cinder-851279-1-smb devstack@keystone.service[86882]: spawned uWSGI master process (pid: 86882) Jul 28 03:40:52.429047 dv-cinder-851279-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 28 03:40:52.431364 dv-cinder-851279-1-smb devstack@keystone.service[86882]: spawned uWSGI worker 1 (pid: 86894, cores: 1) Jul 28 03:40:52.431364 dv-cinder-851279-1-smb devstack@keystone.service[86882]: spawned uWSGI worker 2 (pid: 86895, cores: 1) Jul 28 03:40:52.431364 dv-cinder-851279-1-smb devstack@keystone.service[86882]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 03:40:58.096729 dv-cinder-851279-1-smb devstack@keystone.service[86895]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:40:58.096729 dv-cinder-851279-1-smb devstack@keystone.service[86895]: from cryptography.utils import int_from_bytes Jul 28 03:40:58.097596 dv-cinder-851279-1-smb devstack@keystone.service[86894]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:40:58.097596 dv-cinder-851279-1-smb devstack@keystone.service[86894]: from cryptography.utils import int_from_bytes Jul 28 03:40:58.098010 dv-cinder-851279-1-smb devstack@keystone.service[86895]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:40:58.098010 dv-cinder-851279-1-smb devstack@keystone.service[86895]: from cryptography.utils import int_from_bytes Jul 28 03:40:58.098126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:40:58.098126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: from cryptography.utils import int_from_bytes Jul 28 03:40:58.149288 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 03:40:58.149476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 03:40:58.149658 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] command line args: [] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 03:40:58.149931 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 03:40:58.150022 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 03:40:58.150105 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ================================================================================ {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 03:40:58.150247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 03:40:58.150340 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] admin_token = **** {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.150411 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] command line args: [] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 03:40:58.150590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] config_dir = [] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.150680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 03:40:58.150783 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.150862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ================================================================================ {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 03:40:58.150964 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] config_source = [] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.151047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] admin_token = **** {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.151147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] debug = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.151284 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] config_dir = [] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.151391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.151609 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.151673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] config_source = [] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.151728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.151877 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] debug = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.151985 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.152088 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.152214 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.152320 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.152422 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.152522 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.152616 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] list_limit = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.152720 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.152814 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] log_config_append = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.152916 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.153017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.153119 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] log_dir = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.153216 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] list_limit = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.153317 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] log_file = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.153410 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] log_config_append = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.153410 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.153602 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.153701 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] log_dir = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.153817 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.153890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] log_file = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.154003 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.154085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.154200 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.154276 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.154394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.154476 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.154595 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.154681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.154759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.154875 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.154975 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.155059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.155211 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.155298 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.155471 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.155594 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.155703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.155779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.155937 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.156060 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.156170 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.156247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.156402 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.156493 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.156647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.156726 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.156891 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.157433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.157525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.157698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] publish_errors = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.157841 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.157938 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.158071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.158155 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] publish_errors = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.158250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.158333 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.158496 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.158579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.158702 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.158795 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.158949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.159025 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] standard_threads = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.159179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.159255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.159433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] standard_threads = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.159523 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.159711 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.160342 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.160430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] use_journal = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.160503 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] use_json = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.160674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] use_stderr = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.160755 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.160912 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] use_syslog = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.161027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.161213 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] use_journal = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.161298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.161392 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] use_json = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.161506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.161590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] use_stderr = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.161731 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] use_syslog = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.161816 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.161967 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:40:58.162044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.162228 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.162309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.162465 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.162551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.162710 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.162791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.162952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.163027 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.163188 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.163270 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.163459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.163547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.163710 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.163792 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.163946 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.164029 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.164191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.164316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.164436 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.164512 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.164673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.164757 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.164906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.164980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.165153 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.165243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.165388 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.165472 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.165632 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.165708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.165879 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.165962 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.166115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.166205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.166351 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.166432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.166606 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.166682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.166836 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.166910 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.167070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.167148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.167346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.167426 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.167600 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.167678 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.167833 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.167911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.168066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.168149 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.168304 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.168389 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.168533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.168610 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.168762 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.168840 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.168996 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.169082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.169238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.169359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.169476 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.169557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.169706 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.169787 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.169934 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.170012 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.170179 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.170273 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.170414 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.170500 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.170648 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.170725 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.170888 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.170976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.171121 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.171207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.171368 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.171444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.171604 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.171671 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.171838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.171913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.172160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.172292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.172458 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.172538 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.172657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.172772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.172855 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.172928 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.173044 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.173131 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.173204 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.173327 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.173403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.173473 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.173622 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.173703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.173856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.173945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.174090 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.174171 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.174337 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.174424 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.174567 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.174698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.174804 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.174881 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.175037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.175113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.175301 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.175488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.175565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.175731 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.175873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.176029 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.176158 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.176291 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.176415 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.176544 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.176667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.176791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.176912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.177046 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.177173 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.177308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.177436 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.177571 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.177706 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.177842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.177966 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.178091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.178218 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.178346 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.178472 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.178668 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.178802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.178930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.179075 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.179204 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.179346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.179478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.179606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.179739 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.179865 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.179992 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.180125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.180264 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.180399 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.180534 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.180660 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.180786 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.180921 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.181048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.181174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.181308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.181436 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.181562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.181688 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.181814 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.181944 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.182072 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.182197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.182323 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.182450 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.182586 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.182720 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.182848 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.182973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.183100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.183225 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.183396 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.183529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.183656 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.183781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.183913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.184039 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.184166 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.184299 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.184441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.184562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.184688 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.184814 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.184939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.185072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.185205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.185331 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.185457 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.185583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.185709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.185843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.185966 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.186088 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.186163 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.186232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.186301 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.186379 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.186379 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.186508 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.186508 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.186633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.186702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] auth.external = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.186778 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.186850 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.186920 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.186920 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.187047 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.187117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.187244 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.187333 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] auth.external = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.187436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] auth.password = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.187518 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.187591 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] auth.token = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.187591 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.187717 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.187787 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.187864 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.187936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.188006 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] auth.password = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.188076 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.188145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] auth.token = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.188265 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.188361 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.188515 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.188600 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.188750 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.188835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.188987 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] credential.caching = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.189073 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.189236 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.189314 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.189488 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.189567 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.189734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.189818 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.189971 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.190048 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] credential.caching = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.190218 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.190295 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.190453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.190537 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.190705 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.190782 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.191099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.191187 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.191435 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.191595 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.191697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.191851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.191986 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.192120 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.192236 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.192390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.192503 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.192592 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.192749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.192827 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.193009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.193096 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.193249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] federation.caching = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.193348 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.193504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.193610 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.193756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.193842 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.194007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.194086 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.194241 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.194320 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] federation.caching = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.194492 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.194578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.194732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.194810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.194990 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.195076 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.195227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.195308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.195497 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.195577 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.195734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.195812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.195987 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.196067 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.196222 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.196301 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] identity.caching = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.196472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.196549 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.196761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.196853 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.196951 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.197032 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.197184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] identity.caching = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.197268 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.197430 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.197510 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.197665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.197791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.197918 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.197993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.198125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.198207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.198371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.198460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.198603 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.198810 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.198929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.199010 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.199082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.199152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.199291 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.199433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.199558 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.199637 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.199791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.199870 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.200020 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.200100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.200262 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.200343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.200508 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.200586 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.200752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.200835 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.200999 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.201128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.201258 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.201387 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.201515 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.201653 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.201790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.201913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.202036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.202163 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.202290 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.202372 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.202537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.202665 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.202792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.202919 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.203045 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.203172 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.203308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.203467 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.203467 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.203699 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.203699 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.203928 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.203928 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.204172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.204296 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.204418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.204418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.204655 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.204655 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.204892 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.204892 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.205132 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.205255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.205384 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.205509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.205632 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.205753 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.205875 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.205875 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.206110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.206235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.206317 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.206958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.207153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.207294 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.207499 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.207630 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.207877 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.207877 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.208130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.208259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.208259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.208507 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.208631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.208756 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.208877 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.209004 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.209134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.209273 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.209434 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.user = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.209555 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.209678 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.209807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.209943 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.210071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.210197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.210324 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.210446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.210567 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.210702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.210831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.user = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.210967 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.211094 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.211221 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.211366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.211499 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.211622 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.211749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.211877 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.212003 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.212130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.212264 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.212393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.212519 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.212645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.212786 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.212916 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.213050 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.213174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.213295 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.213422 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.213422 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.213666 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.213795 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.213919 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.214041 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.214162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.214284 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.214416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.214552 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.214676 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.214798 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.214920 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.215043 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.215165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.215295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.215457 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.215585 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.215712 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.215838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.215965 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.216102 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.216241 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.216369 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.216535 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.216535 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.216774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.216995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.217123 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.217200 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.217278 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.217350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.217421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.217500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.217573 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.217643 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.217713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.217789 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.217861 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.217939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.218011 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.218081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.218152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.218222 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] resource.caching = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.218295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.218373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.218446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.218516 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.218585 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.218655 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.218724 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.218801 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.218874 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.218944 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.219014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] resource.caching = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.219083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.219154 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.219232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.219305 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.219398 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.219479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.219553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.219631 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.219704 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] role.caching = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.219776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.219846 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] role.driver = sql {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.219923 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.220081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.220169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.220334 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.220412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.220582 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.220665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.220819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] role.caching = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.220906 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.221065 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.221177 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] role.driver = sql {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.221314 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.221416 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.221563 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.221649 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.221812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.221890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.222080 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.222875 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.223274 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.223430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.223715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.223795 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.223974 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.224053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.224230 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.224316 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.224485 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.224563 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.224722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.224971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.225048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.225217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.225295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.225467 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.225544 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.225718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.225796 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.225969 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.226151 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.226230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.226391 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.226469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.226642 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.226729 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.226893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.226971 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.227142 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.227220 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.227415 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.227499 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.227654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.227732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.227891 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.227970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.228148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.228229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.228387 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.228464 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.228620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.228699 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.228853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.228933 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.229083 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.229162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.229347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.229432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.229566 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] token.caching = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.229648 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.229807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.229886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.230041 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.230119 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.230279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.230359 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.230510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.230589 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.230746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] token.caching = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.230825 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.230982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.231063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.231230 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.231354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.231485 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.231563 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.231736 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.231818 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.231974 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.232052 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.232210 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.232287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.232448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.232531 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.232688 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.232769 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.232935 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.233014 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.233166 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.233245 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.233400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.233479 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.233633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.233711 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.233875 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.233956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] database.connection = **** {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.234121 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.234209 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.234349 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.234428 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.234589 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.234681 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.234882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.234960 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.235119 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.235198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] database.connection = **** {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.235431 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.235528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.235631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.235788 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.235865 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.235937 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.236092 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.236171 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.236326 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.236417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.236562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.236641 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.236797 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.236875 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.237032 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.237120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.237274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.237352 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.237507 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.237584 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.237784 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.238574 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.238821 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.238997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 03:40:58.243107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.243399 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.243799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.244077 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.244360 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.244622 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.244893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.245153 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:40:58.245340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 03:40:58.268634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.268865 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.269855 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.270729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.270964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.271194 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.278441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.279629 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.309283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.309527 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.310796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.311026 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.364051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.364565 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.415589 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.415905 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.416472 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.416712 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.483024 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.483304 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.483496 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.483637 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.483771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.483903 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.484033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.484161 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.484299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.484430 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.484556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.484683 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.510166 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.510453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.510593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.510812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.511037 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.511242 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.511433 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.511567 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.511660 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.511789 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.511867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.512067 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.512285 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.512501 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.523202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.523377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.537034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.537260 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.537348 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.537487 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.537571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.537710 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.537802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.537930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.538014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.538148 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.538229 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.538361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86895) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.538444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.538573 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86894) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 03:40:58.556163 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.556369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 03:40:58.556481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.556694 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 03:40:58.556776 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.556895 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 03:40:58.557030 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.557165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.557274 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 03:40:58.557431 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.557512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.557690 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.557771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.557948 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.558038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.558219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.567766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.567953 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.568038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.568231 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.568314 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.568500 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.568592 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.568787 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.575483 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86895) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.575726 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86894) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.580230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86895) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.580487 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86894) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.580571 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.580769 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.580864 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.581047 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.581129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.581327 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.581437 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.581661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.581746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.581930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.582135 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.582222 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.582296 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.582458 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.582541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.582726 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.582807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.582990 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.583080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.583261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.609023 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.610006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.610558 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86894) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.610852 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.611562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86895) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.611848 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.616412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86894) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.616641 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.616920 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.619189 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86895) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.619674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.619969 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.623551 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86894) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.623837 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.628444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86894) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.628712 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86895) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.628941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.629077 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.629452 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.629820 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.630100 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.630375 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.630666 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.630944 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.633511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86895) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.633807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.634096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.634389 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.634668 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.634944 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.635216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.635515 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.651004 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.651291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.655965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86894) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.656918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.657678 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.659472 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.660879 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.664763 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86894) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.665538 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86895) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.667982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86894) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.671234 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.671386 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.671689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.671818 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.671984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.672272 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.672563 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.672843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.679289 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86895) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.682520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86895) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.685963 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.686427 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.686927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.687438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.687943 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.688436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.689649 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86894) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.689941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.690212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.690474 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.698183 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.699774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.700050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.702955 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86894) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.703236 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.703553 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.703843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.704128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.709142 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86895) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.709437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.709710 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.709983 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.716930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.718156 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86894) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.718446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.718575 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.718729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.718856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.719014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.719299 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.719608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.719940 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.721630 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86895) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.721920 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.722810 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.723069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.723485 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.736682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86894) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.736911 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86895) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.737157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.737445 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.737800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.738598 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.739114 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.739257 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.740504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86894) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.743541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.746307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.748431 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86894) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.748740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.749055 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.755757 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86895) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.755947 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.757563 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86894) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.758740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86895) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.760519 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.760817 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.761113 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.761395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.761730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.764423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.765972 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86895) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.766251 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.766537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.773496 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.775253 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86894) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.775253 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.775591 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86895) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.775729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.778106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.778469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.779357 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.779357 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.782398 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86894) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.782687 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.782969 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.783256 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.783578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.783851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.784127 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.784402 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.785295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.785575 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.785856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.786147 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.786415 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.786677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86894) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.787887 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86895) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.788273 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.788726 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.796269 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86895) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 03:40:58.796552 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.796833 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.797108 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.797390 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.797670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.797949 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.798222 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.798607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.798896 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.799178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.799537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.799827 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.799966 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86895) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 03:40:58.822714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5591d1cd79c0 pid: 86894 (default app) Jul 28 03:40:58.826683 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7c367-8bce-4e2e-ad5d-8a0434080b11 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:40:58.827369 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7c367-8bce-4e2e-ad5d-8a0434080b11 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:40:58.827770 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7c367-8bce-4e2e-ad5d-8a0434080b11 None None] PATH_INFO: `/v3` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:40:58.835582 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Thu Jul 28 03:40:58 2022] GET /identity/v3/ => generated 255 bytes in 12 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:40:58.836214 dv-cinder-851279-1-smb devstack@keystone.service[86895]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5591d1cd79c0 pid: 86895 (default app) Jul 28 03:41:08.042637 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33e854-3ca2-4ad0-a2b3-9088c2fe9f9e None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:08.043169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33e854-3ca2-4ad0-a2b3-9088c2fe9f9e None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:08.043169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33e854-3ca2-4ad0-a2b3-9088c2fe9f9e None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:08.044588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:08.052561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d0755-7f38-4023-bd6b-17ff62c941ea None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:08.053006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d0755-7f38-4023-bd6b-17ff62c941ea None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:08.053109 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d0755-7f38-4023-bd6b-17ff62c941ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:08.125389 dv-cinder-851279-1-smb devstack@keystone.service[86895]: INFO dbcounter [None req-8b3d0755-7f38-4023-bd6b-17ff62c941ea None None] Registered counter for database keystone Jul 28 03:41:08.147945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG oslo_db.sqlalchemy.engines [None req-8b3d0755-7f38-4023-bd6b-17ff62c941ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:41:08.156533 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writer thread running {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:41:08.336431 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG passlib.handlers.bcrypt [None req-8b3d0755-7f38-4023-bd6b-17ff62c941ea None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86895) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 03:41:08.336842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG passlib.handlers.bcrypt [None req-8b3d0755-7f38-4023-bd6b-17ff62c941ea None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86895) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 03:41:08.393068 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-8b3d0755-7f38-4023-bd6b-17ff62c941ea None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:08.395771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-8b3d0755-7f38-4023-bd6b-17ff62c941ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:08.525753 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1/3] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 28 03:41:08.666865 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33e854-3ca2-4ad0-a2b3-9088c2fe9f9e None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:08.738133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: INFO dbcounter [None req-0c33e854-3ca2-4ad0-a2b3-9088c2fe9f9e None None] Registered counter for database keystone Jul 28 03:41:08.757486 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG oslo_db.sqlalchemy.engines [None req-0c33e854-3ca2-4ad0-a2b3-9088c2fe9f9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:41:08.763771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writer thread running {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:41:08.893216 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33e854-3ca2-4ad0-a2b3-9088c2fe9f9e None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:08.898864 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c4d19-d930-4488-bd7a-8886899d6605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:08.899569 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c4d19-d930-4488-bd7a-8886899d6605 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:08.899851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c4d19-d930-4488-bd7a-8886899d6605 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:08.900129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c4d19-d930-4488-bd7a-8886899d6605 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:08.910662 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c4d19-d930-4488-bd7a-8886899d6605 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:08.966368 dv-cinder-851279-1-smb devstack@keystone.service[86894]: WARNING keystone.common.rbac_enforcer.enforcer [None req-436c4d19-d930-4488-bd7a-8886899d6605 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 03:41:08.966624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c4d19-d930-4488-bd7a-8886899d6605 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:08.977280 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 3/4] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Jul 28 03:41:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 03:41:08.983606 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d0755-7f38-4023-bd6b-17ff62c941ea None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:08.998704 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d0755-7f38-4023-bd6b-17ff62c941ea None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:09.003766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a30eea-94a3-482f-b2f0-75c89a2879a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:09.005100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a30eea-94a3-482f-b2f0-75c89a2879a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:09.005416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a30eea-94a3-482f-b2f0-75c89a2879a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:09.005697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a30eea-94a3-482f-b2f0-75c89a2879a8 admin admin] PATH_INFO: `/v3/projects/7ea31e38f3a74a13b1debf11d300a6d6` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:09.007468 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a30eea-94a3-482f-b2f0-75c89a2879a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=7ea31e38f3a74a13b1debf11d300a6d6)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:09.058541 dv-cinder-851279-1-smb devstack@keystone.service[86895]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d7a30eea-94a3-482f-b2f0-75c89a2879a8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 03:41:09.059204 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a30eea-94a3-482f-b2f0-75c89a2879a8 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:09.063727 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 2/5] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Jul 28 03:41:08 2022] GET /identity/v3/projects/7ea31e38f3a74a13b1debf11d300a6d6 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:11.091138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62485d7-7a2b-49c4-9289-d0f9bd750e75 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:11.091738 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62485d7-7a2b-49c4-9289-d0f9bd750e75 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:11.091738 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62485d7-7a2b-49c4-9289-d0f9bd750e75 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:11.095795 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 4/6] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:11.101278 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e113e60-cd96-4dd5-a312-ff7c9a25e483 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:11.101706 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e113e60-cd96-4dd5-a312-ff7c9a25e483 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:11.101845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e113e60-cd96-4dd5-a312-ff7c9a25e483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:11.122153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-0e113e60-cd96-4dd5-a312-ff7c9a25e483 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:11.123716 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-0e113e60-cd96-4dd5-a312-ff7c9a25e483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:11.132346 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 3/7] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 03:41:11.155013 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62485d7-7a2b-49c4-9289-d0f9bd750e75 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:11.167681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62485d7-7a2b-49c4-9289-d0f9bd750e75 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:11.171857 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd0f7d-7bf6-4edf-8a2c-890c303460a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:11.172478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd0f7d-7bf6-4edf-8a2c-890c303460a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:11.172765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd0f7d-7bf6-4edf-8a2c-890c303460a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:11.173044 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd0f7d-7bf6-4edf-8a2c-890c303460a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:11.181450 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd0f7d-7bf6-4edf-8a2c-890c303460a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:11.183249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd0f7d-7bf6-4edf-8a2c-890c303460a8 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:11.192826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 5/8] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Jul 28 03:41:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 03:41:11.198725 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e113e60-cd96-4dd5-a312-ff7c9a25e483 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:11.208949 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e113e60-cd96-4dd5-a312-ff7c9a25e483 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:11.213315 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110fbf7-d4a2-4d74-8574-363785136dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:11.213950 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110fbf7-d4a2-4d74-8574-363785136dff admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:11.214229 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110fbf7-d4a2-4d74-8574-363785136dff admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:11.214503 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110fbf7-d4a2-4d74-8574-363785136dff admin admin] PATH_INFO: `/v3/users/3f3fe43cd62f4e5186fa1917f6943de6` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:11.215904 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110fbf7-d4a2-4d74-8574-363785136dff admin admin] RBAC: Authorizing `identity:get_user(user_id=3f3fe43cd62f4e5186fa1917f6943de6)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:11.217758 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110fbf7-d4a2-4d74-8574-363785136dff admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:11.219373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 4/9] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Jul 28 03:41:11 2022] GET /identity/v3/users/3f3fe43cd62f4e5186fa1917f6943de6 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:13.307589 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2581b-ee6d-4433-9136-66b23309ed25 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:13.308116 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2581b-ee6d-4433-9136-66b23309ed25 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:13.308116 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2581b-ee6d-4433-9136-66b23309ed25 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:13.309483 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:13.314670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0382a-fce8-431c-906b-60d5d1207d61 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:13.315087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0382a-fce8-431c-906b-60d5d1207d61 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:13.315223 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0382a-fce8-431c-906b-60d5d1207d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:13.336591 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-b6f0382a-fce8-431c-906b-60d5d1207d61 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:13.337801 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b6f0382a-fce8-431c-906b-60d5d1207d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:13.367970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900da5a-ba0b-4b9d-a431-21fad0ae7ece None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:13.368257 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900da5a-ba0b-4b9d-a431-21fad0ae7ece None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:13.368541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900da5a-ba0b-4b9d-a431-21fad0ae7ece None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:13.369883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 7/11] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:41:13.375180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e95bc-f998-4fa9-975b-a597047728b9 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:13.375489 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e95bc-f998-4fa9-975b-a597047728b9 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:13.375772 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e95bc-f998-4fa9-975b-a597047728b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:13.418636 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG passlib.handlers.bcrypt [None req-339e95bc-f998-4fa9-975b-a597047728b9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86894) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 03:41:13.419107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG passlib.handlers.bcrypt [None req-339e95bc-f998-4fa9-975b-a597047728b9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86894) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 03:41:13.422529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 5/12] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:13.445569 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0382a-fce8-431c-906b-60d5d1207d61 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:13.465126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-339e95bc-f998-4fa9-975b-a597047728b9 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:13.466793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-339e95bc-f998-4fa9-975b-a597047728b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:13.470193 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:13.556830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0382a-fce8-431c-906b-60d5d1207d61 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:13.575006 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 8/13] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:41:13.594240 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc871c-6c46-4c11-aab9-9b8c9331c36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:13.594904 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc871c-6c46-4c11-aab9-9b8c9331c36d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:13.598405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc871c-6c46-4c11-aab9-9b8c9331c36d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:13.598405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc871c-6c46-4c11-aab9-9b8c9331c36d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:13.599438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e95bc-f998-4fa9-975b-a597047728b9 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:13.608506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc871c-6c46-4c11-aab9-9b8c9331c36d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:13.617728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-90fc871c-6c46-4c11-aab9-9b8c9331c36d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:41:13.617728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:13.617728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:13.617728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:13.617728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:13.617728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:13.617728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:13.617728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:13.617728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:13.617728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:13.617728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:13.617728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:13.617728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:13.617728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:13.617728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:13.617728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:13.618890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:13.618890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:13.618890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:13.618890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:13.618890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:13.618890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:13.618890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:13.618890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:13.618890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:13.618890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:13.618890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:13.618890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:13.618890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:13.618890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:13.618890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:13.618890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:13.620134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:13.620134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:13.620134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:13.620134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:13.620134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:13.620134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:13.620134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:13.620134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:13.620134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:13.620134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:13.620134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:41:13.620134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:41:13.620134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 6/14] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:41:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:41:13.624712 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc871c-6c46-4c11-aab9-9b8c9331c36d None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:13.715060 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e95bc-f998-4fa9-975b-a597047728b9 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:13.715333 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:13.717971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:13.736089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc871c-6c46-4c11-aab9-9b8c9331c36d None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:13.755637 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fa9e2-5fc0-46e8-aa31-91b49a1c0473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:13.756521 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fa9e2-5fc0-46e8-aa31-91b49a1c0473 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:13.756817 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fa9e2-5fc0-46e8-aa31-91b49a1c0473 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:13.757094 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fa9e2-5fc0-46e8-aa31-91b49a1c0473 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:13.770888 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5482806-6590-41e2-bbab-9ab517e602fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:13.771552 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5482806-6590-41e2-bbab-9ab517e602fd None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:13.771836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5482806-6590-41e2-bbab-9ab517e602fd None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:13.772106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5482806-6590-41e2-bbab-9ab517e602fd None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:13.772834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5482806-6590-41e2-bbab-9ab517e602fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:13.773139 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5482806-6590-41e2-bbab-9ab517e602fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:13.774560 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5482806-6590-41e2-bbab-9ab517e602fd None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:13.790017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 7/15] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:13.795751 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5482806-6590-41e2-bbab-9ab517e602fd None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:13.838642 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fa9e2-5fc0-46e8-aa31-91b49a1c0473 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:13.840103 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80fa9e2-5fc0-46e8-aa31-91b49a1c0473 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:13.904174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5482806-6590-41e2-bbab-9ab517e602fd None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:13.944257 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 9/16] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:41:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 03:41:13.949941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fa9e2-5fc0-46e8-aa31-91b49a1c0473 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:13.953388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:14.052713 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae7868-e0ad-4d32-9bec-64eb171e1094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:14.053368 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae7868-e0ad-4d32-9bec-64eb171e1094 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:14.053659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae7868-e0ad-4d32-9bec-64eb171e1094 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:14.053979 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae7868-e0ad-4d32-9bec-64eb171e1094 None admin] PATH_INFO: `/v3/users/3f3fe43cd62f4e5186fa1917f6943de6` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:14.055191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae7868-e0ad-4d32-9bec-64eb171e1094 None admin] RBAC: Authorizing `identity:get_user(user_id=3f3fe43cd62f4e5186fa1917f6943de6)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:14.056691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae7868-e0ad-4d32-9bec-64eb171e1094 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:14.058367 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 8/17] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:13 2022] GET /identity/v3/users/3f3fe43cd62f4e5186fa1917f6943de6 => generated 247 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:14.064112 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae7868-e0ad-4d32-9bec-64eb171e1094 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:14.064559 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fa9e2-5fc0-46e8-aa31-91b49a1c0473 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:14.079579 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:14.102021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87f70d-2de0-4a52-a0f9-e223bf336bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:14.102825 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87f70d-2de0-4a52-a0f9-e223bf336bb4 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:14.103109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87f70d-2de0-4a52-a0f9-e223bf336bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:14.103427 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87f70d-2de0-4a52-a0f9-e223bf336bb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:14.122008 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87f70d-2de0-4a52-a0f9-e223bf336bb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:14.123764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87f70d-2de0-4a52-a0f9-e223bf336bb4 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:14.142025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-ef87f70d-2de0-4a52-a0f9-e223bf336bb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:41:14.142025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:14.142025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:14.142025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:14.142025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:14.142025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:14.142025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:14.142025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:14.142025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:14.142025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:14.142025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:14.142025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:14.142025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:41:14.142025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:41:14.142025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:41:14.143133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:41:14.143133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:14.143133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:14.143133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:14.143133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:14.143133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:14.143133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:14.143133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:14.143133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:14.143133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:14.143133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:14.143133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:14.143133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:14.143133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:14.143133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:14.143133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:14.143133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:14.144685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:41:14.144685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:41:14.144685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:41:14.144685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:41:14.144685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 10/18] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:41:14.149975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87f70d-2de0-4a52-a0f9-e223bf336bb4 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:14.176836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae7868-e0ad-4d32-9bec-64eb171e1094 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:14.210664 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:14.211748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f07c5-4aa2-47bc-8892-f9806ca33793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:14.212390 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f07c5-4aa2-47bc-8892-f9806ca33793 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:14.212673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f07c5-4aa2-47bc-8892-f9806ca33793 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:14.212955 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f07c5-4aa2-47bc-8892-f9806ca33793 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:14.214149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f07c5-4aa2-47bc-8892-f9806ca33793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:14.215674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f07c5-4aa2-47bc-8892-f9806ca33793 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:14.217308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 9/19] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:41:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:14.223925 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f07c5-4aa2-47bc-8892-f9806ca33793 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:14.257699 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87f70d-2de0-4a52-a0f9-e223bf336bb4 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:14.292347 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd775b30-b3da-4d16-a042-e301180e5c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:14.292979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd775b30-b3da-4d16-a042-e301180e5c6c None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:14.293264 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd775b30-b3da-4d16-a042-e301180e5c6c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:14.293593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd775b30-b3da-4d16-a042-e301180e5c6c None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:14.294302 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd775b30-b3da-4d16-a042-e301180e5c6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:14.294610 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd775b30-b3da-4d16-a042-e301180e5c6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:14.296051 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd775b30-b3da-4d16-a042-e301180e5c6c None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:14.310667 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:14.314885 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 11/20] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:14.332250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f07c5-4aa2-47bc-8892-f9806ca33793 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:14.375020 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffc035-9a3c-4b84-be5a-a12938fec39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:14.375645 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffc035-9a3c-4b84-be5a-a12938fec39f None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:14.375931 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffc035-9a3c-4b84-be5a-a12938fec39f None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:14.376212 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffc035-9a3c-4b84-be5a-a12938fec39f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:14.377071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffc035-9a3c-4b84-be5a-a12938fec39f None admin] RBAC: Adding query filter params (role.id=8a5766c4aef44773834941d1bdbd1e98, scope.domain.id=default, user.id=3f3fe43cd62f4e5186fa1917f6943de6) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:14.377394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffc035-9a3c-4b84-be5a-a12938fec39f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:14.379094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffc035-9a3c-4b84-be5a-a12938fec39f None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:14.387093 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 10/21] 10.222.0.64 () {56 vars in 1322 bytes} [Thu Jul 28 03:41:14 2022] GET /identity/v3/role_assignments?user.id=3f3fe43cd62f4e5186fa1917f6943de6&scope.domain.id=default&role.id=8a5766c4aef44773834941d1bdbd1e98 => generated 233 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:16.732052 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6026dee-376b-477d-ba8d-d16fd93610a9 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:16.733096 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6026dee-376b-477d-ba8d-d16fd93610a9 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:16.733642 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6026dee-376b-477d-ba8d-d16fd93610a9 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:16.735579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 12/22] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:16.741754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbab389-c4a6-4fc0-b8ac-cfab00351aa6 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:16.742642 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbab389-c4a6-4fc0-b8ac-cfab00351aa6 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:16.743167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbab389-c4a6-4fc0-b8ac-cfab00351aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:16.776465 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-bdbab389-c4a6-4fc0-b8ac-cfab00351aa6 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:16.778037 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-bdbab389-c4a6-4fc0-b8ac-cfab00351aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:16.794879 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474facc-0535-4250-8709-bf4362199bc1 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:16.795164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474facc-0535-4250-8709-bf4362199bc1 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:16.795751 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474facc-0535-4250-8709-bf4362199bc1 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:16.797631 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 13/23] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:16.808914 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f9bfe-0bc7-4b09-aff6-03291a8a6960 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:16.809506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f9bfe-0bc7-4b09-aff6-03291a8a6960 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:16.810050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f9bfe-0bc7-4b09-aff6-03291a8a6960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:16.849293 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-266f9bfe-0bc7-4b09-aff6-03291a8a6960 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:16.850510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-266f9bfe-0bc7-4b09-aff6-03291a8a6960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:16.866698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 11/24] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:41:16.905070 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbab389-c4a6-4fc0-b8ac-cfab00351aa6 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:17.011233 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 14/25] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:17.012654 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0021082-adfc-4b81-ae4a-f3cb0126cf8e None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:17.012963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0021082-adfc-4b81-ae4a-f3cb0126cf8e None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:17.013248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0021082-adfc-4b81-ae4a-f3cb0126cf8e None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:17.014989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 15/26] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:17.023918 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099e1e-4a0c-4f68-9d34-6b00b0012935 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:17.024210 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099e1e-4a0c-4f68-9d34-6b00b0012935 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:17.024553 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c099e1e-4a0c-4f68-9d34-6b00b0012935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:17.039920 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:17.060421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-3c099e1e-4a0c-4f68-9d34-6b00b0012935 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:17.061912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-3c099e1e-4a0c-4f68-9d34-6b00b0012935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:17.070003 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbab389-c4a6-4fc0-b8ac-cfab00351aa6 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:17.135915 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703ee3f-566f-469b-a82e-2f34ad52a8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:17.136590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703ee3f-566f-469b-a82e-2f34ad52a8fd None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:17.136873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703ee3f-566f-469b-a82e-2f34ad52a8fd None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:17.137152 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703ee3f-566f-469b-a82e-2f34ad52a8fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:17.151568 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:17.161526 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703ee3f-566f-469b-a82e-2f34ad52a8fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:17.167536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-c703ee3f-566f-469b-a82e-2f34ad52a8fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:41:17.167536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:17.167536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:17.167536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:17.167536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:17.167536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:17.167536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:17.167536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:17.167536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:17.167536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:17.167536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:17.167536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:17.167536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:17.167536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:17.167536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:17.167536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:17.168665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:17.168665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:17.168665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:17.168665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:17.168665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:17.168665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:17.168665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:17.168665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:17.168665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:17.168665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:17.168665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:17.168665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:17.168665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:17.168665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:17.168665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:17.168665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:17.169618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:17.169618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:17.169618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:17.169618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:17.169618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:17.169618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:17.169618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:17.169618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:17.169618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:17.169618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:17.169618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:41:17.169618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:41:17.172033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 12/27] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:41:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:17.172990 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703ee3f-566f-469b-a82e-2f34ad52a8fd None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:17.204106 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 16/28] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:17.204787 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c099e1e-4a0c-4f68-9d34-6b00b0012935 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:17.317745 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703ee3f-566f-469b-a82e-2f34ad52a8fd None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:17.357149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7f4e9-3646-4934-b88f-59d3e91ecbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:17.357826 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f4e9-3646-4934-b88f-59d3e91ecbc8 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:17.358113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f4e9-3646-4934-b88f-59d3e91ecbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:17.358402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f4e9-3646-4934-b88f-59d3e91ecbc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:17.360712 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:17.371754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7f4e9-3646-4934-b88f-59d3e91ecbc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:17.373354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7f4e9-3646-4934-b88f-59d3e91ecbc8 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:17.391654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-c0f7f4e9-3646-4934-b88f-59d3e91ecbc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:41:17.391654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:17.391654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:17.391654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:17.391654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:17.391654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:17.391654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:17.391654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:17.391654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:17.391654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:17.391654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:17.391654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:17.391654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:41:17.391654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:41:17.391654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:41:17.392498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:41:17.392498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:17.392498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:17.392498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:17.392498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:17.392498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:17.392498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:17.392498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:17.392498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:17.392498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:17.392498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:17.392498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:17.392498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:17.392498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:17.392498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:17.392498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:17.392498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:17.393469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:41:17.393469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:41:17.393469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:41:17.393469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:41:17.393469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 13/29] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:17.394819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7f4e9-3646-4934-b88f-59d3e91ecbc8 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:17.435905 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c099e1e-4a0c-4f68-9d34-6b00b0012935 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:17.508285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7f4e9-3646-4934-b88f-59d3e91ecbc8 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:17.517345 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2e8d3-60ac-45f9-835f-24e461888093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:17.517993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2e8d3-60ac-45f9-835f-24e461888093 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:17.518280 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2e8d3-60ac-45f9-835f-24e461888093 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:17.518722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2e8d3-60ac-45f9-835f-24e461888093 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:17.519482 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2e8d3-60ac-45f9-835f-24e461888093 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:17.520151 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2e8d3-60ac-45f9-835f-24e461888093 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:17.521188 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2e8d3-60ac-45f9-835f-24e461888093 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:17.553799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 17/30] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:17.555009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2e8d3-60ac-45f9-835f-24e461888093 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:17.558943 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f20be8-70d7-49fe-8bd2-6a821fe43e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:17.559929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f20be8-70d7-49fe-8bd2-6a821fe43e75 None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:17.561217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f20be8-70d7-49fe-8bd2-6a821fe43e75 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:17.561688 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f20be8-70d7-49fe-8bd2-6a821fe43e75 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:17.562608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f20be8-70d7-49fe-8bd2-6a821fe43e75 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:17.569151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f20be8-70d7-49fe-8bd2-6a821fe43e75 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:17.722011 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:17.797035 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2e8d3-60ac-45f9-835f-24e461888093 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:17.808468 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 14/31] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Jul 28 03:41:17 2022] POST /identity/v3/roles => generated 219 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:41:17.810224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f20be8-70d7-49fe-8bd2-6a821fe43e75 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:17.837190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454f195-2595-49c2-a7be-0d1b0a85f324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:17.838300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454f195-2595-49c2-a7be-0d1b0a85f324 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:17.838754 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454f195-2595-49c2-a7be-0d1b0a85f324 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:17.839177 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454f195-2595-49c2-a7be-0d1b0a85f324 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:17.840103 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454f195-2595-49c2-a7be-0d1b0a85f324 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:17.840590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454f195-2595-49c2-a7be-0d1b0a85f324 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:17.842378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454f195-2595-49c2-a7be-0d1b0a85f324 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:17.856054 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 18/32] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:17.857747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f297d1e-419d-433d-bdd2-06fd13381305 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:17.858223 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f297d1e-419d-433d-bdd2-06fd13381305 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:17.858667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f297d1e-419d-433d-bdd2-06fd13381305 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:17.861213 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 19/33] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:17.867567 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f297d1e-419d-433d-bdd2-06fd13381305 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:17.886620 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:17.940616 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f20be8-70d7-49fe-8bd2-6a821fe43e75 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:18.010795 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d7517-dbe4-4920-b0e4-f0b067fc668e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:18.011518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d7517-dbe4-4920-b0e4-f0b067fc668e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:18.011803 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d7517-dbe4-4920-b0e4-f0b067fc668e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:18.012076 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d7517-dbe4-4920-b0e4-f0b067fc668e None admin] PATH_INFO: `/v3/users/3f3fe43cd62f4e5186fa1917f6943de6` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:18.015097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d7517-dbe4-4920-b0e4-f0b067fc668e None admin] RBAC: Authorizing `identity:get_user(user_id=3f3fe43cd62f4e5186fa1917f6943de6)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:18.016773 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d7517-dbe4-4920-b0e4-f0b067fc668e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:18.021109 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 15/34] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:17 2022] GET /identity/v3/users/3f3fe43cd62f4e5186fa1917f6943de6 => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:18.024568 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351691e3-fb10-4fc1-98f2-cb57702ebbef None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:18.025634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351691e3-fb10-4fc1-98f2-cb57702ebbef None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:18.026882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351691e3-fb10-4fc1-98f2-cb57702ebbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:18.039696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:18.043378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f297d1e-419d-433d-bdd2-06fd13381305 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:18.059762 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-351691e3-fb10-4fc1-98f2-cb57702ebbef None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:18.061355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-351691e3-fb10-4fc1-98f2-cb57702ebbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:18.091444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489422be-cbe7-4170-a5e3-d56960e33972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:18.092017 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489422be-cbe7-4170-a5e3-d56960e33972 None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:18.092304 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489422be-cbe7-4170-a5e3-d56960e33972 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:18.092586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489422be-cbe7-4170-a5e3-d56960e33972 None admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:18.094930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489422be-cbe7-4170-a5e3-d56960e33972 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:18.097278 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489422be-cbe7-4170-a5e3-d56960e33972 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:18.161640 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 16/35] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:18.162467 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351691e3-fb10-4fc1-98f2-cb57702ebbef None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:18.215451 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:18.288542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351691e3-fb10-4fc1-98f2-cb57702ebbef None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:18.324871 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad490f-bb54-42b6-b859-c24a0d5b5803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:18.325541 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad490f-bb54-42b6-b859-c24a0d5b5803 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:18.325821 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad490f-bb54-42b6-b859-c24a0d5b5803 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:18.326098 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad490f-bb54-42b6-b859-c24a0d5b5803 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:18.327350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad490f-bb54-42b6-b859-c24a0d5b5803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:18.328794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad490f-bb54-42b6-b859-c24a0d5b5803 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:18.335710 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 17/36] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:41:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:18.335710 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad490f-bb54-42b6-b859-c24a0d5b5803 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:18.342890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 20/37] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 28 03:41:17 2022] POST /identity/v3/projects => generated 301 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:41:18.346282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f9471-477a-41ad-ba89-cc382e308f37 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:18.346282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f9471-477a-41ad-ba89-cc382e308f37 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:18.346282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f9471-477a-41ad-ba89-cc382e308f37 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:18.346282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 21/38] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:18.347151 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f9471-477a-41ad-ba89-cc382e308f37 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:18.470778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad490f-bb54-42b6-b859-c24a0d5b5803 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:18.487823 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:18.510023 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f9471-477a-41ad-ba89-cc382e308f37 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:18.512979 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1465e6-5aec-4378-b21f-1a7327135096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:18.513690 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1465e6-5aec-4378-b21f-1a7327135096 None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:18.513978 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1465e6-5aec-4378-b21f-1a7327135096 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:18.514254 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1465e6-5aec-4378-b21f-1a7327135096 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:18.514984 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1465e6-5aec-4378-b21f-1a7327135096 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:18.516438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1465e6-5aec-4378-b21f-1a7327135096 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:18.546705 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85579f86-ae1b-4c0d-a123-863311c2ccdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:18.547413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85579f86-ae1b-4c0d-a123-863311c2ccdf None admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:18.547750 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85579f86-ae1b-4c0d-a123-863311c2ccdf None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:18.548035 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85579f86-ae1b-4c0d-a123-863311c2ccdf None admin] PATH_INFO: `/v3/domains/default/users/3f3fe43cd62f4e5186fa1917f6943de6/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:18.551054 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85579f86-ae1b-4c0d-a123-863311c2ccdf None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3f3fe43cd62f4e5186fa1917f6943de6, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:18.552578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85579f86-ae1b-4c0d-a123-863311c2ccdf None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:18.584407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 18/39] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Jul 28 03:41:18 2022] POST /identity/v3/roles => generated 225 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:41:18.585804 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aefae5-432c-4ae5-9cbf-9f7c6e4543a8 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:18.586100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aefae5-432c-4ae5-9cbf-9f7c6e4543a8 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:18.586376 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aefae5-432c-4ae5-9cbf-9f7c6e4543a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:18.607050 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-a4aefae5-432c-4ae5-9cbf-9f7c6e4543a8 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:18.608443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a4aefae5-432c-4ae5-9cbf-9f7c6e4543a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:18.647682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 22/40] 10.222.0.64 () {58 vars in 1361 bytes} [Thu Jul 28 03:41:18 2022] PUT /identity/v3/domains/default/users/3f3fe43cd62f4e5186fa1917f6943de6/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:41:18.648972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5053be-9688-4978-8491-ed6f5f5277ce None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:18.649418 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5053be-9688-4978-8491-ed6f5f5277ce None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:18.649751 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5053be-9688-4978-8491-ed6f5f5277ce None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:18.651434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 23/41] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:18.657811 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9fbf3-ca46-40f1-9e2e-12a8af7d7191 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:18.658102 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9fbf3-ca46-40f1-9e2e-12a8af7d7191 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:18.658383 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9fbf3-ca46-40f1-9e2e-12a8af7d7191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:18.680081 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-aeb9fbf3-ca46-40f1-9e2e-12a8af7d7191 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:18.681862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-aeb9fbf3-ca46-40f1-9e2e-12a8af7d7191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:18.686366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:18.712479 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 19/42] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:18.744714 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aefae5-432c-4ae5-9cbf-9f7c6e4543a8 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:18.792043 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 24/43] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:41:18.821301 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9fbf3-ca46-40f1-9e2e-12a8af7d7191 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:18.901655 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aefae5-432c-4ae5-9cbf-9f7c6e4543a8 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:18.903376 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:18.940812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec07706-d2fd-4ead-8503-88cebc463428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:18.941487 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec07706-d2fd-4ead-8503-88cebc463428 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:18.941774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec07706-d2fd-4ead-8503-88cebc463428 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:18.942056 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec07706-d2fd-4ead-8503-88cebc463428 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:18.943269 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec07706-d2fd-4ead-8503-88cebc463428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:18.944777 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec07706-d2fd-4ead-8503-88cebc463428 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:18.946632 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 20/44] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:41:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:18.952609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec07706-d2fd-4ead-8503-88cebc463428 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:18.954466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9fbf3-ca46-40f1-9e2e-12a8af7d7191 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:18.997711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d4ff5-4ac2-4a2a-a445-ee6ed0b350eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:18.998360 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d4ff5-4ac2-4a2a-a445-ee6ed0b350eb None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:18.998645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d4ff5-4ac2-4a2a-a445-ee6ed0b350eb None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:18.998924 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d4ff5-4ac2-4a2a-a445-ee6ed0b350eb None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:18.999706 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d4ff5-4ac2-4a2a-a445-ee6ed0b350eb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:19.001112 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d4ff5-4ac2-4a2a-a445-ee6ed0b350eb None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:19.063235 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec07706-d2fd-4ead-8503-88cebc463428 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:19.079932 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:19.086122 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 25/45] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Jul 28 03:41:18 2022] POST /identity/v3/roles => generated 223 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:41:19.103550 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cd74c-9c37-40ba-a303-bb545bbdecda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:19.104204 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cd74c-9c37-40ba-a303-bb545bbdecda None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:19.104486 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cd74c-9c37-40ba-a303-bb545bbdecda None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:19.104759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cd74c-9c37-40ba-a303-bb545bbdecda None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:19.105486 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cd74c-9c37-40ba-a303-bb545bbdecda None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:19.106989 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cd74c-9c37-40ba-a303-bb545bbdecda None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:19.226323 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 21/46] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 28 03:41:18 2022] POST /identity/v3/projects => generated 312 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:41:20.782196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ba8a4-c214-4f28-8bda-e3baa019a4ce None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:20.782689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ba8a4-c214-4f28-8bda-e3baa019a4ce None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:20.782853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ba8a4-c214-4f28-8bda-e3baa019a4ce None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:20.785011 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 26/47] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:20.791234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa971e-28a4-4704-adc9-31a9a2029d77 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:20.791739 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa971e-28a4-4704-adc9-31a9a2029d77 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:20.791938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa971e-28a4-4704-adc9-31a9a2029d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:20.811644 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-81fa971e-28a4-4704-adc9-31a9a2029d77 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:20.812884 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-81fa971e-28a4-4704-adc9-31a9a2029d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:20.832675 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:20.890682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 22/48] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:20.914534 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ba8a4-c214-4f28-8bda-e3baa019a4ce None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:21.028728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ba8a4-c214-4f28-8bda-e3baa019a4ce None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:21.074988 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382d564-9b88-4515-bf11-969d579dd71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:21.075730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382d564-9b88-4515-bf11-969d579dd71f None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:21.076017 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382d564-9b88-4515-bf11-969d579dd71f None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:21.076295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382d564-9b88-4515-bf11-969d579dd71f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:21.090924 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382d564-9b88-4515-bf11-969d579dd71f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:21.097993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-0382d564-9b88-4515-bf11-969d579dd71f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:41:21.097993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:21.097993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:21.097993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:21.097993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:21.097993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:21.097993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:21.097993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:21.097993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:21.097993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:21.097993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:21.097993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:21.097993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:21.097993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:21.097993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:21.097993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:21.099144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:21.099144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:21.099144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:21.099144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:21.099144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:21.099144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:21.099144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:21.099144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:21.099144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:21.099144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:21.099144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:21.099144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:21.099144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:21.099144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:21.099144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:21.099144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:21.100339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:21.100339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:21.100339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:21.100339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:21.100339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:21.100339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:21.100339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:21.100339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:21.100339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:21.100339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:21.100339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:41:21.100339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:41:21.100339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 27/49] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:41:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:21.106327 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa971e-28a4-4704-adc9-31a9a2029d77 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:21.231860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa971e-28a4-4704-adc9-31a9a2029d77 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:21.271806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5240ce-9ead-4896-be92-456948a8b7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:21.272461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5240ce-9ead-4896-be92-456948a8b7c7 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:21.272746 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5240ce-9ead-4896-be92-456948a8b7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:21.273024 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5240ce-9ead-4896-be92-456948a8b7c7 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:21.273768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5240ce-9ead-4896-be92-456948a8b7c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:21.274077 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5240ce-9ead-4896-be92-456948a8b7c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:21.275564 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5240ce-9ead-4896-be92-456948a8b7c7 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:21.280507 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e5de7-947f-4df8-a66d-7e97d040c6b5 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:21.280994 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e5de7-947f-4df8-a66d-7e97d040c6b5 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:21.281346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e5de7-947f-4df8-a66d-7e97d040c6b5 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:21.283093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 28/50] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:21.286143 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 23/51] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:21.289726 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f6c05-797c-40c1-94d1-daa366dd70ae None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:21.290113 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f6c05-797c-40c1-94d1-daa366dd70ae None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:21.290281 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f6c05-797c-40c1-94d1-daa366dd70ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:21.293003 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5240ce-9ead-4896-be92-456948a8b7c7 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:21.314367 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:21.314788 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-2d6f6c05-797c-40c1-94d1-daa366dd70ae None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:21.317684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-2d6f6c05-797c-40c1-94d1-daa366dd70ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:21.399682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:21.408125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5240ce-9ead-4896-be92-456948a8b7c7 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:21.412188 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 29/52] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:21.435523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f6c05-797c-40c1-94d1-daa366dd70ae None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:21.447538 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6858b31-ccae-46e7-86aa-bb0dabf9b0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:21.448268 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6858b31-ccae-46e7-86aa-bb0dabf9b0da None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:21.448555 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6858b31-ccae-46e7-86aa-bb0dabf9b0da None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:21.448837 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6858b31-ccae-46e7-86aa-bb0dabf9b0da None admin] PATH_INFO: `/v3/users/3f3fe43cd62f4e5186fa1917f6943de6` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:21.450110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6858b31-ccae-46e7-86aa-bb0dabf9b0da None admin] RBAC: Authorizing `identity:get_user(user_id=3f3fe43cd62f4e5186fa1917f6943de6)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:21.452042 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6858b31-ccae-46e7-86aa-bb0dabf9b0da None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:21.453310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 24/53] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:21 2022] GET /identity/v3/users/3f3fe43cd62f4e5186fa1917f6943de6 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:21.458884 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6858b31-ccae-46e7-86aa-bb0dabf9b0da None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:21.557395 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:21.566154 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f6c05-797c-40c1-94d1-daa366dd70ae None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:21.576150 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6858b31-ccae-46e7-86aa-bb0dabf9b0da None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:21.603607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24661e73-13c9-4262-ba98-84a5f00ac311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:21.604271 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24661e73-13c9-4262-ba98-84a5f00ac311 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:21.604563 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24661e73-13c9-4262-ba98-84a5f00ac311 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:21.604845 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24661e73-13c9-4262-ba98-84a5f00ac311 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:21.606074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24661e73-13c9-4262-ba98-84a5f00ac311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:21.607599 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24661e73-13c9-4262-ba98-84a5f00ac311 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:21.609332 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 30/54] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:41:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:21.615662 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24661e73-13c9-4262-ba98-84a5f00ac311 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:21.617289 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ffcf7-f3ad-4528-bbf8-a1d17bedf9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:21.617963 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ffcf7-f3ad-4528-bbf8-a1d17bedf9e8 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:21.618247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ffcf7-f3ad-4528-bbf8-a1d17bedf9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:21.618529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ffcf7-f3ad-4528-bbf8-a1d17bedf9e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:21.619759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ffcf7-f3ad-4528-bbf8-a1d17bedf9e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:21.621273 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ffcf7-f3ad-4528-bbf8-a1d17bedf9e8 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:21.622981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 25/55] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:41:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:21.628878 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ffcf7-f3ad-4528-bbf8-a1d17bedf9e8 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:21.683573 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:21.736097 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24661e73-13c9-4262-ba98-84a5f00ac311 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:21.750474 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ffcf7-f3ad-4528-bbf8-a1d17bedf9e8 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:21.775181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92b61e-7dab-41ad-b29e-48488a8a0277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:21.776258 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92b61e-7dab-41ad-b29e-48488a8a0277 None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:21.776547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92b61e-7dab-41ad-b29e-48488a8a0277 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:21.776842 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92b61e-7dab-41ad-b29e-48488a8a0277 None admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:21.777524 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92b61e-7dab-41ad-b29e-48488a8a0277 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:21.778990 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92b61e-7dab-41ad-b29e-48488a8a0277 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:21.793191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8902c-f6e2-460e-b59f-e6a668d6d373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:21.793832 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8902c-f6e2-460e-b59f-e6a668d6d373 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:21.794119 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8902c-f6e2-460e-b59f-e6a668d6d373 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:21.794396 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8902c-f6e2-460e-b59f-e6a668d6d373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:21.795199 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8902c-f6e2-460e-b59f-e6a668d6d373 None admin] RBAC: Adding query filter params (role.id=8a5766c4aef44773834941d1bdbd1e98, scope.domain.id=default, user.id=3f3fe43cd62f4e5186fa1917f6943de6) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:21.795544 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8902c-f6e2-460e-b59f-e6a668d6d373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:21.797020 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8902c-f6e2-460e-b59f-e6a668d6d373 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:21.803896 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 26/56] 10.222.0.64 () {56 vars in 1322 bytes} [Thu Jul 28 03:41:21 2022] GET /identity/v3/role_assignments?user.id=3f3fe43cd62f4e5186fa1917f6943de6&scope.domain.id=default&role.id=8a5766c4aef44773834941d1bdbd1e98 => generated 530 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:21.874183 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 31/57] 10.222.0.64 () {60 vars in 1140 bytes} [Thu Jul 28 03:41:21 2022] POST /identity/v3/projects => generated 298 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:41:23.941576 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137ea93-ecdc-411f-a9e1-5dcac843fc22 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:23.942080 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137ea93-ecdc-411f-a9e1-5dcac843fc22 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:23.942164 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137ea93-ecdc-411f-a9e1-5dcac843fc22 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:23.943527 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 27/58] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:23.948802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ff169-0cc8-45db-8785-3e1de3f21095 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:23.949232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ff169-0cc8-45db-8785-3e1de3f21095 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:23.949365 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ff169-0cc8-45db-8785-3e1de3f21095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:23.968286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-a00ff169-0cc8-45db-8785-3e1de3f21095 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:23.969500 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a00ff169-0cc8-45db-8785-3e1de3f21095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:24.040396 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 32/59] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:24.065455 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137ea93-ecdc-411f-a9e1-5dcac843fc22 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:24.082228 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:24.172512 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137ea93-ecdc-411f-a9e1-5dcac843fc22 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:24.209540 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d8952-5212-4de9-94e2-4915a2981d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:24.210190 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d8952-5212-4de9-94e2-4915a2981d8d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:24.210472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d8952-5212-4de9-94e2-4915a2981d8d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:24.210749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d8952-5212-4de9-94e2-4915a2981d8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:24.211951 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d8952-5212-4de9-94e2-4915a2981d8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:24.213409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d8952-5212-4de9-94e2-4915a2981d8d None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:24.214994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 28/60] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:41:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:24.220617 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ff169-0cc8-45db-8785-3e1de3f21095 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:24.264269 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:24.324003 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ff169-0cc8-45db-8785-3e1de3f21095 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:24.359074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de454766-7878-4a84-9e6d-25dc03880946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:24.359733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de454766-7878-4a84-9e6d-25dc03880946 None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:24.360014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de454766-7878-4a84-9e6d-25dc03880946 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:24.360292 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de454766-7878-4a84-9e6d-25dc03880946 None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:24.360993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de454766-7878-4a84-9e6d-25dc03880946 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:24.363119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de454766-7878-4a84-9e6d-25dc03880946 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:24.483470 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 33/61] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 28 03:41:24 2022] POST /identity/v3/users => generated 275 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:41:27.818175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60558e35-e550-44ce-bd98-3ba6241785b1 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:27.819184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60558e35-e550-44ce-bd98-3ba6241785b1 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:27.819724 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60558e35-e550-44ce-bd98-3ba6241785b1 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:27.821854 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 29/62] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:27.827389 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc8266-bfd3-4327-a0dc-b5efe2ae5397 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:27.827886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc8266-bfd3-4327-a0dc-b5efe2ae5397 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:27.827980 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc8266-bfd3-4327-a0dc-b5efe2ae5397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:27.857756 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-1acc8266-bfd3-4327-a0dc-b5efe2ae5397 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:27.859006 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-1acc8266-bfd3-4327-a0dc-b5efe2ae5397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:27.966286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 34/63] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:27.989663 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60558e35-e550-44ce-bd98-3ba6241785b1 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:28.048309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78443cf9-5c18-4c34-b0a0-32b532685ecf None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:28.048938 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78443cf9-5c18-4c34-b0a0-32b532685ecf None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:28.049985 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78443cf9-5c18-4c34-b0a0-32b532685ecf None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:28.052124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 35/64] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:28.069051 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa2eab-dff2-40f4-aa7a-b3d447d330f3 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:28.069670 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa2eab-dff2-40f4-aa7a-b3d447d330f3 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:28.070156 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa2eab-dff2-40f4-aa7a-b3d447d330f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:28.096733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-12aa2eab-dff2-40f4-aa7a-b3d447d330f3 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:28.098246 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-12aa2eab-dff2-40f4-aa7a-b3d447d330f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:28.127060 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:28.142562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:28.170723 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60558e35-e550-44ce-bd98-3ba6241785b1 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:28.186614 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 36/65] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:41:28.188558 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ca876-7174-4800-a22c-7388ebce4da7 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:28.188999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ca876-7174-4800-a22c-7388ebce4da7 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:28.189425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ca876-7174-4800-a22c-7388ebce4da7 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:28.191945 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 37/66] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:28.206442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254c29a-5af3-4ffe-b4a2-8f2989e5dc6f None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:28.207227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254c29a-5af3-4ffe-b4a2-8f2989e5dc6f None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:28.207911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254c29a-5af3-4ffe-b4a2-8f2989e5dc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:28.229104 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f2c46-47bf-457b-8911-7c18341a7e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:28.230009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f2c46-47bf-457b-8911-7c18341a7e6d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:28.230435 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f2c46-47bf-457b-8911-7c18341a7e6d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:28.230935 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f2c46-47bf-457b-8911-7c18341a7e6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:28.240960 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-5254c29a-5af3-4ffe-b4a2-8f2989e5dc6f None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:28.243020 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f2c46-47bf-457b-8911-7c18341a7e6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:28.243139 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-5254c29a-5af3-4ffe-b4a2-8f2989e5dc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:28.248373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-dc1f2c46-47bf-457b-8911-7c18341a7e6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:28.248373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:28.248373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:28.248373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:28.248373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:28.248373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:28.248373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:28.248373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:28.248373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:28.248373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:28.248373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:28.248373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:28.248373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:28.248373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:28.248373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:28.248373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:28.249441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:28.249441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:28.249441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:28.249441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:28.249441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:28.249441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:28.249441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:28.249441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:28.249441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:28.249441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:28.249441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:28.249441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:28.249441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:28.249441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:28.249441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:28.249441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:28.250202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:28.250202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:28.250202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:28.250202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:28.250202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:28.250202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:28.250202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:28.250202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:28.250202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:28.250202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:28.250202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:28.250202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:41:28.250764 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 30/67] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:28.255860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f2c46-47bf-457b-8911-7c18341a7e6d None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:28.337542 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 38/68] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:28.339303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15f3ec-2e17-47fc-8a1b-75658ab9959d None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:28.339835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15f3ec-2e17-47fc-8a1b-75658ab9959d None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:28.340306 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15f3ec-2e17-47fc-8a1b-75658ab9959d None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:28.341931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 39/69] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:28.342864 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15f3ec-2e17-47fc-8a1b-75658ab9959d None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:28.391487 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f2c46-47bf-457b-8911-7c18341a7e6d None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:28.434955 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79265b24-69fe-417f-a127-37d42e9d53ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:28.435641 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79265b24-69fe-417f-a127-37d42e9d53ca None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:28.435927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79265b24-69fe-417f-a127-37d42e9d53ca None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:28.436200 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79265b24-69fe-417f-a127-37d42e9d53ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:28.448355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79265b24-69fe-417f-a127-37d42e9d53ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:28.453779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-79265b24-69fe-417f-a127-37d42e9d53ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:41:28.453779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:28.453779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:28.453779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:28.453779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:28.453779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:28.453779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:28.453779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:28.453779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:28.453779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:28.453779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:28.453779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:28.453779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:28.453779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:28.453779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:28.453779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:28.454652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:28.454652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:28.454652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:28.454652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:28.454652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:28.454652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:28.454652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:28.454652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:28.454652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:28.454652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:28.454652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:28.454652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:28.454652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:28.454652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:28.454652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:28.454652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:28.455430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:28.455430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:28.455430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:28.455430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:28.455430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:28.455430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:28.455430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:28.455430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:28.455430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:28.455430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:28.455430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:41:28.455430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:41:28.455430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 31/70] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:41:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:28.457290 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdd379-dcfb-4d32-831d-7ef38015de5d None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:28.457290 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdd379-dcfb-4d32-831d-7ef38015de5d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:28.457290 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdd379-dcfb-4d32-831d-7ef38015de5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:28.464145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:28.465512 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:28.477719 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-ddfdd379-dcfb-4d32-831d-7ef38015de5d None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:28.479298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ddfdd379-dcfb-4d32-831d-7ef38015de5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:28.481923 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15f3ec-2e17-47fc-8a1b-75658ab9959d None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:28.521757 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e4980-68b3-4cf3-9d31-32d5609f9c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:28.522406 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e4980-68b3-4cf3-9d31-32d5609f9c01 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:28.522765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e4980-68b3-4cf3-9d31-32d5609f9c01 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:28.523053 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e4980-68b3-4cf3-9d31-32d5609f9c01 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:28.523824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e4980-68b3-4cf3-9d31-32d5609f9c01 None admin] RBAC: Adding query filter params (name=member) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:28.524136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e4980-68b3-4cf3-9d31-32d5609f9c01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:28.525540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e4980-68b3-4cf3-9d31-32d5609f9c01 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:28.535613 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 40/71] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:41:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:28.536478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e4980-68b3-4cf3-9d31-32d5609f9c01 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:28.564926 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 32/72] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:28.566871 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b5f01-94ec-43c8-9421-1fec0150d5b0 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:28.567362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b5f01-94ec-43c8-9421-1fec0150d5b0 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:28.567803 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b5f01-94ec-43c8-9421-1fec0150d5b0 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:28.569317 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 33/73] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:28.570043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b5f01-94ec-43c8-9421-1fec0150d5b0 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:28.645832 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e4980-68b3-4cf3-9d31-32d5609f9c01 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:28.685733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aadd5b-a058-4278-a080-d5c427c59590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:28.686395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aadd5b-a058-4278-a080-d5c427c59590 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:28.686681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aadd5b-a058-4278-a080-d5c427c59590 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:28.686964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aadd5b-a058-4278-a080-d5c427c59590 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:28.698588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aadd5b-a058-4278-a080-d5c427c59590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:28.704114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-98aadd5b-a058-4278-a080-d5c427c59590 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:41:28.704114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:28.704114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:28.704114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:28.704114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:28.704114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:28.704114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:28.704114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:28.704114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:28.704114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:28.704114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:28.704114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:28.704114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:28.704114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:28.704114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:28.704114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:28.706321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:28.706321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:28.706321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:28.706321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:28.706321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:28.706321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:28.706321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:28.706321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:28.706321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:28.706321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:28.706321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:28.706321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:28.706321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:28.706321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:28.706321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:28.706321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:28.707821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:28.707821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:28.707821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:28.707821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:28.707821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:28.707821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:28.707821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:28.707821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:28.707821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:28.707821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:28.707821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:41:28.707821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:41:28.707821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 41/74] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:41:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:28.707821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aadd5b-a058-4278-a080-d5c427c59590 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:28.711133 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b5f01-94ec-43c8-9421-1fec0150d5b0 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:28.718346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:28.742970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:28.748651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470c418-9a1c-41f3-a1da-0a5b64cd822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:28.749296 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470c418-9a1c-41f3-a1da-0a5b64cd822d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:28.749580 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470c418-9a1c-41f3-a1da-0a5b64cd822d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:28.749854 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470c418-9a1c-41f3-a1da-0a5b64cd822d None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:28.750630 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470c418-9a1c-41f3-a1da-0a5b64cd822d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:28.750935 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470c418-9a1c-41f3-a1da-0a5b64cd822d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:28.752568 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470c418-9a1c-41f3-a1da-0a5b64cd822d None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:28.765065 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 34/75] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:28.765065 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f84ea5-4ee0-4975-bba0-18d0705939bf None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:28.765065 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f84ea5-4ee0-4975-bba0-18d0705939bf None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:28.765065 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f84ea5-4ee0-4975-bba0-18d0705939bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:28.783159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-88f84ea5-4ee0-4975-bba0-18d0705939bf None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:28.785749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-88f84ea5-4ee0-4975-bba0-18d0705939bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:28.821707 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aadd5b-a058-4278-a080-d5c427c59590 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:28.856088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 35/76] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:28.856954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f84ea5-4ee0-4975-bba0-18d0705939bf None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:28.861151 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f47a6-7ef3-4767-a440-001d45634ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:28.862298 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f47a6-7ef3-4767-a440-001d45634ffd None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:28.862298 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f47a6-7ef3-4767-a440-001d45634ffd None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:28.862610 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f47a6-7ef3-4767-a440-001d45634ffd None admin] PATH_INFO: `/v3/users/427345877d57430294ac22048db4a8c5` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:28.881775 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f47a6-7ef3-4767-a440-001d45634ffd None admin] RBAC: Authorizing `identity:get_user(user_id=427345877d57430294ac22048db4a8c5)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:28.883258 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f47a6-7ef3-4767-a440-001d45634ffd None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:28.885179 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 42/77] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:28 2022] GET /identity/v3/users/427345877d57430294ac22048db4a8c5 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:28.885767 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f47a6-7ef3-4767-a440-001d45634ffd None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:28.955682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:28.962994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f84ea5-4ee0-4975-bba0-18d0705939bf None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:28.988636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:28.992425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f47a6-7ef3-4767-a440-001d45634ffd None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:29.001390 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee39e5b-03f1-4b2c-ad6c-9378d26fe05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:29.002063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee39e5b-03f1-4b2c-ad6c-9378d26fe05c None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:29.002395 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee39e5b-03f1-4b2c-ad6c-9378d26fe05c None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:29.002820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee39e5b-03f1-4b2c-ad6c-9378d26fe05c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:29.013730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee39e5b-03f1-4b2c-ad6c-9378d26fe05c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:29.019844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-0ee39e5b-03f1-4b2c-ad6c-9378d26fe05c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:29.019844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:29.019844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:29.019844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:29.019844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:29.019844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:29.019844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:29.019844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:29.019844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:29.019844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:29.019844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:29.019844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:29.019844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:29.019844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:29.019844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:29.019844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:29.020703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:29.020703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:29.020703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:29.020703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:29.020703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:29.020703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:29.020703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:29.020703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:29.020703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:29.020703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:29.020703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:29.020703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:29.020703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:29.020703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:29.020703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:29.020703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:29.021469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:29.021469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:29.021469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:29.021469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:29.021469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:29.021469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:29.021469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:29.021469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:29.021469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:29.021469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:29.021469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:29.021469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:41:29.021469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 36/78] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:29.022104 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee39e5b-03f1-4b2c-ad6c-9378d26fe05c None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:29.029506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f81fbf-7679-4c8c-a425-9e035be51f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:29.030145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f81fbf-7679-4c8c-a425-9e035be51f5d None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:29.030430 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f81fbf-7679-4c8c-a425-9e035be51f5d None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:29.030717 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f81fbf-7679-4c8c-a425-9e035be51f5d None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:29.031737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f81fbf-7679-4c8c-a425-9e035be51f5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:29.032043 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f81fbf-7679-4c8c-a425-9e035be51f5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:29.033456 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f81fbf-7679-4c8c-a425-9e035be51f5d None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:29.042482 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 43/79] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:41:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:29.043329 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f81fbf-7679-4c8c-a425-9e035be51f5d None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:29.126547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee39e5b-03f1-4b2c-ad6c-9378d26fe05c None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:29.152269 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f81fbf-7679-4c8c-a425-9e035be51f5d None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:29.162229 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47181d8-58f1-44a6-beef-5686f33fbebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:29.162889 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47181d8-58f1-44a6-beef-5686f33fbebe None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:29.163235 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47181d8-58f1-44a6-beef-5686f33fbebe None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:29.163551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47181d8-58f1-44a6-beef-5686f33fbebe None admin] PATH_INFO: `/v3/users/3f3fe43cd62f4e5186fa1917f6943de6` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:29.164735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47181d8-58f1-44a6-beef-5686f33fbebe None admin] RBAC: Authorizing `identity:get_user(user_id=3f3fe43cd62f4e5186fa1917f6943de6)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:29.166212 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47181d8-58f1-44a6-beef-5686f33fbebe None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:29.167877 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 37/80] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:29 2022] GET /identity/v3/users/3f3fe43cd62f4e5186fa1917f6943de6 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:29.168646 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47181d8-58f1-44a6-beef-5686f33fbebe None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:29.182977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:29.192071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93e101-ff95-40cf-ac31-721c9ad4e01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:29.192734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e101-ff95-40cf-ac31-721c9ad4e01e None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:29.193023 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e101-ff95-40cf-ac31-721c9ad4e01e None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:29.193302 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93e101-ff95-40cf-ac31-721c9ad4e01e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:29.194493 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93e101-ff95-40cf-ac31-721c9ad4e01e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:29.196014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93e101-ff95-40cf-ac31-721c9ad4e01e None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:29.197705 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 44/81] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:41:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:29.198582 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93e101-ff95-40cf-ac31-721c9ad4e01e None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:29.224329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:29.273196 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47181d8-58f1-44a6-beef-5686f33fbebe None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:29.304316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93e101-ff95-40cf-ac31-721c9ad4e01e None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:29.310216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ebed6-2abf-40c4-be6e-3bbd9c91d9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:29.310889 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ebed6-2abf-40c4-be6e-3bbd9c91d9fd None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:29.311214 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ebed6-2abf-40c4-be6e-3bbd9c91d9fd None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:29.311546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ebed6-2abf-40c4-be6e-3bbd9c91d9fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:29.339019 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c9cad-2658-4d9a-9d3a-16ecf6c5ccf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:29.339697 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c9cad-2658-4d9a-9d3a-16ecf6c5ccf0 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:29.339987 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c9cad-2658-4d9a-9d3a-16ecf6c5ccf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:29.340270 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c9cad-2658-4d9a-9d3a-16ecf6c5ccf0 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:29.341000 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c9cad-2658-4d9a-9d3a-16ecf6c5ccf0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:29.341308 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c9cad-2658-4d9a-9d3a-16ecf6c5ccf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:29.342700 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c9cad-2658-4d9a-9d3a-16ecf6c5ccf0 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:29.351031 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 45/82] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:41:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:29.351921 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c9cad-2658-4d9a-9d3a-16ecf6c5ccf0 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:29.386994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ebed6-2abf-40c4-be6e-3bbd9c91d9fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:29.388655 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ebed6-2abf-40c4-be6e-3bbd9c91d9fd None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:29.415518 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:29.441134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:29.458382 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c9cad-2658-4d9a-9d3a-16ecf6c5ccf0 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:29.493497 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf99705-c226-46e2-86b3-4024fc358966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:29.494063 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf99705-c226-46e2-86b3-4024fc358966 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:29.494347 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf99705-c226-46e2-86b3-4024fc358966 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:29.494626 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf99705-c226-46e2-86b3-4024fc358966 None admin] PATH_INFO: `/v3/users/427345877d57430294ac22048db4a8c5` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:29.495055 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 38/83] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:29.495940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ebed6-2abf-40c4-be6e-3bbd9c91d9fd None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:29.500579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf99705-c226-46e2-86b3-4024fc358966 None admin] RBAC: Authorizing `identity:get_user(user_id=427345877d57430294ac22048db4a8c5)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:29.502179 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf99705-c226-46e2-86b3-4024fc358966 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:29.504556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 46/84] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:29 2022] GET /identity/v3/users/427345877d57430294ac22048db4a8c5 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:29.505315 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf99705-c226-46e2-86b3-4024fc358966 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:29.595466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ebed6-2abf-40c4-be6e-3bbd9c91d9fd None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:29.608061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf99705-c226-46e2-86b3-4024fc358966 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:29.630403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767f65a-2084-44a0-8e89-7af2818e5f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:29.631037 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767f65a-2084-44a0-8e89-7af2818e5f86 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:29.631336 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767f65a-2084-44a0-8e89-7af2818e5f86 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:29.631635 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767f65a-2084-44a0-8e89-7af2818e5f86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:29.634211 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:29.642848 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867129ce-915c-4e71-ae35-bd96901e2d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:29.644023 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867129ce-915c-4e71-ae35-bd96901e2d7e None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:29.644403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867129ce-915c-4e71-ae35-bd96901e2d7e None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:29.644683 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867129ce-915c-4e71-ae35-bd96901e2d7e None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:29.645377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867129ce-915c-4e71-ae35-bd96901e2d7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:29.646849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867129ce-915c-4e71-ae35-bd96901e2d7e None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:29.653564 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:29.699938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767f65a-2084-44a0-8e89-7af2818e5f86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:29.701498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767f65a-2084-44a0-8e89-7af2818e5f86 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:29.779435 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 47/85] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 28 03:41:29 2022] POST /identity/v3/users => generated 289 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:41:29.779435 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867129ce-915c-4e71-ae35-bd96901e2d7e None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:29.813538 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 39/86] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:29.814433 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767f65a-2084-44a0-8e89-7af2818e5f86 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:29.880305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:29.908369 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867129ce-915c-4e71-ae35-bd96901e2d7e None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:29.946335 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767f65a-2084-44a0-8e89-7af2818e5f86 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:29.949474 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a19066-9872-47c3-b5ae-7a6e3ffe4489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:29.950145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a19066-9872-47c3-b5ae-7a6e3ffe4489 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:29.950435 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a19066-9872-47c3-b5ae-7a6e3ffe4489 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:29.950714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a19066-9872-47c3-b5ae-7a6e3ffe4489 None admin] PATH_INFO: `/v3/users/427345877d57430294ac22048db4a8c5` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:29.952685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a19066-9872-47c3-b5ae-7a6e3ffe4489 None admin] RBAC: Authorizing `identity:get_user(user_id=427345877d57430294ac22048db4a8c5)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:29.954182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a19066-9872-47c3-b5ae-7a6e3ffe4489 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:29.956613 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 48/87] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:29 2022] GET /identity/v3/users/427345877d57430294ac22048db4a8c5 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:29.957250 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a19066-9872-47c3-b5ae-7a6e3ffe4489 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:29.988386 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2698619-8fea-4d45-b5b1-7e6127fbc4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:29.989063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2698619-8fea-4d45-b5b1-7e6127fbc4aa None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:29.989365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2698619-8fea-4d45-b5b1-7e6127fbc4aa None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:29.989636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2698619-8fea-4d45-b5b1-7e6127fbc4aa None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:29.990850 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2698619-8fea-4d45-b5b1-7e6127fbc4aa None admin] RBAC: Authorizing `identity:get_project(project_id=856293872ed14cbda37a5830759ee4e7)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:29.992676 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2698619-8fea-4d45-b5b1-7e6127fbc4aa None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:29.994350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 40/88] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:29 2022] GET /identity/v3/projects/856293872ed14cbda37a5830759ee4e7 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:29.999611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2698619-8fea-4d45-b5b1-7e6127fbc4aa None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:30.022826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:30.100088 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a19066-9872-47c3-b5ae-7a6e3ffe4489 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:30.151240 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2698619-8fea-4d45-b5b1-7e6127fbc4aa None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:30.154708 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e3aa5-7ca1-4800-92ac-d1d729ed4cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:30.155443 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e3aa5-7ca1-4800-92ac-d1d729ed4cd8 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:30.155734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e3aa5-7ca1-4800-92ac-d1d729ed4cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:30.156014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e3aa5-7ca1-4800-92ac-d1d729ed4cd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:30.175465 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:30.192113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf3c7f-3b8a-4c20-942c-8cca70574d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:30.194121 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf3c7f-3b8a-4c20-942c-8cca70574d07 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:30.194121 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf3c7f-3b8a-4c20-942c-8cca70574d07 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:30.194121 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf3c7f-3b8a-4c20-942c-8cca70574d07 None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:30.195272 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf3c7f-3b8a-4c20-942c-8cca70574d07 None admin] RBAC: Authorizing `identity:get_project(project_id=856293872ed14cbda37a5830759ee4e7)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:30.196915 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf3c7f-3b8a-4c20-942c-8cca70574d07 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:30.198925 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 41/89] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:29 2022] GET /identity/v3/projects/856293872ed14cbda37a5830759ee4e7 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:30.199954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf3c7f-3b8a-4c20-942c-8cca70574d07 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:30.241252 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e3aa5-7ca1-4800-92ac-d1d729ed4cd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:30.242837 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e3aa5-7ca1-4800-92ac-d1d729ed4cd8 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:30.298697 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:30.318302 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf3c7f-3b8a-4c20-942c-8cca70574d07 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:30.368100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaaae1-7bcd-4a0a-9539-091e7a33688a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:30.369094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaaae1-7bcd-4a0a-9539-091e7a33688a None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:30.369399 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaaae1-7bcd-4a0a-9539-091e7a33688a None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:30.369685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaaae1-7bcd-4a0a-9539-091e7a33688a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:30.373036 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 49/90] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:30.375168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e3aa5-7ca1-4800-92ac-d1d729ed4cd8 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:30.438306 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:30.458070 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eaaae1-7bcd-4a0a-9539-091e7a33688a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:30.459893 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eaaae1-7bcd-4a0a-9539-091e7a33688a None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:30.501453 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e3aa5-7ca1-4800-92ac-d1d729ed4cd8 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:30.547380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6af25-9bfb-4c34-97a6-d4f5cb70958e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:30.547380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6af25-9bfb-4c34-97a6-d4f5cb70958e None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:30.547380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6af25-9bfb-4c34-97a6-d4f5cb70958e None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:30.547380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6af25-9bfb-4c34-97a6-d4f5cb70958e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:30.547732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6af25-9bfb-4c34-97a6-d4f5cb70958e None admin] RBAC: Adding query filter params (role.id=43f173da338d498382fba44911238254, scope.project.id=856293872ed14cbda37a5830759ee4e7, user.id=427345877d57430294ac22048db4a8c5) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:30.547732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6af25-9bfb-4c34-97a6-d4f5cb70958e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:30.547732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6af25-9bfb-4c34-97a6-d4f5cb70958e None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:30.555407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 50/91] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:41:30 2022] GET /identity/v3/role_assignments?user.id=427345877d57430294ac22048db4a8c5&scope.project.id=856293872ed14cbda37a5830759ee4e7&role.id=43f173da338d498382fba44911238254 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:30.556241 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6af25-9bfb-4c34-97a6-d4f5cb70958e None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:30.576129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:30.629533 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 42/92] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:30.630464 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaaae1-7bcd-4a0a-9539-091e7a33688a None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:30.767239 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6af25-9bfb-4c34-97a6-d4f5cb70958e None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:30.807344 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:30.822481 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eaaae1-7bcd-4a0a-9539-091e7a33688a None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:30.827313 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f425a-c04f-4956-a26f-856865cb0adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:30.827994 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f425a-c04f-4956-a26f-856865cb0adc None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:30.828283 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f425a-c04f-4956-a26f-856865cb0adc None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:30.828565 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f425a-c04f-4956-a26f-856865cb0adc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:30.829374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f425a-c04f-4956-a26f-856865cb0adc None admin] RBAC: Adding query filter params (role.id=8a5766c4aef44773834941d1bdbd1e98, scope.project.id=856293872ed14cbda37a5830759ee4e7, user.id=3f3fe43cd62f4e5186fa1917f6943de6) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:30.829689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f425a-c04f-4956-a26f-856865cb0adc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:30.831846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f425a-c04f-4956-a26f-856865cb0adc None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:30.840255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 51/93] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:41:30 2022] GET /identity/v3/role_assignments?user.id=3f3fe43cd62f4e5186fa1917f6943de6&scope.project.id=856293872ed14cbda37a5830759ee4e7&role.id=8a5766c4aef44773834941d1bdbd1e98 => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:30.841254 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f425a-c04f-4956-a26f-856865cb0adc None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:30.904450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd29ff-c6ed-48b0-8dae-6869dd336c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:30.905113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd29ff-c6ed-48b0-8dae-6869dd336c56 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:30.905327 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd29ff-c6ed-48b0-8dae-6869dd336c56 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:30.905606 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd29ff-c6ed-48b0-8dae-6869dd336c56 None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:30.907380 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd29ff-c6ed-48b0-8dae-6869dd336c56 None admin] RBAC: Authorizing `identity:get_project(project_id=856293872ed14cbda37a5830759ee4e7)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:30.909481 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd29ff-c6ed-48b0-8dae-6869dd336c56 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:30.911530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 43/94] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:30 2022] GET /identity/v3/projects/856293872ed14cbda37a5830759ee4e7 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:30.922424 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd29ff-c6ed-48b0-8dae-6869dd336c56 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:31.048905 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:31.097198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f425a-c04f-4956-a26f-856865cb0adc None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:31.138352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd29ff-c6ed-48b0-8dae-6869dd336c56 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:31.168214 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8e326-557e-4691-b45c-934ec9a9c180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:31.168824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8e326-557e-4691-b45c-934ec9a9c180 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:31.169112 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8e326-557e-4691-b45c-934ec9a9c180 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:31.169392 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8e326-557e-4691-b45c-934ec9a9c180 None admin] PATH_INFO: `/v3/projects/be50a41a2163492abc7db04b97a96031` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:31.170700 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8e326-557e-4691-b45c-934ec9a9c180 None admin] RBAC: Authorizing `identity:get_project(project_id=be50a41a2163492abc7db04b97a96031)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:31.172198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8e326-557e-4691-b45c-934ec9a9c180 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:31.173899 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 52/95] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:30 2022] GET /identity/v3/projects/be50a41a2163492abc7db04b97a96031 => generated 312 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:31.186796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8e326-557e-4691-b45c-934ec9a9c180 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:31.220690 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb74686-9b38-4147-afe8-4472e68b32ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:31.222251 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb74686-9b38-4147-afe8-4472e68b32ca None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:31.222736 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb74686-9b38-4147-afe8-4472e68b32ca None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:31.223229 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb74686-9b38-4147-afe8-4472e68b32ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:31.224267 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb74686-9b38-4147-afe8-4472e68b32ca None admin] RBAC: Adding query filter params (role.id=81c955f5702546679605b5484602ae69, scope.project.id=856293872ed14cbda37a5830759ee4e7, user.id=427345877d57430294ac22048db4a8c5) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:31.224784 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb74686-9b38-4147-afe8-4472e68b32ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:31.226553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb74686-9b38-4147-afe8-4472e68b32ca None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:31.240475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 44/96] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:41:30 2022] GET /identity/v3/role_assignments?user.id=427345877d57430294ac22048db4a8c5&scope.project.id=856293872ed14cbda37a5830759ee4e7&role.id=81c955f5702546679605b5484602ae69 => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:31.345595 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8e326-557e-4691-b45c-934ec9a9c180 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:31.388100 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c4603-dadd-4b58-9b82-4b1a272ce006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:31.388754 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c4603-dadd-4b58-9b82-4b1a272ce006 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:31.389042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c4603-dadd-4b58-9b82-4b1a272ce006 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:31.389322 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c4603-dadd-4b58-9b82-4b1a272ce006 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:31.390153 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c4603-dadd-4b58-9b82-4b1a272ce006 None admin] RBAC: Adding query filter params (role.id=43f173da338d498382fba44911238254, scope.project.id=be50a41a2163492abc7db04b97a96031, user.id=427345877d57430294ac22048db4a8c5) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:31.390459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c4603-dadd-4b58-9b82-4b1a272ce006 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:31.392007 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c4603-dadd-4b58-9b82-4b1a272ce006 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:31.399640 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 53/97] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:41:31 2022] GET /identity/v3/role_assignments?user.id=427345877d57430294ac22048db4a8c5&scope.project.id=be50a41a2163492abc7db04b97a96031&role.id=43f173da338d498382fba44911238254 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:32.338443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21618169-5b92-4294-91a7-c3958ae5a6ee None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:32.339481 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21618169-5b92-4294-91a7-c3958ae5a6ee None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:32.339972 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21618169-5b92-4294-91a7-c3958ae5a6ee None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:32.341647 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 45/98] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:32.355566 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6b38d-9675-4c63-893d-97c8b461bccd None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:32.356247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6b38d-9675-4c63-893d-97c8b461bccd None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:32.356247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6b38d-9675-4c63-893d-97c8b461bccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:32.385243 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-5ed6b38d-9675-4c63-893d-97c8b461bccd None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:32.386561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-5ed6b38d-9675-4c63-893d-97c8b461bccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:32.389835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:32.425757 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2043-c94e-4665-9408-9f44e5e6fcf4 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:32.426380 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2043-c94e-4665-9408-9f44e5e6fcf4 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:32.426860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2043-c94e-4665-9408-9f44e5e6fcf4 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:32.428515 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 46/99] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:32.433650 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf8d5b-af24-44c3-bc6c-441b2d2f57c7 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:32.434185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf8d5b-af24-44c3-bc6c-441b2d2f57c7 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:32.434664 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf8d5b-af24-44c3-bc6c-441b2d2f57c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:32.476354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-dcaf8d5b-af24-44c3-bc6c-441b2d2f57c7 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:32.477930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-dcaf8d5b-af24-44c3-bc6c-441b2d2f57c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:32.485773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 54/100] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:32.497946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:32.518589 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6b38d-9675-4c63-893d-97c8b461bccd None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:32.600806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 47/101] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:41:32.632659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf8d5b-af24-44c3-bc6c-441b2d2f57c7 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:32.751175 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6b38d-9675-4c63-893d-97c8b461bccd None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:32.838762 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf8d5b-af24-44c3-bc6c-441b2d2f57c7 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:32.862951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c41f9-1a23-4886-aa85-c477cd320538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:32.862951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c41f9-1a23-4886-aa85-c477cd320538 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:32.862951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c41f9-1a23-4886-aa85-c477cd320538 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:32.862951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c41f9-1a23-4886-aa85-c477cd320538 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:32.863310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c41f9-1a23-4886-aa85-c477cd320538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:32.863310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c41f9-1a23-4886-aa85-c477cd320538 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:32.863310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 55/102] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:41:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:32.884351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c41f9-1a23-4886-aa85-c477cd320538 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:32.900078 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ad3ab-04ae-407e-9bb4-717a30ec61e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:32.900830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ad3ab-04ae-407e-9bb4-717a30ec61e3 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:32.901130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ad3ab-04ae-407e-9bb4-717a30ec61e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:32.901415 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ad3ab-04ae-407e-9bb4-717a30ec61e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:32.902256 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:32.936088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ad3ab-04ae-407e-9bb4-717a30ec61e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:32.942019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-4f6ad3ab-04ae-407e-9bb4-717a30ec61e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 03:41:32.942019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:32.942019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:32.942019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:32.942019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:32.942019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:32.942019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:32.942019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:32.942019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:32.942019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:32.942019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:32.942019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:32.942019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:32.942019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:32.942019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:32.942019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:32.942930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:32.942930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:32.942930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:32.942930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:32.942930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:32.942930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:32.942930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:32.942930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:32.942930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:32.942930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:32.942930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:32.942930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:32.942930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:32.942930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:32.942930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:32.942930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:32.943759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:32.943759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:32.943759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:32.943759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:32.943759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:32.943759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:32.943759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:32.943759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:32.943759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:32.943759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:32.943759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 03:41:32.943759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:41:32.951457 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 48/103] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:32.958248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ad3ab-04ae-407e-9bb4-717a30ec61e3 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:32.987699 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:33.138546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ad3ab-04ae-407e-9bb4-717a30ec61e3 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:33.179730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c41f9-1a23-4886-aa85-c477cd320538 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:33.187425 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1cff2-a067-44e2-8240-51c48ce1471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:33.188373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1cff2-a067-44e2-8240-51c48ce1471c None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:33.188878 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1cff2-a067-44e2-8240-51c48ce1471c None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:33.189350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1cff2-a067-44e2-8240-51c48ce1471c None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:33.191475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1cff2-a067-44e2-8240-51c48ce1471c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:33.192013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1cff2-a067-44e2-8240-51c48ce1471c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:33.193613 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1cff2-a067-44e2-8240-51c48ce1471c None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:33.210971 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 49/104] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:41:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:33.216654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1cff2-a067-44e2-8240-51c48ce1471c None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:33.276100 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69d48f-8e6e-4ebd-a300-d74dabad1876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:33.276859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69d48f-8e6e-4ebd-a300-d74dabad1876 None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:33.277063 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69d48f-8e6e-4ebd-a300-d74dabad1876 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:33.277326 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69d48f-8e6e-4ebd-a300-d74dabad1876 None admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:33.278051 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69d48f-8e6e-4ebd-a300-d74dabad1876 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:33.279564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69d48f-8e6e-4ebd-a300-d74dabad1876 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:33.302720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:33.340372 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1cff2-a067-44e2-8240-51c48ce1471c None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:33.380328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d096c-4143-4193-becd-46c85b99b37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:33.381358 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d096c-4143-4193-becd-46c85b99b37f None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:33.381841 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d096c-4143-4193-becd-46c85b99b37f None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:33.382340 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d096c-4143-4193-becd-46c85b99b37f None admin] PATH_INFO: `/v3/users/951e5d48cd8143f186ee100a92a18a3f` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:33.398028 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d096c-4143-4193-becd-46c85b99b37f None admin] RBAC: Authorizing `identity:get_user(user_id=951e5d48cd8143f186ee100a92a18a3f)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:33.399900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d096c-4143-4193-becd-46c85b99b37f None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:33.401833 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 50/105] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:33 2022] GET /identity/v3/users/951e5d48cd8143f186ee100a92a18a3f => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:33.407929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d096c-4143-4193-becd-46c85b99b37f None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:33.414399 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 56/106] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 28 03:41:32 2022] POST /identity/v3/projects => generated 302 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:41:33.548055 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d096c-4143-4193-becd-46c85b99b37f None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:33.583608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:33.590476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd3867-3632-4416-b809-b4898d724fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:33.591313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd3867-3632-4416-b809-b4898d724fab None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:33.591871 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd3867-3632-4416-b809-b4898d724fab None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:33.592333 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd3867-3632-4416-b809-b4898d724fab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:33.668699 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd3867-3632-4416-b809-b4898d724fab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:33.670518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd3867-3632-4416-b809-b4898d724fab None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:33.783981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 51/107] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:41:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 03:41:33.790812 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69d48f-8e6e-4ebd-a300-d74dabad1876 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:33.870097 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:33.916055 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69d48f-8e6e-4ebd-a300-d74dabad1876 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:33.952005 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621195b7-fe3a-4597-ad26-6bec90cd2db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:33.952598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621195b7-fe3a-4597-ad26-6bec90cd2db4 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:33.952942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621195b7-fe3a-4597-ad26-6bec90cd2db4 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:33.953226 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621195b7-fe3a-4597-ad26-6bec90cd2db4 None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:33.954437 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621195b7-fe3a-4597-ad26-6bec90cd2db4 None admin] RBAC: Authorizing `identity:get_project(project_id=856293872ed14cbda37a5830759ee4e7)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:33.956600 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621195b7-fe3a-4597-ad26-6bec90cd2db4 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:33.958346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 57/108] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:33 2022] GET /identity/v3/projects/856293872ed14cbda37a5830759ee4e7 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:33.965830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd3867-3632-4416-b809-b4898d724fab None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:33.997447 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:34.087405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd3867-3632-4416-b809-b4898d724fab None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:34.101346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12325614-4dc0-4edc-aa90-c34241b5b6d5 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:34.101637 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12325614-4dc0-4edc-aa90-c34241b5b6d5 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:34.101917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12325614-4dc0-4edc-aa90-c34241b5b6d5 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:34.103484 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 58/109] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:41:34.121321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea8101-ac50-46a1-8fb1-7873982611e3 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:34.121605 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea8101-ac50-46a1-8fb1-7873982611e3 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:34.121892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea8101-ac50-46a1-8fb1-7873982611e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:34.144355 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-0fea8101-ac50-46a1-8fb1-7873982611e3 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:34.145690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0fea8101-ac50-46a1-8fb1-7873982611e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:34.146871 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0de51b-87f7-42ba-96c3-bbd47fe38a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:34.147539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0de51b-87f7-42ba-96c3-bbd47fe38a95 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:34.147828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0de51b-87f7-42ba-96c3-bbd47fe38a95 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:34.148112 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0de51b-87f7-42ba-96c3-bbd47fe38a95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:34.148917 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0de51b-87f7-42ba-96c3-bbd47fe38a95 None admin] RBAC: Adding query filter params (role.id=e2859598b69d4763beae00133c2d5a83, scope.project.id=856293872ed14cbda37a5830759ee4e7, user.id=951e5d48cd8143f186ee100a92a18a3f) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:34.149234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0de51b-87f7-42ba-96c3-bbd47fe38a95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:34.150699 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0de51b-87f7-42ba-96c3-bbd47fe38a95 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:34.157264 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 52/110] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:41:33 2022] GET /identity/v3/role_assignments?user.id=951e5d48cd8143f186ee100a92a18a3f&scope.project.id=856293872ed14cbda37a5830759ee4e7&role.id=e2859598b69d4763beae00133c2d5a83 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:34.158549 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e883994-ec29-4998-8370-132e7f89b885 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:34.158965 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e883994-ec29-4998-8370-132e7f89b885 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:34.159248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e883994-ec29-4998-8370-132e7f89b885 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:34.161793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 53/111] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:34.171380 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296da54-da08-4d24-9384-2cb6e3db5773 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:34.171380 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296da54-da08-4d24-9384-2cb6e3db5773 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:34.171380 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296da54-da08-4d24-9384-2cb6e3db5773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:34.186629 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-6296da54-da08-4d24-9384-2cb6e3db5773 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:34.188000 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-6296da54-da08-4d24-9384-2cb6e3db5773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:34.318855 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 54/112] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:41:34.329483 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 59/113] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:41:34.334125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f53d0-6415-4d96-94cd-7c1967495ac5 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:34.334425 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f53d0-6415-4d96-94cd-7c1967495ac5 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:34.334697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f53d0-6415-4d96-94cd-7c1967495ac5 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:34.336355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 55/114] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:34.353618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea8101-ac50-46a1-8fb1-7873982611e3 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:34.357686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44c61c-7a34-4809-8810-81dbab09fd1e None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:34.358154 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44c61c-7a34-4809-8810-81dbab09fd1e None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:34.358252 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44c61c-7a34-4809-8810-81dbab09fd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:34.391741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-6d44c61c-7a34-4809-8810-81dbab09fd1e None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:34.393613 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-6d44c61c-7a34-4809-8810-81dbab09fd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:34.435879 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:34.466107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:34.507723 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 56/115] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:34.509011 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44c61c-7a34-4809-8810-81dbab09fd1e None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:34.528852 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea8101-ac50-46a1-8fb1-7873982611e3 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:34.593218 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0be59d-6c94-4e61-b7e0-3ec801523544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:34.594249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0be59d-6c94-4e61-b7e0-3ec801523544 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:34.595381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0be59d-6c94-4e61-b7e0-3ec801523544 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:34.595888 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0be59d-6c94-4e61-b7e0-3ec801523544 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:34.612583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0be59d-6c94-4e61-b7e0-3ec801523544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:34.619378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-df0be59d-6c94-4e61-b7e0-3ec801523544 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:34.619378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:34.619378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:34.619378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:34.619378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:34.619378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:34.619378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:34.619378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:34.619378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:34.619378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:34.619378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:34.619378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:34.619378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:34.619378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:34.619378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:34.619378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:34.620388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:34.620388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:34.620388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:34.620388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:34.620388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:34.620388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:34.620388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:34.620388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:34.620388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:34.620388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:34.620388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:34.620388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:34.620388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:34.620388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:34.620388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:34.620388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:34.621160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:34.621160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:34.621160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:34.621160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:34.621160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:34.621160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:34.621160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:34.621160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:34.621160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:34.621160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:34.621160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:34.621160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:41:34.624761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 60/116] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:34.626407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d566a-73ce-4f0f-bdcb-ad3e79a8ff0e None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:34.626843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d566a-73ce-4f0f-bdcb-ad3e79a8ff0e None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:34.627992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d566a-73ce-4f0f-bdcb-ad3e79a8ff0e None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:34.630913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 61/117] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:34.637164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d566a-73ce-4f0f-bdcb-ad3e79a8ff0e None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:34.673520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44c61c-7a34-4809-8810-81dbab09fd1e None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:34.724381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a0410-bb1f-401e-a4b8-9cb2cdd36709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:34.729357 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a0410-bb1f-401e-a4b8-9cb2cdd36709 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:34.729357 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a0410-bb1f-401e-a4b8-9cb2cdd36709 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:34.729357 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a0410-bb1f-401e-a4b8-9cb2cdd36709 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:34.738500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a0410-bb1f-401e-a4b8-9cb2cdd36709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:34.745443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-d09a0410-bb1f-401e-a4b8-9cb2cdd36709 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:41:34.745443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:34.745443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:34.745443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:34.745443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:34.745443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:34.745443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:34.745443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:34.745443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:34.745443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:34.745443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:34.745443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:34.745443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:34.745443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:34.745443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:34.745443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:34.746328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:34.746328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:34.746328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:34.746328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:34.746328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:34.746328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:34.746328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:34.746328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:34.746328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:34.746328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:34.746328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:34.746328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:34.746328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:34.746328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:34.746328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:34.746328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:34.747097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:34.747097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:34.747097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:34.747097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:34.747097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:34.747097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:34.747097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:34.747097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:34.747097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:34.747097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:34.747097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:41:34.747097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:41:34.753737 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 57/118] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:41:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:34.753737 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a0410-bb1f-401e-a4b8-9cb2cdd36709 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:34.785012 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:34.795264 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d566a-73ce-4f0f-bdcb-ad3e79a8ff0e None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:34.817736 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:34.853640 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe2fdc-7558-464c-b629-d6d3a7ca1a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:34.854873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe2fdc-7558-464c-b629-d6d3a7ca1a2a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:34.855370 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe2fdc-7558-464c-b629-d6d3a7ca1a2a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:34.855992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe2fdc-7558-464c-b629-d6d3a7ca1a2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:34.872562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe2fdc-7558-464c-b629-d6d3a7ca1a2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:34.879796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-0efe2fdc-7558-464c-b629-d6d3a7ca1a2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:34.879796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:34.879796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:34.879796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:34.879796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:34.879796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:34.879796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:34.879796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:34.879796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:34.879796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:34.879796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:34.879796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:34.879796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:34.879796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:34.879796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:34.879796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:34.880672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:34.880672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:34.880672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:34.880672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:34.880672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:34.880672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:34.880672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:34.880672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:34.880672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:34.880672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:34.880672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:34.880672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:34.880672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:34.880672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:34.880672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:34.880672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:34.881419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:34.881419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:34.881419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:34.881419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:34.881419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:34.881419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:34.881419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:34.881419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:34.881419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:34.881419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:34.881419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:34.881419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:41:34.884149 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 62/119] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:34.891185 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78651102-5765-4af3-a1fd-d31481645388 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:34.892244 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78651102-5765-4af3-a1fd-d31481645388 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:34.892902 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78651102-5765-4af3-a1fd-d31481645388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:34.915108 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-78651102-5765-4af3-a1fd-d31481645388 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:34.916776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-78651102-5765-4af3-a1fd-d31481645388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:34.987067 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a0410-bb1f-401e-a4b8-9cb2cdd36709 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:35.068179 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 63/120] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:35.069491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78651102-5765-4af3-a1fd-d31481645388 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:35.076347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde57e3-2258-4057-8f6a-dde037340b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:35.077389 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde57e3-2258-4057-8f6a-dde037340b4b None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:35.083836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde57e3-2258-4057-8f6a-dde037340b4b None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:35.084138 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde57e3-2258-4057-8f6a-dde037340b4b None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:35.085018 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde57e3-2258-4057-8f6a-dde037340b4b None admin] RBAC: Adding query filter params (name=member) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:35.085331 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde57e3-2258-4057-8f6a-dde037340b4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:35.087133 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde57e3-2258-4057-8f6a-dde037340b4b None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:35.117395 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 58/121] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:41:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:35.118187 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde57e3-2258-4057-8f6a-dde037340b4b None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:35.195814 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78651102-5765-4af3-a1fd-d31481645388 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:35.208200 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:35.238410 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9cbeb-72f6-4e2c-ab95-fcd4eccd7b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:35.239525 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9cbeb-72f6-4e2c-ab95-fcd4eccd7b02 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:35.240032 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9cbeb-72f6-4e2c-ab95-fcd4eccd7b02 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:35.240516 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9cbeb-72f6-4e2c-ab95-fcd4eccd7b02 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:35.241513 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9cbeb-72f6-4e2c-ab95-fcd4eccd7b02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:35.242038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9cbeb-72f6-4e2c-ab95-fcd4eccd7b02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:35.243744 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9cbeb-72f6-4e2c-ab95-fcd4eccd7b02 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:35.261378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 64/122] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:35.262760 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9cbeb-72f6-4e2c-ab95-fcd4eccd7b02 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:35.356449 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:35.395492 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde57e3-2258-4057-8f6a-dde037340b4b None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:35.429099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9cbeb-72f6-4e2c-ab95-fcd4eccd7b02 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:35.446781 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889a1ff-b628-4cc9-8e53-91f9c60718f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:35.448127 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889a1ff-b628-4cc9-8e53-91f9c60718f4 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:35.448641 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889a1ff-b628-4cc9-8e53-91f9c60718f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:35.449469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889a1ff-b628-4cc9-8e53-91f9c60718f4 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:35.450446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889a1ff-b628-4cc9-8e53-91f9c60718f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:35.450941 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889a1ff-b628-4cc9-8e53-91f9c60718f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:35.453208 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889a1ff-b628-4cc9-8e53-91f9c60718f4 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:35.466892 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 59/123] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:41:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:35.468253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889a1ff-b628-4cc9-8e53-91f9c60718f4 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:35.468433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fbd4f-c5ab-45c1-afb1-65a36ec1c261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:35.469281 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fbd4f-c5ab-45c1-afb1-65a36ec1c261 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:35.469635 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fbd4f-c5ab-45c1-afb1-65a36ec1c261 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:35.469986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fbd4f-c5ab-45c1-afb1-65a36ec1c261 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:35.483599 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fbd4f-c5ab-45c1-afb1-65a36ec1c261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:35.489954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-a34fbd4f-c5ab-45c1-afb1-65a36ec1c261 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:41:35.489954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:35.489954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:35.489954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:35.489954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:35.489954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:35.489954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:35.489954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:35.489954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:35.489954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:35.489954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:35.489954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:35.489954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:35.489954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:35.489954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:35.489954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:35.490871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:35.490871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:35.490871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:35.490871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:35.490871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:35.490871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:35.490871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:35.490871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:35.490871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:35.490871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:35.490871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:35.490871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:35.490871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:35.490871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:35.490871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:35.490871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:35.491677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:35.491677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:35.491677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:35.491677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:35.491677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:35.491677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:35.491677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:35.491677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:35.491677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:35.491677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:35.491677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:41:35.491677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:41:35.491677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 65/124] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:41:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:35.492390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fbd4f-c5ab-45c1-afb1-65a36ec1c261 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:35.538148 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:35.621304 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889a1ff-b628-4cc9-8e53-91f9c60718f4 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:35.631708 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fbd4f-c5ab-45c1-afb1-65a36ec1c261 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:35.672383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa3520-4a28-4e87-b7a0-7219e04d2a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:35.673098 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa3520-4a28-4e87-b7a0-7219e04d2a17 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:35.673513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa3520-4a28-4e87-b7a0-7219e04d2a17 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:35.674551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa3520-4a28-4e87-b7a0-7219e04d2a17 None admin] PATH_INFO: `/v3/users/427345877d57430294ac22048db4a8c5` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:35.676435 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa3520-4a28-4e87-b7a0-7219e04d2a17 None admin] RBAC: Authorizing `identity:get_user(user_id=427345877d57430294ac22048db4a8c5)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:35.678535 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa3520-4a28-4e87-b7a0-7219e04d2a17 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:35.678893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe238a1-8753-4cbf-af7e-6b31ecb40ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:35.679763 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe238a1-8753-4cbf-af7e-6b31ecb40ce1 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:35.680199 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe238a1-8753-4cbf-af7e-6b31ecb40ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:35.680612 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe238a1-8753-4cbf-af7e-6b31ecb40ce1 None admin] PATH_INFO: `/v3/users/3f3fe43cd62f4e5186fa1917f6943de6` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:35.682144 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 60/125] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:35 2022] GET /identity/v3/users/427345877d57430294ac22048db4a8c5 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:35.682424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe238a1-8753-4cbf-af7e-6b31ecb40ce1 None admin] RBAC: Authorizing `identity:get_user(user_id=3f3fe43cd62f4e5186fa1917f6943de6)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:35.684087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe238a1-8753-4cbf-af7e-6b31ecb40ce1 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:35.691089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa3520-4a28-4e87-b7a0-7219e04d2a17 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:35.691437 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 66/126] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:35 2022] GET /identity/v3/users/3f3fe43cd62f4e5186fa1917f6943de6 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:35.692549 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe238a1-8753-4cbf-af7e-6b31ecb40ce1 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:35.702822 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:35.822260 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa3520-4a28-4e87-b7a0-7219e04d2a17 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:35.843500 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:35.847909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe238a1-8753-4cbf-af7e-6b31ecb40ce1 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:35.875196 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773ba09-ad7b-40b9-99fc-d423a856f0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:35.876090 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773ba09-ad7b-40b9-99fc-d423a856f0ac None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:35.876380 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773ba09-ad7b-40b9-99fc-d423a856f0ac None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:35.876668 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773ba09-ad7b-40b9-99fc-d423a856f0ac None admin] PATH_INFO: `/v3/users/427345877d57430294ac22048db4a8c5` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:35.879165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773ba09-ad7b-40b9-99fc-d423a856f0ac None admin] RBAC: Authorizing `identity:get_user(user_id=427345877d57430294ac22048db4a8c5)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:35.880862 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773ba09-ad7b-40b9-99fc-d423a856f0ac None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:35.883249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 61/127] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:35 2022] GET /identity/v3/users/427345877d57430294ac22048db4a8c5 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:35.884306 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773ba09-ad7b-40b9-99fc-d423a856f0ac None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:35.890243 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae6583-c68a-4530-867c-054f2fb26c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:35.891267 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae6583-c68a-4530-867c-054f2fb26c7e None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:35.891817 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae6583-c68a-4530-867c-054f2fb26c7e None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:35.892304 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae6583-c68a-4530-867c-054f2fb26c7e None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:35.893845 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae6583-c68a-4530-867c-054f2fb26c7e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:35.894376 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae6583-c68a-4530-867c-054f2fb26c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:35.896270 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae6583-c68a-4530-867c-054f2fb26c7e None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:35.905768 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 67/128] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:41:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:35.907296 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae6583-c68a-4530-867c-054f2fb26c7e None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:35.990035 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:36.024953 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773ba09-ad7b-40b9-99fc-d423a856f0ac None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:36.072685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae6583-c68a-4530-867c-054f2fb26c7e None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:36.076601 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bac8f6-f4ec-4cc5-9d2d-a42f1cd8462e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:36.077608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bac8f6-f4ec-4cc5-9d2d-a42f1cd8462e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:36.078100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bac8f6-f4ec-4cc5-9d2d-a42f1cd8462e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:36.078638 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bac8f6-f4ec-4cc5-9d2d-a42f1cd8462e None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:36.080152 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bac8f6-f4ec-4cc5-9d2d-a42f1cd8462e None admin] RBAC: Authorizing `identity:get_project(project_id=856293872ed14cbda37a5830759ee4e7)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:36.082445 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bac8f6-f4ec-4cc5-9d2d-a42f1cd8462e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:36.089560 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 62/129] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:35 2022] GET /identity/v3/projects/856293872ed14cbda37a5830759ee4e7 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:36.090842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bac8f6-f4ec-4cc5-9d2d-a42f1cd8462e None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:36.116212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57d1f9-c022-4f5f-a74e-77b9b9f9b77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:36.117831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57d1f9-c022-4f5f-a74e-77b9b9f9b77e None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:36.118598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57d1f9-c022-4f5f-a74e-77b9b9f9b77e None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:36.119288 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57d1f9-c022-4f5f-a74e-77b9b9f9b77e None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:36.121358 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57d1f9-c022-4f5f-a74e-77b9b9f9b77e None admin] RBAC: Authorizing `identity:get_project(project_id=856293872ed14cbda37a5830759ee4e7)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:36.123176 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57d1f9-c022-4f5f-a74e-77b9b9f9b77e None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:36.125439 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 68/130] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:35 2022] GET /identity/v3/projects/856293872ed14cbda37a5830759ee4e7 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:36.126528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57d1f9-c022-4f5f-a74e-77b9b9f9b77e None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:36.172113 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:36.225703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bac8f6-f4ec-4cc5-9d2d-a42f1cd8462e None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:36.264574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57d1f9-c022-4f5f-a74e-77b9b9f9b77e None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:36.275774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1f151-d9a5-4d1e-9f80-d0f5c80a5875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:36.278954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1f151-d9a5-4d1e-9f80-d0f5c80a5875 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:36.279246 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1f151-d9a5-4d1e-9f80-d0f5c80a5875 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:36.279561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1f151-d9a5-4d1e-9f80-d0f5c80a5875 None admin] PATH_INFO: `/v3/projects/be50a41a2163492abc7db04b97a96031` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:36.281443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1f151-d9a5-4d1e-9f80-d0f5c80a5875 None admin] RBAC: Authorizing `identity:get_project(project_id=be50a41a2163492abc7db04b97a96031)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:36.283262 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1f151-d9a5-4d1e-9f80-d0f5c80a5875 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:36.287314 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 63/131] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:36 2022] GET /identity/v3/projects/be50a41a2163492abc7db04b97a96031 => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:36.288334 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1f151-d9a5-4d1e-9f80-d0f5c80a5875 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:36.315444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:36.335664 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bf01a-86c9-4129-a021-36343951de34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:36.337442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bf01a-86c9-4129-a021-36343951de34 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:36.338239 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bf01a-86c9-4129-a021-36343951de34 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:36.339004 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bf01a-86c9-4129-a021-36343951de34 None admin] PATH_INFO: `/v3/users/427345877d57430294ac22048db4a8c5` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:36.341623 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bf01a-86c9-4129-a021-36343951de34 None admin] RBAC: Authorizing `identity:get_user(user_id=427345877d57430294ac22048db4a8c5)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:36.345093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bf01a-86c9-4129-a021-36343951de34 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:36.349237 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 69/132] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:36 2022] GET /identity/v3/users/427345877d57430294ac22048db4a8c5 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:36.351216 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bf01a-86c9-4129-a021-36343951de34 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:36.486261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1f151-d9a5-4d1e-9f80-d0f5c80a5875 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:36.527236 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5187c-b797-4565-a4d6-3c450591f8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:36.528490 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5187c-b797-4565-a4d6-3c450591f8c5 None admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:36.528797 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5187c-b797-4565-a4d6-3c450591f8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:36.529087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5187c-b797-4565-a4d6-3c450591f8c5 None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7/users/427345877d57430294ac22048db4a8c5/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:36.532217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5187c-b797-4565-a4d6-3c450591f8c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=856293872ed14cbda37a5830759ee4e7, user_id=427345877d57430294ac22048db4a8c5, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:36.535633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5187c-b797-4565-a4d6-3c450591f8c5 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:36.540996 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:36.551955 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bf01a-86c9-4129-a021-36343951de34 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:36.614140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 64/133] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:41:36 2022] PUT /identity/v3/projects/856293872ed14cbda37a5830759ee4e7/users/427345877d57430294ac22048db4a8c5/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:41:36.614140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5187c-b797-4565-a4d6-3c450591f8c5 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:36.621124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88d225-1121-4404-9c7d-4725c018342d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:36.622025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88d225-1121-4404-9c7d-4725c018342d None admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:36.622441 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88d225-1121-4404-9c7d-4725c018342d None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:36.622855 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88d225-1121-4404-9c7d-4725c018342d None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7/users/3f3fe43cd62f4e5186fa1917f6943de6/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:36.625990 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88d225-1121-4404-9c7d-4725c018342d None admin] RBAC: Authorizing `identity:create_grant(project_id=856293872ed14cbda37a5830759ee4e7, user_id=3f3fe43cd62f4e5186fa1917f6943de6, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:36.628785 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88d225-1121-4404-9c7d-4725c018342d None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:36.731365 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 70/134] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:41:36 2022] PUT /identity/v3/projects/856293872ed14cbda37a5830759ee4e7/users/3f3fe43cd62f4e5186fa1917f6943de6/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:41:36.731365 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88d225-1121-4404-9c7d-4725c018342d None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:36.758237 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:36.850530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5187c-b797-4565-a4d6-3c450591f8c5 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:36.932241 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557e9f6-0e27-42e9-bbfe-681bcb91d96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:36.933766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557e9f6-0e27-42e9-bbfe-681bcb91d96e None admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:36.934255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557e9f6-0e27-42e9-bbfe-681bcb91d96e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:36.934724 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557e9f6-0e27-42e9-bbfe-681bcb91d96e None admin] PATH_INFO: `/v3/projects/be50a41a2163492abc7db04b97a96031/users/427345877d57430294ac22048db4a8c5/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:36.938743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557e9f6-0e27-42e9-bbfe-681bcb91d96e None admin] RBAC: Authorizing `identity:create_grant(project_id=be50a41a2163492abc7db04b97a96031, user_id=427345877d57430294ac22048db4a8c5, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:36.942787 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557e9f6-0e27-42e9-bbfe-681bcb91d96e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:36.957620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88d225-1121-4404-9c7d-4725c018342d None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:37.019348 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87aaa4-852b-40d9-a42f-5f7696a6ecbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:37.019348 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87aaa4-852b-40d9-a42f-5f7696a6ecbf None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:37.019348 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87aaa4-852b-40d9-a42f-5f7696a6ecbf None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:37.019348 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87aaa4-852b-40d9-a42f-5f7696a6ecbf None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:37.019926 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 65/135] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:41:36 2022] PUT /identity/v3/projects/be50a41a2163492abc7db04b97a96031/users/427345877d57430294ac22048db4a8c5/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:41:37.020147 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87aaa4-852b-40d9-a42f-5f7696a6ecbf None admin] RBAC: Authorizing `identity:get_project(project_id=856293872ed14cbda37a5830759ee4e7)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:37.021862 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1e314-347a-439b-960c-6e13976361b8 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:37.022466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1e314-347a-439b-960c-6e13976361b8 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:37.022718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87aaa4-852b-40d9-a42f-5f7696a6ecbf None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:37.023116 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1e314-347a-439b-960c-6e13976361b8 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:37.025576 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 71/136] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:36 2022] GET /identity/v3/projects/856293872ed14cbda37a5830759ee4e7 => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:37.026970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 66/137] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:37.027644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530c534-a6ce-4a72-9299-265e860c9c3b None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:37.027756 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530c534-a6ce-4a72-9299-265e860c9c3b None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:37.028699 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530c534-a6ce-4a72-9299-265e860c9c3b None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:37.029653 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 72/138] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:37.036400 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fdb39-2db6-45d8-b909-a672dd7aaae8 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:37.037095 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fdb39-2db6-45d8-b909-a672dd7aaae8 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:37.037587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fdb39-2db6-45d8-b909-a672dd7aaae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:37.039358 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de7ec3-01dd-451c-96f4-406c5bffb582 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:37.039882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de7ec3-01dd-451c-96f4-406c5bffb582 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:37.040375 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de7ec3-01dd-451c-96f4-406c5bffb582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:37.070762 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-a75fdb39-2db6-45d8-b909-a672dd7aaae8 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:37.072288 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a75fdb39-2db6-45d8-b909-a672dd7aaae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:37.079246 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-a7de7ec3-01dd-451c-96f4-406c5bffb582 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:37.083403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a7de7ec3-01dd-451c-96f4-406c5bffb582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:37.127672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:37.244191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 67/139] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:37.244938 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 73/140] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:41:37.245086 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fdb39-2db6-45d8-b909-a672dd7aaae8 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:37.287367 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de7ec3-01dd-451c-96f4-406c5bffb582 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:37.390349 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:37.458174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fdb39-2db6-45d8-b909-a672dd7aaae8 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:37.466930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de7ec3-01dd-451c-96f4-406c5bffb582 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:37.506424 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b68df1-490e-4095-9728-a65d17efe77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:37.507193 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b68df1-490e-4095-9728-a65d17efe77e None admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:37.507561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b68df1-490e-4095-9728-a65d17efe77e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:37.507723 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b68df1-490e-4095-9728-a65d17efe77e None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7/users/427345877d57430294ac22048db4a8c5/roles/81c955f5702546679605b5484602ae69` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:37.511148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b68df1-490e-4095-9728-a65d17efe77e None admin] RBAC: Authorizing `identity:create_grant(project_id=856293872ed14cbda37a5830759ee4e7, user_id=427345877d57430294ac22048db4a8c5, role_id=81c955f5702546679605b5484602ae69)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:37.512747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b68df1-490e-4095-9728-a65d17efe77e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:37.513328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c114ce-fd76-4d3b-9927-3fd5f40e502d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:37.513994 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c114ce-fd76-4d3b-9927-3fd5f40e502d None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:37.514342 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c114ce-fd76-4d3b-9927-3fd5f40e502d None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:37.514620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c114ce-fd76-4d3b-9927-3fd5f40e502d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:37.516124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c114ce-fd76-4d3b-9927-3fd5f40e502d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:37.519037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c114ce-fd76-4d3b-9927-3fd5f40e502d None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:37.521134 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 74/141] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:41:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:37.521851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c114ce-fd76-4d3b-9927-3fd5f40e502d None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:37.555646 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:37.598283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 68/142] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:41:37 2022] PUT /identity/v3/projects/856293872ed14cbda37a5830759ee4e7/users/427345877d57430294ac22048db4a8c5/roles/81c955f5702546679605b5484602ae69 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:41:37.603015 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b68df1-490e-4095-9728-a65d17efe77e None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:37.647483 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c114ce-fd76-4d3b-9927-3fd5f40e502d None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:37.683372 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27441ba-f269-4186-8bb2-ec87c94123ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:37.683578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27441ba-f269-4186-8bb2-ec87c94123ef None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:37.683826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27441ba-f269-4186-8bb2-ec87c94123ef None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:37.684589 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27441ba-f269-4186-8bb2-ec87c94123ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:37.711533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27441ba-f269-4186-8bb2-ec87c94123ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:37.718311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-c27441ba-f269-4186-8bb2-ec87c94123ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 03:41:37.718311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:37.718311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:37.718311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:37.718311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:37.718311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:37.718311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:37.718311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:37.718311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:37.718311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:37.718311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:37.718311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:37.718311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:37.718311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:37.718311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:37.718311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:37.719196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:37.719196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:37.719196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:37.719196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:37.719196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:37.719196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:37.719196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:37.719196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:37.719196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:37.719196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:37.719196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:37.719196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:37.719196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:37.719196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:37.719196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:37.719196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:37.719983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:37.719983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:37.719983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:37.719983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:37.719983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:37.719983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:37.719983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:37.719983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:37.719983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:37.719983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:37.719983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 03:41:37.719983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:41:37.721306 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 75/143] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:37.728475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27441ba-f269-4186-8bb2-ec87c94123ef None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:37.849267 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b68df1-490e-4095-9728-a65d17efe77e None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:37.886655 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:37.930664 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639bfe5-6a00-4b0e-a989-3c12b26a6c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:37.931246 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639bfe5-6a00-4b0e-a989-3c12b26a6c21 None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:37.931993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639bfe5-6a00-4b0e-a989-3c12b26a6c21 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:37.932278 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639bfe5-6a00-4b0e-a989-3c12b26a6c21 None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:37.935756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639bfe5-6a00-4b0e-a989-3c12b26a6c21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:37.937419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639bfe5-6a00-4b0e-a989-3c12b26a6c21 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:38.028195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:38.050382 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27441ba-f269-4186-8bb2-ec87c94123ef None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:38.093612 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc223d-e203-42d0-8892-4736cd09bebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:38.094248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc223d-e203-42d0-8892-4736cd09bebd None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:38.094534 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc223d-e203-42d0-8892-4736cd09bebd None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:38.094821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc223d-e203-42d0-8892-4736cd09bebd None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:38.096301 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc223d-e203-42d0-8892-4736cd09bebd None admin] RBAC: Adding query filter params (name=reader) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:38.096709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc223d-e203-42d0-8892-4736cd09bebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:38.098502 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc223d-e203-42d0-8892-4736cd09bebd None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:38.109079 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 69/144] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 28 03:41:37 2022] POST /identity/v3/users => generated 283 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:41:38.118589 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 76/145] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:41:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:38.124909 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639bfe5-6a00-4b0e-a989-3c12b26a6c21 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:38.253526 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639bfe5-6a00-4b0e-a989-3c12b26a6c21 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:38.296999 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169c283-64f0-4ba1-8166-bf7bf9f39eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:38.297677 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169c283-64f0-4ba1-8166-bf7bf9f39eb1 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:38.297959 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169c283-64f0-4ba1-8166-bf7bf9f39eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:38.298275 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169c283-64f0-4ba1-8166-bf7bf9f39eb1 None admin] PATH_INFO: `/v3/users/951e5d48cd8143f186ee100a92a18a3f` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:38.300618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169c283-64f0-4ba1-8166-bf7bf9f39eb1 None admin] RBAC: Authorizing `identity:get_user(user_id=951e5d48cd8143f186ee100a92a18a3f)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:38.302181 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169c283-64f0-4ba1-8166-bf7bf9f39eb1 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:38.304367 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 70/146] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:38 2022] GET /identity/v3/users/951e5d48cd8143f186ee100a92a18a3f => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:38.310734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc223d-e203-42d0-8892-4736cd09bebd None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:38.527043 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc223d-e203-42d0-8892-4736cd09bebd None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:38.585229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fa80c-3c89-49de-a5cb-e83f318271f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:38.585891 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fa80c-3c89-49de-a5cb-e83f318271f8 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:38.586162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fa80c-3c89-49de-a5cb-e83f318271f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:38.586439 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fa80c-3c89-49de-a5cb-e83f318271f8 None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:38.592148 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fa80c-3c89-49de-a5cb-e83f318271f8 None admin] RBAC: Authorizing `identity:get_project(project_id=856293872ed14cbda37a5830759ee4e7)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:38.593647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fa80c-3c89-49de-a5cb-e83f318271f8 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:38.596668 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 77/147] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:38 2022] GET /identity/v3/projects/856293872ed14cbda37a5830759ee4e7 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:38.604016 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169c283-64f0-4ba1-8166-bf7bf9f39eb1 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:38.664519 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:38.744059 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169c283-64f0-4ba1-8166-bf7bf9f39eb1 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:38.807049 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f87dd5-b66a-4d76-a317-203d13ab47ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:38.807827 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f87dd5-b66a-4d76-a317-203d13ab47ca None admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:38.808200 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f87dd5-b66a-4d76-a317-203d13ab47ca None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:38.808499 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f87dd5-b66a-4d76-a317-203d13ab47ca None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7/users/951e5d48cd8143f186ee100a92a18a3f/roles/e2859598b69d4763beae00133c2d5a83` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:38.810638 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f87dd5-b66a-4d76-a317-203d13ab47ca None admin] RBAC: Authorizing `identity:create_grant(project_id=856293872ed14cbda37a5830759ee4e7, user_id=951e5d48cd8143f186ee100a92a18a3f, role_id=e2859598b69d4763beae00133c2d5a83)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:38.812198 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f87dd5-b66a-4d76-a317-203d13ab47ca None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:38.920965 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 71/148] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:41:38 2022] PUT /identity/v3/projects/856293872ed14cbda37a5830759ee4e7/users/951e5d48cd8143f186ee100a92a18a3f/roles/e2859598b69d4763beae00133c2d5a83 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:41:39.741950 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595b379-bc28-4dfa-980a-2f4715c75bc8 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:39.742457 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595b379-bc28-4dfa-980a-2f4715c75bc8 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:39.742528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595b379-bc28-4dfa-980a-2f4715c75bc8 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:39.743932 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 78/149] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:39.749869 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2d778-a11a-44e1-9768-7f282b34fa73 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:39.750345 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2d778-a11a-44e1-9768-7f282b34fa73 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:39.750440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2d778-a11a-44e1-9768-7f282b34fa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:39.771164 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-66a2d778-a11a-44e1-9768-7f282b34fa73 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:39.778451 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-66a2d778-a11a-44e1-9768-7f282b34fa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:39.862391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 72/150] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:39.899099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595b379-bc28-4dfa-980a-2f4715c75bc8 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:39.917953 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:40.057247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595b379-bc28-4dfa-980a-2f4715c75bc8 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:40.105924 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066fc6a-c1a5-472a-ab84-f602a2906cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:40.106597 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066fc6a-c1a5-472a-ab84-f602a2906cce None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:40.106880 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066fc6a-c1a5-472a-ab84-f602a2906cce None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:40.107154 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066fc6a-c1a5-472a-ab84-f602a2906cce None admin] PATH_INFO: `/v3/roles/member` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:40.126667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066fc6a-c1a5-472a-ab84-f602a2906cce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:40.133547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-b066fc6a-c1a5-472a-ab84-f602a2906cce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:40.133547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:40.133547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:40.133547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:40.133547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:40.133547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:40.133547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:40.133547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:40.133547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:40.133547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:40.133547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:40.133547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:40.133547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:40.133547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:40.133547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:40.133547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:40.134432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:40.134432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:40.134432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:40.134432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:40.134432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:40.134432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:40.134432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:40.134432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:40.134432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:40.134432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:40.134432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:40.134432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:40.134432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:40.134432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:40.134432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:40.134432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:40.135196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:40.135196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:40.135196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:40.135196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:40.135196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:40.135196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:40.135196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:40.135196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:40.135196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:40.135196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:40.135196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:40.135196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:41:40.135196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 79/151] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:40.141163 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2d778-a11a-44e1-9768-7f282b34fa73 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:40.200069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:40.297495 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2d778-a11a-44e1-9768-7f282b34fa73 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:40.345396 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065d692-ab01-4fcc-88a3-759da8ff9bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:40.346862 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065d692-ab01-4fcc-88a3-759da8ff9bd0 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:40.347147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065d692-ab01-4fcc-88a3-759da8ff9bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:40.347453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065d692-ab01-4fcc-88a3-759da8ff9bd0 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:40.348281 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065d692-ab01-4fcc-88a3-759da8ff9bd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:40.348590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065d692-ab01-4fcc-88a3-759da8ff9bd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:40.350098 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065d692-ab01-4fcc-88a3-759da8ff9bd0 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:40.363570 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 73/152] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:41:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:40.369340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066fc6a-c1a5-472a-ab84-f602a2906cce None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:40.500535 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:40.543469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066fc6a-c1a5-472a-ab84-f602a2906cce None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:40.588070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bb916-5c74-4dd1-9897-11ded1c3e193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:40.588748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bb916-5c74-4dd1-9897-11ded1c3e193 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:40.589033 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bb916-5c74-4dd1-9897-11ded1c3e193 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:40.589310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bb916-5c74-4dd1-9897-11ded1c3e193 None admin] PATH_INFO: `/v3/users/427345877d57430294ac22048db4a8c5` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:40.590590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bb916-5c74-4dd1-9897-11ded1c3e193 None admin] RBAC: Authorizing `identity:get_user(user_id=427345877d57430294ac22048db4a8c5)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:40.592153 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bb916-5c74-4dd1-9897-11ded1c3e193 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:40.594185 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 80/153] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:40 2022] GET /identity/v3/users/427345877d57430294ac22048db4a8c5 => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:40.601055 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065d692-ab01-4fcc-88a3-759da8ff9bd0 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:40.739989 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:40.747401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065d692-ab01-4fcc-88a3-759da8ff9bd0 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:40.804127 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17665c-eb50-48af-9567-8a0d9339141a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:40.804766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17665c-eb50-48af-9567-8a0d9339141a None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:40.805063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17665c-eb50-48af-9567-8a0d9339141a None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:40.805343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17665c-eb50-48af-9567-8a0d9339141a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:40.891992 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17665c-eb50-48af-9567-8a0d9339141a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:40.894128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17665c-eb50-48af-9567-8a0d9339141a None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:40.999447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad9e48-7cec-4bea-bcd6-1bcfb977360e None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:41.000392 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad9e48-7cec-4bea-bcd6-1bcfb977360e None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:41.000890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad9e48-7cec-4bea-bcd6-1bcfb977360e None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:41.003778 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 81/154] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:41.009066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1683213-3294-42fe-be1c-30115738c0f8 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:41.009766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1683213-3294-42fe-be1c-30115738c0f8 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:41.010357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1683213-3294-42fe-be1c-30115738c0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:41.036726 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:41.042036 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-e1683213-3294-42fe-be1c-30115738c0f8 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:41.043822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e1683213-3294-42fe-be1c-30115738c0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:41.046335 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 74/155] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:41.051194 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17665c-eb50-48af-9567-8a0d9339141a None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:41.185809 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 82/156] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:41:41.238391 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1683213-3294-42fe-be1c-30115738c0f8 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:41.257373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17665c-eb50-48af-9567-8a0d9339141a None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:41.332100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c31a00-fc73-4b4f-b8f2-2c48149e0143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:41.332813 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c31a00-fc73-4b4f-b8f2-2c48149e0143 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:41.333103 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c31a00-fc73-4b4f-b8f2-2c48149e0143 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:41.333380 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c31a00-fc73-4b4f-b8f2-2c48149e0143 None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:41.334657 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c31a00-fc73-4b4f-b8f2-2c48149e0143 None admin] RBAC: Authorizing `identity:get_project(project_id=856293872ed14cbda37a5830759ee4e7)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:41.336167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c31a00-fc73-4b4f-b8f2-2c48149e0143 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:41.341203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 75/157] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:41 2022] GET /identity/v3/projects/856293872ed14cbda37a5830759ee4e7 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:41.341203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d7686-4cc0-4071-92d6-4c9223622f87 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:41.341203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d7686-4cc0-4071-92d6-4c9223622f87 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:41.341203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d7686-4cc0-4071-92d6-4c9223622f87 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:41.341582 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 76/158] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:41.348220 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d7686-4cc0-4071-92d6-4c9223622f87 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:41.387687 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:41.466268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1683213-3294-42fe-be1c-30115738c0f8 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:41.505864 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:41.550872 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c72996-b652-42cf-a2a5-4ac02b94f4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:41.551429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c72996-b652-42cf-a2a5-4ac02b94f4d6 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:41.551764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c72996-b652-42cf-a2a5-4ac02b94f4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:41.552041 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c72996-b652-42cf-a2a5-4ac02b94f4d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:41.577291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c72996-b652-42cf-a2a5-4ac02b94f4d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:41.582979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-42c72996-b652-42cf-a2a5-4ac02b94f4d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:41:41.582979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:41.582979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:41.582979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:41.582979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:41.582979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:41.582979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:41.582979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:41.582979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:41.582979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:41.582979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:41.582979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:41.582979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:41.582979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:41.582979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:41.582979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:41.583917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:41.583917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:41.583917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:41.583917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:41.583917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:41.583917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:41.583917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:41.583917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:41.583917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:41.583917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:41.583917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:41.583917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:41.583917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:41.583917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:41.583917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:41.583917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:41.584766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:41.584766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:41.584766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:41.584766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:41.584766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:41.584766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:41.584766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:41.584766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:41.584766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:41.584766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:41.584766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:41:41.584766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:41:41.584766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 83/159] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:41:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:41.586166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91e279-0c4c-4c93-9478-ee28b4c6677e None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:41.586166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91e279-0c4c-4c93-9478-ee28b4c6677e None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:41.586961 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91e279-0c4c-4c93-9478-ee28b4c6677e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:41.588088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d7686-4cc0-4071-92d6-4c9223622f87 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:41.613022 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-3e91e279-0c4c-4c93-9478-ee28b4c6677e None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:41.614230 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-3e91e279-0c4c-4c93-9478-ee28b4c6677e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:41.647685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a20b80-1536-4698-b81b-1926bc66edea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:41.648386 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a20b80-1536-4698-b81b-1926bc66edea None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:41.648672 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a20b80-1536-4698-b81b-1926bc66edea None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:41.648953 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a20b80-1536-4698-b81b-1926bc66edea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:41.649947 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a20b80-1536-4698-b81b-1926bc66edea None admin] RBAC: Adding query filter params (role.id=43f173da338d498382fba44911238254, scope.project.id=856293872ed14cbda37a5830759ee4e7, user.id=427345877d57430294ac22048db4a8c5) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:41.650298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a20b80-1536-4698-b81b-1926bc66edea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:41.651951 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a20b80-1536-4698-b81b-1926bc66edea None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:41.670598 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 77/160] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:41:41 2022] GET /identity/v3/role_assignments?user.id=427345877d57430294ac22048db4a8c5&scope.project.id=856293872ed14cbda37a5830759ee4e7&role.id=43f173da338d498382fba44911238254 => generated 608 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:41.672186 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0672a-d3a8-4360-a919-0f4b42d13c69 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:41.672474 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0672a-d3a8-4360-a919-0f4b42d13c69 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:41.672749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0672a-d3a8-4360-a919-0f4b42d13c69 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:41.674934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 78/161] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:41.675876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0672a-d3a8-4360-a919-0f4b42d13c69 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:41.701157 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 84/162] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:41.702542 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25141837-cfb5-41e8-a157-b1a850ff3447 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:41.702829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25141837-cfb5-41e8-a157-b1a850ff3447 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:41.703108 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25141837-cfb5-41e8-a157-b1a850ff3447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:41.744255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-25141837-cfb5-41e8-a157-b1a850ff3447 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:41.745417 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-25141837-cfb5-41e8-a157-b1a850ff3447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:41.848257 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:41.852091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0672a-d3a8-4360-a919-0f4b42d13c69 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:41.876811 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 85/163] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:41.878402 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25141837-cfb5-41e8-a157-b1a850ff3447 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:41.899747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:41.914668 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea71607-352c-43cc-8e10-48b9773a0a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:41.915392 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea71607-352c-43cc-8e10-48b9773a0a16 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:41.915731 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea71607-352c-43cc-8e10-48b9773a0a16 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:41.916011 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea71607-352c-43cc-8e10-48b9773a0a16 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:41.916802 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea71607-352c-43cc-8e10-48b9773a0a16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:41.917113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea71607-352c-43cc-8e10-48b9773a0a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:41.918602 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea71607-352c-43cc-8e10-48b9773a0a16 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:41.933739 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 79/164] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:41.940230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea71607-352c-43cc-8e10-48b9773a0a16 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:42.046699 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25141837-cfb5-41e8-a157-b1a850ff3447 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:42.106985 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe54c0c-638c-4e1f-aaa0-30025b93c1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:42.108144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe54c0c-638c-4e1f-aaa0-30025b93c1f0 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:42.108447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe54c0c-638c-4e1f-aaa0-30025b93c1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:42.108731 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe54c0c-638c-4e1f-aaa0-30025b93c1f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:42.127217 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe54c0c-638c-4e1f-aaa0-30025b93c1f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:42.132856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-1fe54c0c-638c-4e1f-aaa0-30025b93c1f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:42.132856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:42.132856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:42.132856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:42.132856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:42.132856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:42.132856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:42.132856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:42.132856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:42.132856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:42.132856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:42.132856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:42.132856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:42.132856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:42.132856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:42.132856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:42.133819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:42.133819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:42.133819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:42.133819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:42.133819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:42.133819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:42.133819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:42.133819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:42.133819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:42.133819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:42.133819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:42.133819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:42.133819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:42.133819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:42.133819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:42.133819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:42.139667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:42.139667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:42.139667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:42.139667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:42.139667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:42.139667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:42.139667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:42.139667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:42.139667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:42.139667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:42.139667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:42.139667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:41:42.139667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 86/165] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:42.139667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe54c0c-638c-4e1f-aaa0-30025b93c1f0 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:42.204530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea71607-352c-43cc-8e10-48b9773a0a16 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:42.268166 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ab5a6-7620-4722-af60-45b97681e92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:42.269637 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ab5a6-7620-4722-af60-45b97681e92a None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:42.270155 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ab5a6-7620-4722-af60-45b97681e92a None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:42.270638 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ab5a6-7620-4722-af60-45b97681e92a None admin] PATH_INFO: `/v3/users/3f3fe43cd62f4e5186fa1917f6943de6` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:42.272240 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ab5a6-7620-4722-af60-45b97681e92a None admin] RBAC: Authorizing `identity:get_user(user_id=3f3fe43cd62f4e5186fa1917f6943de6)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:42.274042 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ab5a6-7620-4722-af60-45b97681e92a None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:42.275169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:42.277396 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 80/166] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:41 2022] GET /identity/v3/users/3f3fe43cd62f4e5186fa1917f6943de6 => generated 247 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:42.278576 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ab5a6-7620-4722-af60-45b97681e92a None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:42.394523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe54c0c-638c-4e1f-aaa0-30025b93c1f0 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:42.395727 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:42.449132 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ab5a6-7620-4722-af60-45b97681e92a None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:42.465171 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c127c-cfb3-43eb-b688-52b79b1f54bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:42.466172 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c127c-cfb3-43eb-b688-52b79b1f54bb None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:42.466666 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c127c-cfb3-43eb-b688-52b79b1f54bb None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:42.467245 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c127c-cfb3-43eb-b688-52b79b1f54bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:42.484373 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c127c-cfb3-43eb-b688-52b79b1f54bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:42.489301 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ad446-8b1a-40d9-b3a5-64b126a03eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:42.489945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ad446-8b1a-40d9-b3a5-64b126a03eed None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:42.490226 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ad446-8b1a-40d9-b3a5-64b126a03eed None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:42.490556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ad446-8b1a-40d9-b3a5-64b126a03eed None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:42.491294 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ad446-8b1a-40d9-b3a5-64b126a03eed None admin] RBAC: Adding query filter params (name=member) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:42.491628 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ad446-8b1a-40d9-b3a5-64b126a03eed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:42.492115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-c25c127c-cfb3-43eb-b688-52b79b1f54bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:41:42.492115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:42.492115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:42.492115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:42.492115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:42.492115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:42.492115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:42.492115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:42.492115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:42.492115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:42.492115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:42.492115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:42.492115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:42.492115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:42.492115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:42.492115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:42.492951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:42.492951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:42.492951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:42.492951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:42.492951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:42.492951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:42.492951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:42.492951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:42.492951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:42.492951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:42.492951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:42.492951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:42.492951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:42.492951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:42.492951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:42.492951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:42.493714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:42.493714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:42.493714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:42.493714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:42.493714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:42.493714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:42.493714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:42.493714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:42.493714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:42.493714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:42.493714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:41:42.493714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:41:42.494434 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ad446-8b1a-40d9-b3a5-64b126a03eed None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:42.500664 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 87/167] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:41:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:42.502011 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c127c-cfb3-43eb-b688-52b79b1f54bb None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:42.502232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 81/168] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:41:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:42.511674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ad446-8b1a-40d9-b3a5-64b126a03eed None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:42.634007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ad446-8b1a-40d9-b3a5-64b126a03eed None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:42.661013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:42.680231 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0955e-b840-40dc-9498-d0e39865ab96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:42.681373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0955e-b840-40dc-9498-d0e39865ab96 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:42.681878 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0955e-b840-40dc-9498-d0e39865ab96 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:42.682286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0955e-b840-40dc-9498-d0e39865ab96 None admin] PATH_INFO: `/v3/users/427345877d57430294ac22048db4a8c5` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:42.684718 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0955e-b840-40dc-9498-d0e39865ab96 None admin] RBAC: Authorizing `identity:get_user(user_id=427345877d57430294ac22048db4a8c5)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:42.686673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0955e-b840-40dc-9498-d0e39865ab96 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:42.688536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 82/169] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:42 2022] GET /identity/v3/users/427345877d57430294ac22048db4a8c5 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:42.690040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0955e-b840-40dc-9498-d0e39865ab96 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:42.756662 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c127c-cfb3-43eb-b688-52b79b1f54bb None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:42.776664 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:42.820803 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0955e-b840-40dc-9498-d0e39865ab96 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:42.826371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d31f35-4a5b-4d1b-ba90-f79b413b5d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:42.827010 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d31f35-4a5b-4d1b-ba90-f79b413b5d14 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:42.827291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d31f35-4a5b-4d1b-ba90-f79b413b5d14 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:42.827593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d31f35-4a5b-4d1b-ba90-f79b413b5d14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:42.858569 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f50140-6258-430c-a655-63745ddc6ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:42.859803 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f50140-6258-430c-a655-63745ddc6ee2 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:42.860424 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f50140-6258-430c-a655-63745ddc6ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:42.860904 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f50140-6258-430c-a655-63745ddc6ee2 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:42.862505 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f50140-6258-430c-a655-63745ddc6ee2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:42.863015 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f50140-6258-430c-a655-63745ddc6ee2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:42.865098 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f50140-6258-430c-a655-63745ddc6ee2 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:42.875340 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 83/170] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:41:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:42.876475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f50140-6258-430c-a655-63745ddc6ee2 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:42.930080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d31f35-4a5b-4d1b-ba90-f79b413b5d14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:42.931572 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d31f35-4a5b-4d1b-ba90-f79b413b5d14 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:42.955890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:42.998307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f50140-6258-430c-a655-63745ddc6ee2 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:43.038089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f67c4e-c3b9-4cee-ab58-b1b26d07809c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:43.039107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f67c4e-c3b9-4cee-ab58-b1b26d07809c None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:43.039707 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f67c4e-c3b9-4cee-ab58-b1b26d07809c None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:43.040153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f67c4e-c3b9-4cee-ab58-b1b26d07809c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:43.117442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f67c4e-c3b9-4cee-ab58-b1b26d07809c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:43.119309 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f67c4e-c3b9-4cee-ab58-b1b26d07809c None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:43.144269 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 88/171] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:41:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:43.145225 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d31f35-4a5b-4d1b-ba90-f79b413b5d14 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:43.177482 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:43.187883 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:43.235181 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 84/172] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:41:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:43.238631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc762975-759d-4fff-afac-687b6b2e2e39 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:43.239088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc762975-759d-4fff-afac-687b6b2e2e39 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:43.239644 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc762975-759d-4fff-afac-687b6b2e2e39 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:43.241160 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 85/173] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:43.242098 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc762975-759d-4fff-afac-687b6b2e2e39 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:43.307258 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d31f35-4a5b-4d1b-ba90-f79b413b5d14 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:43.360315 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722fbc0-d04b-460f-9b5a-119f697a5fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:43.362287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722fbc0-d04b-460f-9b5a-119f697a5fb2 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:43.362793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722fbc0-d04b-460f-9b5a-119f697a5fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:43.363450 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722fbc0-d04b-460f-9b5a-119f697a5fb2 None admin] PATH_INFO: `/v3/users/427345877d57430294ac22048db4a8c5` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:43.365363 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722fbc0-d04b-460f-9b5a-119f697a5fb2 None admin] RBAC: Authorizing `identity:get_user(user_id=427345877d57430294ac22048db4a8c5)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:43.367451 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722fbc0-d04b-460f-9b5a-119f697a5fb2 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:43.368956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc762975-759d-4fff-afac-687b6b2e2e39 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:43.369785 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 89/174] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:43 2022] GET /identity/v3/users/427345877d57430294ac22048db4a8c5 => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:43.371531 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa7a26-6352-451f-b097-4ade5fa236c5 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:43.372065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa7a26-6352-451f-b097-4ade5fa236c5 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:43.372541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa7a26-6352-451f-b097-4ade5fa236c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:43.401510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-40fa7a26-6352-451f-b097-4ade5fa236c5 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:43.402739 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-40fa7a26-6352-451f-b097-4ade5fa236c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:43.414552 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3e6b0-cb4f-4311-9c11-20e2b36d3140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:43.415626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3e6b0-cb4f-4311-9c11-20e2b36d3140 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:43.416217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3e6b0-cb4f-4311-9c11-20e2b36d3140 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:43.416707 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3e6b0-cb4f-4311-9c11-20e2b36d3140 None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:43.418389 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3e6b0-cb4f-4311-9c11-20e2b36d3140 None admin] RBAC: Authorizing `identity:get_project(project_id=856293872ed14cbda37a5830759ee4e7)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:43.420181 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3e6b0-cb4f-4311-9c11-20e2b36d3140 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:43.422452 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 86/175] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:43 2022] GET /identity/v3/projects/856293872ed14cbda37a5830759ee4e7 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:43.423481 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3e6b0-cb4f-4311-9c11-20e2b36d3140 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:43.459857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:43.478656 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 90/176] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:43.479964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b4625-0d4f-45e2-990c-aa9508c7bc76 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:43.481041 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b4625-0d4f-45e2-990c-aa9508c7bc76 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:43.481041 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b4625-0d4f-45e2-990c-aa9508c7bc76 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:43.482194 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 91/177] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:43.482697 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b4625-0d4f-45e2-990c-aa9508c7bc76 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:43.503514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:43.541506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3e6b0-cb4f-4311-9c11-20e2b36d3140 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:43.582174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6df52-7a9e-4383-9907-9f328e5da310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:43.583244 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6df52-7a9e-4383-9907-9f328e5da310 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:43.583756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6df52-7a9e-4383-9907-9f328e5da310 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:43.584284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6df52-7a9e-4383-9907-9f328e5da310 None admin] PATH_INFO: `/v3/projects/be50a41a2163492abc7db04b97a96031` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:43.585872 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6df52-7a9e-4383-9907-9f328e5da310 None admin] RBAC: Authorizing `identity:get_project(project_id=be50a41a2163492abc7db04b97a96031)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:43.587826 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6df52-7a9e-4383-9907-9f328e5da310 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:43.589920 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 87/178] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:43 2022] GET /identity/v3/projects/be50a41a2163492abc7db04b97a96031 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:43.590939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6df52-7a9e-4383-9907-9f328e5da310 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:43.612894 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b4625-0d4f-45e2-990c-aa9508c7bc76 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:43.650689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e54a86-1eac-4796-b239-ee606e114b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:43.651346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e54a86-1eac-4796-b239-ee606e114b86 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:43.651633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e54a86-1eac-4796-b239-ee606e114b86 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:43.651908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e54a86-1eac-4796-b239-ee606e114b86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:43.704160 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:43.719138 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6df52-7a9e-4383-9907-9f328e5da310 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:43.729294 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e54a86-1eac-4796-b239-ee606e114b86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:43.730901 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e54a86-1eac-4796-b239-ee606e114b86 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:43.743145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:43.755018 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbb4b6-7ad9-4a79-a3ca-61dd395dcbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:43.755756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbb4b6-7ad9-4a79-a3ca-61dd395dcbb8 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:43.762080 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbb4b6-7ad9-4a79-a3ca-61dd395dcbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:43.762080 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbb4b6-7ad9-4a79-a3ca-61dd395dcbb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:43.762080 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbb4b6-7ad9-4a79-a3ca-61dd395dcbb8 None admin] RBAC: Adding query filter params (role.id=8a5766c4aef44773834941d1bdbd1e98, scope.project.id=856293872ed14cbda37a5830759ee4e7, user.id=3f3fe43cd62f4e5186fa1917f6943de6) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:43.762080 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbb4b6-7ad9-4a79-a3ca-61dd395dcbb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:43.762080 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbb4b6-7ad9-4a79-a3ca-61dd395dcbb8 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:43.764680 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 88/179] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:41:43 2022] GET /identity/v3/role_assignments?user.id=3f3fe43cd62f4e5186fa1917f6943de6&scope.project.id=856293872ed14cbda37a5830759ee4e7&role.id=8a5766c4aef44773834941d1bdbd1e98 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:43.765846 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23289472-1c0c-4510-98c2-18354457ac92 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:43.766129 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23289472-1c0c-4510-98c2-18354457ac92 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:43.766396 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23289472-1c0c-4510-98c2-18354457ac92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:43.786829 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-23289472-1c0c-4510-98c2-18354457ac92 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:43.788124 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-23289472-1c0c-4510-98c2-18354457ac92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:43.868776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 92/180] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:41:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:43.868776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e54a86-1eac-4796-b239-ee606e114b86 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:43.873591 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 89/181] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:43.880832 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23289472-1c0c-4510-98c2-18354457ac92 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:43.989998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e54a86-1eac-4796-b239-ee606e114b86 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:43.996309 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:44.000387 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:44.019008 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23289472-1c0c-4510-98c2-18354457ac92 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:44.025763 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88499f2e-ceae-4cab-a1f1-1eace71b88c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:44.026418 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88499f2e-ceae-4cab-a1f1-1eace71b88c1 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:44.026705 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88499f2e-ceae-4cab-a1f1-1eace71b88c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:44.026984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88499f2e-ceae-4cab-a1f1-1eace71b88c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:44.038247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88499f2e-ceae-4cab-a1f1-1eace71b88c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:44.043229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-88499f2e-ceae-4cab-a1f1-1eace71b88c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:41:44.043229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:44.043229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:44.043229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:44.043229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:44.043229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:44.043229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:44.043229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:44.043229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:44.043229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:44.043229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:44.043229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:44.043229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:44.043229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:44.043229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:44.043229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:44.044312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:44.044312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:44.044312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:44.044312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:44.044312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:44.044312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:44.044312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:44.044312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:44.044312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:44.044312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:44.044312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:44.044312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:44.044312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:44.044312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:44.044312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:44.044312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:44.045109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:44.045109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:44.045109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:44.045109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:44.045109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:44.045109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:44.045109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:44.045109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:44.045109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:44.045109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:44.045109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:41:44.045109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:41:44.045109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 93/182] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:41:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:44.045892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40317940-7b99-4f23-9483-07d59ea51806 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:44.046186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40317940-7b99-4f23-9483-07d59ea51806 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:44.046471 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40317940-7b99-4f23-9483-07d59ea51806 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:44.047865 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 94/183] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:44.056351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5d9ec-64c5-4cb2-b22f-7d467c56f80a None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:44.056351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5d9ec-64c5-4cb2-b22f-7d467c56f80a None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:44.056351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5d9ec-64c5-4cb2-b22f-7d467c56f80a None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:44.056351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 95/184] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:44.056351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5d9ec-64c5-4cb2-b22f-7d467c56f80a None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:44.061066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad377a6-5524-47ce-967e-676ef4eecc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:44.061709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad377a6-5524-47ce-967e-676ef4eecc23 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:44.062044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad377a6-5524-47ce-967e-676ef4eecc23 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:44.062319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad377a6-5524-47ce-967e-676ef4eecc23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:44.063122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad377a6-5524-47ce-967e-676ef4eecc23 None admin] RBAC: Adding query filter params (role.id=43f173da338d498382fba44911238254, scope.project.id=be50a41a2163492abc7db04b97a96031, user.id=427345877d57430294ac22048db4a8c5) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:44.063487 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad377a6-5524-47ce-967e-676ef4eecc23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:44.065178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad377a6-5524-47ce-967e-676ef4eecc23 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:44.071556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 90/185] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:41:43 2022] GET /identity/v3/role_assignments?user.id=427345877d57430294ac22048db4a8c5&scope.project.id=be50a41a2163492abc7db04b97a96031&role.id=43f173da338d498382fba44911238254 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:44.076752 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad377a6-5524-47ce-967e-676ef4eecc23 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:44.177634 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5d9ec-64c5-4cb2-b22f-7d467c56f80a None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:44.203605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad377a6-5524-47ce-967e-676ef4eecc23 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:44.234761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4d7b8-60c1-4f65-9b69-cccd68ce1a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:44.236243 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4d7b8-60c1-4f65-9b69-cccd68ce1a17 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:44.236243 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4d7b8-60c1-4f65-9b69-cccd68ce1a17 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:44.236243 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4d7b8-60c1-4f65-9b69-cccd68ce1a17 None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:44.238745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4d7b8-60c1-4f65-9b69-cccd68ce1a17 None admin] RBAC: Authorizing `identity:get_project(project_id=856293872ed14cbda37a5830759ee4e7)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:44.239387 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4d7b8-60c1-4f65-9b69-cccd68ce1a17 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:44.241753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 96/186] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:44 2022] GET /identity/v3/projects/856293872ed14cbda37a5830759ee4e7 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:44.242289 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b33f1d-7231-4027-95b8-2d29c8141103 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:44.242575 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b33f1d-7231-4027-95b8-2d29c8141103 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:44.242850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b33f1d-7231-4027-95b8-2d29c8141103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:44.258862 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d27e1c-ef33-43e7-86eb-a81f20c5ffb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:44.259645 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d27e1c-ef33-43e7-86eb-a81f20c5ffb1 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:44.260015 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d27e1c-ef33-43e7-86eb-a81f20c5ffb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:44.260356 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d27e1c-ef33-43e7-86eb-a81f20c5ffb1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:44.264666 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-97b33f1d-7231-4027-95b8-2d29c8141103 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:44.265875 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-97b33f1d-7231-4027-95b8-2d29c8141103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:44.273678 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d27e1c-ef33-43e7-86eb-a81f20c5ffb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:44.279013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-56d27e1c-ef33-43e7-86eb-a81f20c5ffb1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 03:41:44.279013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:44.279013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:44.279013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:44.279013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:44.279013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:44.279013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:44.279013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:44.279013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:44.279013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:44.279013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:44.279013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:44.279013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:44.279013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:44.279013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:44.279013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:44.279945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:44.279945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:44.279945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:44.279945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:44.279945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:44.279945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:44.279945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:44.279945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:44.279945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:44.279945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:44.279945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:44.279945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:44.279945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:44.279945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:44.279945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:44.279945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:44.280794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:44.280794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:44.280794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:44.280794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:44.280794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:44.280794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:44.280794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:44.280794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:44.280794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:44.280794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:44.280794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 03:41:44.280794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:41:44.281649 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 91/187] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:44.282499 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d27e1c-ef33-43e7-86eb-a81f20c5ffb1 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:44.288140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:44.301318 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:44.345612 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 97/188] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:44.347726 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503a791-07bc-48ac-9ba8-101645925be3 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:44.348019 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503a791-07bc-48ac-9ba8-101645925be3 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:44.348300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503a791-07bc-48ac-9ba8-101645925be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:44.368301 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-3503a791-07bc-48ac-9ba8-101645925be3 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:44.370159 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-3503a791-07bc-48ac-9ba8-101645925be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:44.410331 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d27e1c-ef33-43e7-86eb-a81f20c5ffb1 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:44.446615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd255bf-a83d-48da-9dfc-6793002d1c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:44.447263 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd255bf-a83d-48da-9dfc-6793002d1c54 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:44.447574 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd255bf-a83d-48da-9dfc-6793002d1c54 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:44.447849 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd255bf-a83d-48da-9dfc-6793002d1c54 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:44.448583 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd255bf-a83d-48da-9dfc-6793002d1c54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:44.448888 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd255bf-a83d-48da-9dfc-6793002d1c54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:44.450332 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd255bf-a83d-48da-9dfc-6793002d1c54 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:44.456051 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 98/189] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:44.456928 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503a791-07bc-48ac-9ba8-101645925be3 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:44.468569 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 92/190] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:44.469640 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd255bf-a83d-48da-9dfc-6793002d1c54 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:44.541566 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:44.559678 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:44.565969 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503a791-07bc-48ac-9ba8-101645925be3 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:44.577926 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd255bf-a83d-48da-9dfc-6793002d1c54 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:44.601318 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fbb32-926c-43ce-bd8c-adfaf0c95fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:44.602129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fbb32-926c-43ce-bd8c-adfaf0c95fd6 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:44.602513 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fbb32-926c-43ce-bd8c-adfaf0c95fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:44.602913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fbb32-926c-43ce-bd8c-adfaf0c95fd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:44.603965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fbb32-926c-43ce-bd8c-adfaf0c95fd6 None admin] RBAC: Adding query filter params (role.id=81c955f5702546679605b5484602ae69, scope.project.id=856293872ed14cbda37a5830759ee4e7, user.id=427345877d57430294ac22048db4a8c5) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:44.604354 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fbb32-926c-43ce-bd8c-adfaf0c95fd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:44.606130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fbb32-926c-43ce-bd8c-adfaf0c95fd6 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:44.613091 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 99/191] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:41:44 2022] GET /identity/v3/role_assignments?user.id=427345877d57430294ac22048db4a8c5&scope.project.id=856293872ed14cbda37a5830759ee4e7&role.id=81c955f5702546679605b5484602ae69 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:44.613896 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fbb32-926c-43ce-bd8c-adfaf0c95fd6 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:44.620512 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787093a-61be-4afb-97f8-fb56a3166429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:44.621339 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787093a-61be-4afb-97f8-fb56a3166429 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:44.621674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787093a-61be-4afb-97f8-fb56a3166429 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:44.622009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787093a-61be-4afb-97f8-fb56a3166429 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:44.622848 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787093a-61be-4afb-97f8-fb56a3166429 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:44.623231 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787093a-61be-4afb-97f8-fb56a3166429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:44.624805 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787093a-61be-4afb-97f8-fb56a3166429 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:44.641763 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 93/192] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:41:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:44.642928 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787093a-61be-4afb-97f8-fb56a3166429 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:44.751780 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fbb32-926c-43ce-bd8c-adfaf0c95fd6 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:44.772903 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787093a-61be-4afb-97f8-fb56a3166429 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:44.802261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad4575-ea76-4b44-99e4-ef4077dcca97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:44.803029 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad4575-ea76-4b44-99e4-ef4077dcca97 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:44.803311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad4575-ea76-4b44-99e4-ef4077dcca97 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:44.803617 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad4575-ea76-4b44-99e4-ef4077dcca97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:44.806214 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad4575-ea76-4b44-99e4-ef4077dcca97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:44.807395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad4575-ea76-4b44-99e4-ef4077dcca97 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:44.807523 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:44.809185 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 100/193] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:41:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:44.810951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad4575-ea76-4b44-99e4-ef4077dcca97 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:44.817712 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52015023-cffe-48a0-aeb4-4868e2189224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:44.818378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52015023-cffe-48a0-aeb4-4868e2189224 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:44.824633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52015023-cffe-48a0-aeb4-4868e2189224 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:44.824633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52015023-cffe-48a0-aeb4-4868e2189224 None admin] PATH_INFO: `/v3/users/ca5fd5885cb74767a606e64c03ea9b8d` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:44.834657 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52015023-cffe-48a0-aeb4-4868e2189224 None admin] RBAC: Authorizing `identity:get_user(user_id=ca5fd5885cb74767a606e64c03ea9b8d)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:44.836475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52015023-cffe-48a0-aeb4-4868e2189224 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:44.838211 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 94/194] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:44 2022] GET /identity/v3/users/ca5fd5885cb74767a606e64c03ea9b8d => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:44.838994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52015023-cffe-48a0-aeb4-4868e2189224 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:44.854864 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:44.929638 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad4575-ea76-4b44-99e4-ef4077dcca97 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:44.947584 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52015023-cffe-48a0-aeb4-4868e2189224 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:44.965988 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091f8a8-66a3-4485-9c3b-ec7b055e9b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:44.966635 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091f8a8-66a3-4485-9c3b-ec7b055e9b88 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:44.966913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091f8a8-66a3-4485-9c3b-ec7b055e9b88 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:44.967183 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091f8a8-66a3-4485-9c3b-ec7b055e9b88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:44.978606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091f8a8-66a3-4485-9c3b-ec7b055e9b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:44.982232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f74f6-c5b9-4317-bf53-e60020287a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:44.982887 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f74f6-c5b9-4317-bf53-e60020287a23 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:44.983194 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f74f6-c5b9-4317-bf53-e60020287a23 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:44.983478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f74f6-c5b9-4317-bf53-e60020287a23 None admin] PATH_INFO: `/v3/users/951e5d48cd8143f186ee100a92a18a3f` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:44.983602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-e091f8a8-66a3-4485-9c3b-ec7b055e9b88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:41:44.983602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:44.983602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:44.983602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:44.983602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:44.983602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:44.983602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:44.983602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:44.983602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:44.983602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:44.983602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:44.983602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:44.983602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:44.983602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:44.983602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:44.983602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:44.984657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:44.984657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:44.984657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:44.984657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:44.984657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:44.984657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:44.984657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:44.984657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:44.984657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:44.984657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:44.984657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:44.984657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:44.984657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:44.984657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:44.984657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:44.984657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:44.985466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:44.985466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:44.985466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:44.985466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:44.985466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:44.985466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:44.985466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:44.985466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:44.985466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:44.985466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:44.985466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:41:44.985466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:41:44.985466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 101/195] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:41:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:44.985466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091f8a8-66a3-4485-9c3b-ec7b055e9b88 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:44.987496 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f74f6-c5b9-4317-bf53-e60020287a23 None admin] RBAC: Authorizing `identity:get_user(user_id=951e5d48cd8143f186ee100a92a18a3f)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:44.989183 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f74f6-c5b9-4317-bf53-e60020287a23 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:44.995140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 95/196] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:44 2022] GET /identity/v3/users/951e5d48cd8143f186ee100a92a18a3f => generated 289 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:44.995140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f74f6-c5b9-4317-bf53-e60020287a23 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:45.049962 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:45.087131 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:45.097887 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f74f6-c5b9-4317-bf53-e60020287a23 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:45.100428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091f8a8-66a3-4485-9c3b-ec7b055e9b88 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:45.136942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ae5f4-1726-487f-8a7d-b6153e2d7233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:45.137570 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ae5f4-1726-487f-8a7d-b6153e2d7233 None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:45.137854 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ae5f4-1726-487f-8a7d-b6153e2d7233 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:45.138132 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ae5f4-1726-487f-8a7d-b6153e2d7233 None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:45.138373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f4940-c6d1-4dd5-adac-6136f38196cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:45.138841 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ae5f4-1726-487f-8a7d-b6153e2d7233 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:45.139011 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f4940-c6d1-4dd5-adac-6136f38196cf None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:45.139295 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f4940-c6d1-4dd5-adac-6136f38196cf None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:45.139612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f4940-c6d1-4dd5-adac-6136f38196cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:45.140346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ae5f4-1726-487f-8a7d-b6153e2d7233 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:45.211332 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f4940-c6d1-4dd5-adac-6136f38196cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:45.212883 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f4940-c6d1-4dd5-adac-6136f38196cf None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:45.265464 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:45.272582 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 102/197] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 28 03:41:44 2022] POST /identity/v3/users => generated 297 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:41:45.276797 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ae5f4-1726-487f-8a7d-b6153e2d7233 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:45.327913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 96/198] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:41:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:45.328790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f4940-c6d1-4dd5-adac-6136f38196cf None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:45.405304 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ae5f4-1726-487f-8a7d-b6153e2d7233 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:45.453007 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d138388-58fc-41cb-91e6-5cd99ec7318c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:45.453898 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d138388-58fc-41cb-91e6-5cd99ec7318c None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:45.454319 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d138388-58fc-41cb-91e6-5cd99ec7318c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:45.454729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d138388-58fc-41cb-91e6-5cd99ec7318c None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:45.455869 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d138388-58fc-41cb-91e6-5cd99ec7318c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:45.456241 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d138388-58fc-41cb-91e6-5cd99ec7318c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:45.458916 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d138388-58fc-41cb-91e6-5cd99ec7318c None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:45.459169 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f4940-c6d1-4dd5-adac-6136f38196cf None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:45.466488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 103/199] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:41:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:45.467147 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d138388-58fc-41cb-91e6-5cd99ec7318c None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:45.478005 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:45.505302 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdaa3c-363a-45f8-b7a7-33c0d6105c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:45.505975 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdaa3c-363a-45f8-b7a7-33c0d6105c5f None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:45.506293 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdaa3c-363a-45f8-b7a7-33c0d6105c5f None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:45.506575 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdaa3c-363a-45f8-b7a7-33c0d6105c5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:45.536302 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:45.597871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d138388-58fc-41cb-91e6-5cd99ec7318c None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:45.599288 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdaa3c-363a-45f8-b7a7-33c0d6105c5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:45.601470 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdaa3c-363a-45f8-b7a7-33c0d6105c5f None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:45.663056 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be6397-c67a-4d81-8b8a-6bb6936994d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:45.664269 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be6397-c67a-4d81-8b8a-6bb6936994d0 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:45.665166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be6397-c67a-4d81-8b8a-6bb6936994d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:45.665835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be6397-c67a-4d81-8b8a-6bb6936994d0 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:45.667621 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be6397-c67a-4d81-8b8a-6bb6936994d0 None admin] RBAC: Authorizing `identity:get_project(project_id=fad2eddcd9204e1e82453c2e4c58edd0)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:45.669594 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be6397-c67a-4d81-8b8a-6bb6936994d0 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:45.672063 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 104/200] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:45 2022] GET /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:45.673261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be6397-c67a-4d81-8b8a-6bb6936994d0 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:45.734043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 97/201] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:41:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:45.735020 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdaa3c-363a-45f8-b7a7-33c0d6105c5f None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:45.771537 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:45.802138 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:45.808331 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be6397-c67a-4d81-8b8a-6bb6936994d0 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:45.859387 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347ca9c-1f3e-45bb-87b5-39b605c110a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:45.860050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347ca9c-1f3e-45bb-87b5-39b605c110a2 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:45.860333 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347ca9c-1f3e-45bb-87b5-39b605c110a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:45.860607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347ca9c-1f3e-45bb-87b5-39b605c110a2 None admin] PATH_INFO: `/v3/users/ca5fd5885cb74767a606e64c03ea9b8d` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:45.862367 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347ca9c-1f3e-45bb-87b5-39b605c110a2 None admin] RBAC: Authorizing `identity:get_user(user_id=ca5fd5885cb74767a606e64c03ea9b8d)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:45.863858 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347ca9c-1f3e-45bb-87b5-39b605c110a2 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:45.865928 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 105/202] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:45 2022] GET /identity/v3/users/ca5fd5885cb74767a606e64c03ea9b8d => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:45.866854 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347ca9c-1f3e-45bb-87b5-39b605c110a2 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:45.867688 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdaa3c-363a-45f8-b7a7-33c0d6105c5f None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:45.905317 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be29f1a-47f4-4a29-b7b1-2a249115ab55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:45.906319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be29f1a-47f4-4a29-b7b1-2a249115ab55 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:45.906639 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be29f1a-47f4-4a29-b7b1-2a249115ab55 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:45.906965 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be29f1a-47f4-4a29-b7b1-2a249115ab55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:45.908283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be29f1a-47f4-4a29-b7b1-2a249115ab55 None admin] RBAC: Adding query filter params (role.id=8a5766c4aef44773834941d1bdbd1e98, scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0, user.id=ca5fd5885cb74767a606e64c03ea9b8d) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:45.908816 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be29f1a-47f4-4a29-b7b1-2a249115ab55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:45.911202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be29f1a-47f4-4a29-b7b1-2a249115ab55 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:45.918023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 98/203] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:41:45 2022] GET /identity/v3/role_assignments?user.id=ca5fd5885cb74767a606e64c03ea9b8d&scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0&role.id=8a5766c4aef44773834941d1bdbd1e98 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:45.918886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be29f1a-47f4-4a29-b7b1-2a249115ab55 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:46.040896 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347ca9c-1f3e-45bb-87b5-39b605c110a2 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:46.069967 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be29f1a-47f4-4a29-b7b1-2a249115ab55 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:46.104374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:46.112731 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58711b72-af83-4b71-b2b2-e9b8f2db928e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:46.114823 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58711b72-af83-4b71-b2b2-e9b8f2db928e None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:46.115115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58711b72-af83-4b71-b2b2-e9b8f2db928e None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:46.123649 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58711b72-af83-4b71-b2b2-e9b8f2db928e None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:46.123649 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58711b72-af83-4b71-b2b2-e9b8f2db928e None admin] RBAC: Authorizing `identity:get_project(project_id=856293872ed14cbda37a5830759ee4e7)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:46.123649 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58711b72-af83-4b71-b2b2-e9b8f2db928e None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:46.123649 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 106/204] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:45 2022] GET /identity/v3/projects/856293872ed14cbda37a5830759ee4e7 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:46.129493 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58711b72-af83-4b71-b2b2-e9b8f2db928e None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:46.137528 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15493fb2-290c-4e1f-96c6-3c665195c34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:46.138181 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15493fb2-290c-4e1f-96c6-3c665195c34e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:46.138464 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15493fb2-290c-4e1f-96c6-3c665195c34e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:46.138741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15493fb2-290c-4e1f-96c6-3c665195c34e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:46.150603 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:46.243107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15493fb2-290c-4e1f-96c6-3c665195c34e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:46.245078 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15493fb2-290c-4e1f-96c6-3c665195c34e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:46.356468 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 99/205] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:41:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:46.364103 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15493fb2-290c-4e1f-96c6-3c665195c34e None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:46.375290 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58711b72-af83-4b71-b2b2-e9b8f2db928e None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:46.385804 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:46.451668 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a34cc-345c-4ec2-a37c-56d3b8cbda02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:46.452847 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a34cc-345c-4ec2-a37c-56d3b8cbda02 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:46.453337 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a34cc-345c-4ec2-a37c-56d3b8cbda02 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:46.454192 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a34cc-345c-4ec2-a37c-56d3b8cbda02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:46.455818 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a34cc-345c-4ec2-a37c-56d3b8cbda02 None admin] RBAC: Adding query filter params (role.id=e2859598b69d4763beae00133c2d5a83, scope.project.id=856293872ed14cbda37a5830759ee4e7, user.id=951e5d48cd8143f186ee100a92a18a3f) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:46.456517 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a34cc-345c-4ec2-a37c-56d3b8cbda02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:46.458825 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a34cc-345c-4ec2-a37c-56d3b8cbda02 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:46.473462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 107/206] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:41:46 2022] GET /identity/v3/role_assignments?user.id=951e5d48cd8143f186ee100a92a18a3f&scope.project.id=856293872ed14cbda37a5830759ee4e7&role.id=e2859598b69d4763beae00133c2d5a83 => generated 608 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:46.532336 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15493fb2-290c-4e1f-96c6-3c665195c34e None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:46.593091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0075757-44fb-4933-a711-5401221aafa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:46.593780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0075757-44fb-4933-a711-5401221aafa2 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:46.594063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0075757-44fb-4933-a711-5401221aafa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:46.594335 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0075757-44fb-4933-a711-5401221aafa2 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:46.596131 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0075757-44fb-4933-a711-5401221aafa2 None admin] RBAC: Authorizing `identity:get_project(project_id=fad2eddcd9204e1e82453c2e4c58edd0)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:46.597822 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0075757-44fb-4933-a711-5401221aafa2 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:46.599563 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 100/207] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:46 2022] GET /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:46.606209 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a34cc-345c-4ec2-a37c-56d3b8cbda02 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:46.720545 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:46.753750 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a34cc-345c-4ec2-a37c-56d3b8cbda02 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:46.805089 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce551823-ca78-4b2e-9961-a91418763f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:46.805744 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce551823-ca78-4b2e-9961-a91418763f36 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:46.806030 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce551823-ca78-4b2e-9961-a91418763f36 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:46.806306 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce551823-ca78-4b2e-9961-a91418763f36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:46.807132 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce551823-ca78-4b2e-9961-a91418763f36 None admin] RBAC: Adding query filter params (role.id=81c955f5702546679605b5484602ae69, scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0, user.id=ca5fd5885cb74767a606e64c03ea9b8d) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:46.807472 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce551823-ca78-4b2e-9961-a91418763f36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:46.808964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce551823-ca78-4b2e-9961-a91418763f36 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:46.816541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 108/208] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:41:46 2022] GET /identity/v3/role_assignments?user.id=ca5fd5885cb74767a606e64c03ea9b8d&scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0&role.id=81c955f5702546679605b5484602ae69 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:47.618168 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d3ece-79f8-4687-a71b-46bb6c6067d7 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:47.618680 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d3ece-79f8-4687-a71b-46bb6c6067d7 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:47.618754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d3ece-79f8-4687-a71b-46bb6c6067d7 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:47.620596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 101/209] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:41:47.626203 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2eecd-80a2-4753-9ee5-e8b01294ded2 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:47.626648 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2eecd-80a2-4753-9ee5-e8b01294ded2 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:47.627483 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2eecd-80a2-4753-9ee5-e8b01294ded2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:47.647508 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-8eb2eecd-80a2-4753-9ee5-e8b01294ded2 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:47.648785 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-8eb2eecd-80a2-4753-9ee5-e8b01294ded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:47.724708 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 109/210] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:41:47.748605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d3ece-79f8-4687-a71b-46bb6c6067d7 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:47.870415 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:47.887636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d3ece-79f8-4687-a71b-46bb6c6067d7 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:47.926630 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3ac66-1ea7-463f-914c-857659ff0f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:47.927307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3ac66-1ea7-463f-914c-857659ff0f69 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:47.927656 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3ac66-1ea7-463f-914c-857659ff0f69 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:47.927940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3ac66-1ea7-463f-914c-857659ff0f69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:47.939953 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3ac66-1ea7-463f-914c-857659ff0f69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:47.946081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-12c3ac66-1ea7-463f-914c-857659ff0f69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:47.946081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:47.946081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:47.946081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:47.946081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:47.946081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:47.946081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:47.946081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:47.946081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:47.946081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:47.946081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:47.946081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:47.946081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:47.946081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:47.946081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:47.946081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:47.946930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:47.946930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:47.946930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:47.946930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:47.946930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:47.946930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:47.946930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:47.946930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:47.946930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:47.946930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:47.946930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:47.946930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:47.946930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:47.946930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:47.946930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:47.946930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:47.947748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:47.947748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:47.947748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:47.947748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:47.947748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:47.947748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:47.947748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:47.947748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:47.947748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:47.947748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:47.947748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:47.947748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:41:47.947748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 102/211] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:41:47.953384 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2eecd-80a2-4753-9ee5-e8b01294ded2 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:47.989988 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b0508-fd2b-4da6-baba-995d664d1153 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:47.990621 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b0508-fd2b-4da6-baba-995d664d1153 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:47.991104 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b0508-fd2b-4da6-baba-995d664d1153 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:47.992705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 103/212] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:41:47.998117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31ad35-002c-4250-8f24-c268bfc73d75 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:47.998684 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31ad35-002c-4250-8f24-c268bfc73d75 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:47.999177 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31ad35-002c-4250-8f24-c268bfc73d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:48.018085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-bc31ad35-002c-4250-8f24-c268bfc73d75 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:48.019668 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-bc31ad35-002c-4250-8f24-c268bfc73d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:48.031080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:48.083224 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2eecd-80a2-4753-9ee5-e8b01294ded2 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:48.108933 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 104/213] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:41:48.132219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbc7a4-ef9a-4892-b162-b3826463170a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:48.134169 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31ad35-002c-4250-8f24-c268bfc73d75 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:48.136436 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbc7a4-ef9a-4892-b162-b3826463170a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:48.137162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbc7a4-ef9a-4892-b162-b3826463170a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:48.137754 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbc7a4-ef9a-4892-b162-b3826463170a None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:48.138900 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cbc7a4-ef9a-4892-b162-b3826463170a None admin] RBAC: Adding query filter params (name=member) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:48.139472 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cbc7a4-ef9a-4892-b162-b3826463170a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:48.141221 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cbc7a4-ef9a-4892-b162-b3826463170a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:48.154185 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 110/214] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:41:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:48.167627 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbc7a4-ef9a-4892-b162-b3826463170a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:48.234082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:48.259389 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31ad35-002c-4250-8f24-c268bfc73d75 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:48.281255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbc7a4-ef9a-4892-b162-b3826463170a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:48.307268 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db75942-73ae-4c38-b676-b870646e91d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:48.307977 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db75942-73ae-4c38-b676-b870646e91d0 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:48.308257 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db75942-73ae-4c38-b676-b870646e91d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:48.308529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db75942-73ae-4c38-b676-b870646e91d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:48.309673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db75942-73ae-4c38-b676-b870646e91d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:48.311221 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db75942-73ae-4c38-b676-b870646e91d0 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:48.313156 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 105/215] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:41:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:48.314268 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365bf83-9a7b-455e-be1e-aefa4b4f0b5b None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:48.314498 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:48.314598 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365bf83-9a7b-455e-be1e-aefa4b4f0b5b None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:48.314807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365bf83-9a7b-455e-be1e-aefa4b4f0b5b None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:48.316471 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 106/216] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:48.319096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365bf83-9a7b-455e-be1e-aefa4b4f0b5b None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:48.325723 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe1747-8a3d-4670-aae9-123cbe8b5284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:48.326417 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe1747-8a3d-4670-aae9-123cbe8b5284 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:48.326707 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe1747-8a3d-4670-aae9-123cbe8b5284 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:48.326983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe1747-8a3d-4670-aae9-123cbe8b5284 None admin] PATH_INFO: `/v3/users/5e50958576834e33a329ea9e21a348dc` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:48.343493 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe1747-8a3d-4670-aae9-123cbe8b5284 None admin] RBAC: Authorizing `identity:get_user(user_id=5e50958576834e33a329ea9e21a348dc)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:48.346310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe1747-8a3d-4670-aae9-123cbe8b5284 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:48.348442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 111/217] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:48 2022] GET /identity/v3/users/5e50958576834e33a329ea9e21a348dc => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:48.354112 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dba4c8-fc3e-4d94-a09f-30f14bdc23b8 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:48.354407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dba4c8-fc3e-4d94-a09f-30f14bdc23b8 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:48.354680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dba4c8-fc3e-4d94-a09f-30f14bdc23b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:48.372043 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-91dba4c8-fc3e-4d94-a09f-30f14bdc23b8 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:48.373237 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-91dba4c8-fc3e-4d94-a09f-30f14bdc23b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:48.430940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365bf83-9a7b-455e-be1e-aefa4b4f0b5b None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:48.447810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 112/218] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:48.448565 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dba4c8-fc3e-4d94-a09f-30f14bdc23b8 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:48.483869 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2d9fe-3fbb-444e-ac45-70042f3a8fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:48.484503 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2d9fe-3fbb-444e-ac45-70042f3a8fea None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:48.484783 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2d9fe-3fbb-444e-ac45-70042f3a8fea None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:48.485057 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2d9fe-3fbb-444e-ac45-70042f3a8fea None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:48.485752 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2d9fe-3fbb-444e-ac45-70042f3a8fea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:48.488437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2d9fe-3fbb-444e-ac45-70042f3a8fea None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:48.554614 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dba4c8-fc3e-4d94-a09f-30f14bdc23b8 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:48.578059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:48.596163 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:48.600552 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fbfaf-8f88-4d30-a2c8-f0f372558642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:48.601195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fbfaf-8f88-4d30-a2c8-f0f372558642 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:48.611905 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fbfaf-8f88-4d30-a2c8-f0f372558642 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:48.611905 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fbfaf-8f88-4d30-a2c8-f0f372558642 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:48.612165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 107/219] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 28 03:41:48 2022] POST /identity/v3/users => generated 297 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:41:48.612165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2d9fe-3fbb-444e-ac45-70042f3a8fea None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:48.743253 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fbfaf-8f88-4d30-a2c8-f0f372558642 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:48.745774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fbfaf-8f88-4d30-a2c8-f0f372558642 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:48.751694 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2d9fe-3fbb-444e-ac45-70042f3a8fea None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:48.826007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba8d74-0cc3-481b-9aea-9dcb5c6f1582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:48.827930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba8d74-0cc3-481b-9aea-9dcb5c6f1582 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:48.828400 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba8d74-0cc3-481b-9aea-9dcb5c6f1582 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:48.828847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba8d74-0cc3-481b-9aea-9dcb5c6f1582 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:48.847314 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba8d74-0cc3-481b-9aea-9dcb5c6f1582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:48.855612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-b1ba8d74-0cc3-481b-9aea-9dcb5c6f1582 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:41:48.855612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:48.855612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:48.855612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:48.855612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:48.855612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:48.855612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:48.855612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:48.855612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:48.855612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:48.855612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:48.855612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:48.855612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:48.855612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:48.855612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:48.855612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:48.856522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:48.856522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:48.856522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:48.856522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:48.856522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:48.856522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:48.856522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:48.856522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:48.856522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:48.856522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:48.856522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:48.856522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:48.856522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:48.856522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:48.856522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:48.856522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:48.857284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:48.857284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:48.857284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:48.857284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:48.857284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:48.857284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:48.857284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:48.857284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:48.857284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:48.857284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:48.857284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:41:48.857284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:41:48.859659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 108/220] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:41:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:48.865652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba8d74-0cc3-481b-9aea-9dcb5c6f1582 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:48.912526 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 113/221] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:41:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:48.918591 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fbfaf-8f88-4d30-a2c8-f0f372558642 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:48.943971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:48.958866 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:49.013590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba8d74-0cc3-481b-9aea-9dcb5c6f1582 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:49.047779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fbfaf-8f88-4d30-a2c8-f0f372558642 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:49.058918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7105d5a-e807-4442-ab9d-a342c76bb530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:49.059696 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7105d5a-e807-4442-ab9d-a342c76bb530 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:49.059980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7105d5a-e807-4442-ab9d-a342c76bb530 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:49.060256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7105d5a-e807-4442-ab9d-a342c76bb530 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:49.061101 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7105d5a-e807-4442-ab9d-a342c76bb530 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:49.061438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7105d5a-e807-4442-ab9d-a342c76bb530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:49.062875 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7105d5a-e807-4442-ab9d-a342c76bb530 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:49.076278 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 109/222] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:49.082864 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7105d5a-e807-4442-ab9d-a342c76bb530 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:49.087952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7025c13-fb95-4aab-9428-b9c4213ccc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:49.088792 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7025c13-fb95-4aab-9428-b9c4213ccc50 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:49.089213 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7025c13-fb95-4aab-9428-b9c4213ccc50 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:49.089655 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7025c13-fb95-4aab-9428-b9c4213ccc50 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:49.090985 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7025c13-fb95-4aab-9428-b9c4213ccc50 None admin] RBAC: Authorizing `identity:get_project(project_id=fad2eddcd9204e1e82453c2e4c58edd0)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:49.092612 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7025c13-fb95-4aab-9428-b9c4213ccc50 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:49.094725 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 114/223] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:48 2022] GET /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:49.103556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7025c13-fb95-4aab-9428-b9c4213ccc50 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:49.207830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:49.213405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7105d5a-e807-4442-ab9d-a342c76bb530 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:49.223354 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7025c13-fb95-4aab-9428-b9c4213ccc50 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:49.243170 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:49.256322 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114741be-fe4a-45c5-bf0c-a18352a61c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:49.257155 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114741be-fe4a-45c5-bf0c-a18352a61c31 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:49.257536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114741be-fe4a-45c5-bf0c-a18352a61c31 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:49.257915 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114741be-fe4a-45c5-bf0c-a18352a61c31 None admin] PATH_INFO: `/v3/users/ca5fd5885cb74767a606e64c03ea9b8d` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:49.259332 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114741be-fe4a-45c5-bf0c-a18352a61c31 None admin] RBAC: Authorizing `identity:get_user(user_id=ca5fd5885cb74767a606e64c03ea9b8d)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:49.261100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114741be-fe4a-45c5-bf0c-a18352a61c31 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:49.263234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 110/224] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:49 2022] GET /identity/v3/users/ca5fd5885cb74767a606e64c03ea9b8d => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:49.264701 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85242e8a-5ba4-4b9a-811c-46f142c0716f None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:49.265153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85242e8a-5ba4-4b9a-811c-46f142c0716f None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:49.265626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85242e8a-5ba4-4b9a-811c-46f142c0716f None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:49.267091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 111/225] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:49.272459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceccb25-9fce-4f8b-a11b-1c168c3f8147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:49.273046 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85242e8a-5ba4-4b9a-811c-46f142c0716f None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:49.273512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceccb25-9fce-4f8b-a11b-1c168c3f8147 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:49.273945 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceccb25-9fce-4f8b-a11b-1c168c3f8147 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:49.274405 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceccb25-9fce-4f8b-a11b-1c168c3f8147 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:49.275435 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceccb25-9fce-4f8b-a11b-1c168c3f8147 None admin] RBAC: Adding query filter params (role.id=43f173da338d498382fba44911238254, scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0, user.id=5e50958576834e33a329ea9e21a348dc) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:49.275945 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceccb25-9fce-4f8b-a11b-1c168c3f8147 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:49.277881 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceccb25-9fce-4f8b-a11b-1c168c3f8147 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:49.285416 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 115/226] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:41:49 2022] GET /identity/v3/role_assignments?user.id=5e50958576834e33a329ea9e21a348dc&scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0&role.id=43f173da338d498382fba44911238254 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:49.289917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643aa415-3f32-44cf-aa3b-6ac203c4e691 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:49.289917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643aa415-3f32-44cf-aa3b-6ac203c4e691 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:49.289917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643aa415-3f32-44cf-aa3b-6ac203c4e691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:49.306190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-643aa415-3f32-44cf-aa3b-6ac203c4e691 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:49.307808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-643aa415-3f32-44cf-aa3b-6ac203c4e691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:49.420268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 116/227] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:49.446225 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643aa415-3f32-44cf-aa3b-6ac203c4e691 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:49.496280 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85242e8a-5ba4-4b9a-811c-46f142c0716f None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:49.546013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5afb0b-1420-45a5-ace2-57acd5ff9783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:49.547002 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5afb0b-1420-45a5-ace2-57acd5ff9783 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:49.547661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5afb0b-1420-45a5-ace2-57acd5ff9783 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:49.548136 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5afb0b-1420-45a5-ace2-57acd5ff9783 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:49.550768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5afb0b-1420-45a5-ace2-57acd5ff9783 None admin] RBAC: Authorizing `identity:get_project(project_id=fad2eddcd9204e1e82453c2e4c58edd0)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:49.552716 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5afb0b-1420-45a5-ace2-57acd5ff9783 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:49.554820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 112/228] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:49 2022] GET /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:49.561513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5afb0b-1420-45a5-ace2-57acd5ff9783 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:49.590790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:49.627003 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643aa415-3f32-44cf-aa3b-6ac203c4e691 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:49.657811 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:49.694885 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e81b7-cdfa-47cb-bb90-95a5e0f68700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:49.695580 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e81b7-cdfa-47cb-bb90-95a5e0f68700 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:49.695869 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e81b7-cdfa-47cb-bb90-95a5e0f68700 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:49.696146 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e81b7-cdfa-47cb-bb90-95a5e0f68700 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:49.717690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e81b7-cdfa-47cb-bb90-95a5e0f68700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:49.723533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-960e81b7-cdfa-47cb-bb90-95a5e0f68700 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:41:49.723533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:49.723533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:49.723533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:49.723533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:49.723533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:49.723533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:49.723533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:49.723533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:49.723533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:49.723533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:49.723533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:49.723533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:49.723533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:49.723533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:49.723533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:49.724475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:49.724475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:49.724475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:49.724475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:49.724475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:49.724475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:49.724475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:49.724475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:49.724475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:49.724475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:49.724475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:49.724475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:49.724475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:49.724475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:49.724475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:49.724475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:49.725251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:49.725251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:49.725251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:49.725251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:49.725251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:49.725251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:49.725251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:49.725251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:49.725251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:49.725251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:49.725251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:41:49.725251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:41:49.725251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 117/229] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:41:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:41:49.732757 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e81b7-cdfa-47cb-bb90-95a5e0f68700 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:49.738867 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5afb0b-1420-45a5-ace2-57acd5ff9783 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:49.808085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2061d-cfbf-41e0-9d20-475c5b412616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:49.808804 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2061d-cfbf-41e0-9d20-475c5b412616 None admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:49.809074 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2061d-cfbf-41e0-9d20-475c5b412616 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:49.809355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2061d-cfbf-41e0-9d20-475c5b412616 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0/users/ca5fd5885cb74767a606e64c03ea9b8d/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:49.820122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2061d-cfbf-41e0-9d20-475c5b412616 None admin] RBAC: Authorizing `identity:create_grant(project_id=fad2eddcd9204e1e82453c2e4c58edd0, user_id=ca5fd5885cb74767a606e64c03ea9b8d, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:49.821612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2061d-cfbf-41e0-9d20-475c5b412616 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:49.869164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e81b7-cdfa-47cb-bb90-95a5e0f68700 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:49.906246 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b119de-22c2-4795-8e27-b3fc0d94e65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:49.906882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b119de-22c2-4795-8e27-b3fc0d94e65e None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:49.907165 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b119de-22c2-4795-8e27-b3fc0d94e65e None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:49.907568 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b119de-22c2-4795-8e27-b3fc0d94e65e None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:49.908746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b119de-22c2-4795-8e27-b3fc0d94e65e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:49.909172 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b119de-22c2-4795-8e27-b3fc0d94e65e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:49.910587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b119de-22c2-4795-8e27-b3fc0d94e65e None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:49.920725 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 118/230] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:41:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:49.927854 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b119de-22c2-4795-8e27-b3fc0d94e65e None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:49.932704 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 113/231] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:41:49 2022] PUT /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0/users/ca5fd5885cb74767a606e64c03ea9b8d/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:41:49.933023 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:50.071969 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b119de-22c2-4795-8e27-b3fc0d94e65e None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:50.120749 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbc27d-305a-481c-8029-601649c268f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:50.121435 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbc27d-305a-481c-8029-601649c268f2 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:50.121723 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbc27d-305a-481c-8029-601649c268f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:50.122005 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbc27d-305a-481c-8029-601649c268f2 None admin] PATH_INFO: `/v3/users/ca5fd5885cb74767a606e64c03ea9b8d` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:50.128345 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbc27d-305a-481c-8029-601649c268f2 None admin] RBAC: Authorizing `identity:get_user(user_id=ca5fd5885cb74767a606e64c03ea9b8d)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:50.129868 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbc27d-305a-481c-8029-601649c268f2 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:50.132049 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 119/232] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:49 2022] GET /identity/v3/users/ca5fd5885cb74767a606e64c03ea9b8d => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:50.137800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2061d-cfbf-41e0-9d20-475c5b412616 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:50.313745 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2061d-cfbf-41e0-9d20-475c5b412616 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:50.347407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:50.352298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e9840-d096-4615-8c6b-8451f8ad2ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:50.353399 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e9840-d096-4615-8c6b-8451f8ad2ba2 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:50.353873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e9840-d096-4615-8c6b-8451f8ad2ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:50.354413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e9840-d096-4615-8c6b-8451f8ad2ba2 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:50.364405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e9840-d096-4615-8c6b-8451f8ad2ba2 None admin] RBAC: Authorizing `identity:get_project(project_id=fad2eddcd9204e1e82453c2e4c58edd0)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:50.364405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e9840-d096-4615-8c6b-8451f8ad2ba2 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:50.364405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 114/233] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:50 2022] GET /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:50.365345 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbc27d-305a-481c-8029-601649c268f2 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:50.449946 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:50.482564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbc27d-305a-481c-8029-601649c268f2 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:50.525272 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cf800-2952-4b57-8065-d1065b877ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:50.526331 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cf800-2952-4b57-8065-d1065b877ef3 None admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:50.526815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cf800-2952-4b57-8065-d1065b877ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:50.527288 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cf800-2952-4b57-8065-d1065b877ef3 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0/users/ca5fd5885cb74767a606e64c03ea9b8d/roles/81c955f5702546679605b5484602ae69` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:50.533716 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cf800-2952-4b57-8065-d1065b877ef3 None admin] RBAC: Authorizing `identity:create_grant(project_id=fad2eddcd9204e1e82453c2e4c58edd0, user_id=ca5fd5885cb74767a606e64c03ea9b8d, role_id=81c955f5702546679605b5484602ae69)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:50.535589 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cf800-2952-4b57-8065-d1065b877ef3 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:50.637810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 120/234] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:41:50 2022] PUT /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0/users/ca5fd5885cb74767a606e64c03ea9b8d/roles/81c955f5702546679605b5484602ae69 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:41:51.178671 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a23797-e0ac-4c24-a2d7-2c3a7a191c28 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:51.179768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a23797-e0ac-4c24-a2d7-2c3a7a191c28 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:51.180256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a23797-e0ac-4c24-a2d7-2c3a7a191c28 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:51.181884 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 115/235] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:51.187516 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d5bb9-3c6d-4be2-b645-c7537b7b4d7f None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:51.188385 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d5bb9-3c6d-4be2-b645-c7537b7b4d7f None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:51.188860 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d5bb9-3c6d-4be2-b645-c7537b7b4d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:51.212416 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-c61d5bb9-3c6d-4be2-b645-c7537b7b4d7f None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:51.214020 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c61d5bb9-3c6d-4be2-b645-c7537b7b4d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:51.250956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c533a1c-5a21-4e66-977c-fb03b596a350 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:51.250956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c533a1c-5a21-4e66-977c-fb03b596a350 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:51.250956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c533a1c-5a21-4e66-977c-fb03b596a350 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:51.250956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 116/236] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:51.257262 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3507c4-65ba-49aa-82a1-3cbdb4c334a0 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:51.257542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3507c4-65ba-49aa-82a1-3cbdb4c334a0 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:51.257822 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3507c4-65ba-49aa-82a1-3cbdb4c334a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:51.296404 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-cd3507c4-65ba-49aa-82a1-3cbdb4c334a0 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:51.297647 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-cd3507c4-65ba-49aa-82a1-3cbdb4c334a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:51.310228 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 121/237] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:51.348261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d5bb9-3c6d-4be2-b645-c7537b7b4d7f None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:51.435753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:51.444754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 117/238] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:51.484094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3507c4-65ba-49aa-82a1-3cbdb4c334a0 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:51.486660 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d5bb9-3c6d-4be2-b645-c7537b7b4d7f None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:51.528119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3467d4-bc20-40df-a7bf-e9d42c2dd880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:51.529107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3467d4-bc20-40df-a7bf-e9d42c2dd880 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:51.529614 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3467d4-bc20-40df-a7bf-e9d42c2dd880 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:51.530091 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3467d4-bc20-40df-a7bf-e9d42c2dd880 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:51.531719 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3467d4-bc20-40df-a7bf-e9d42c2dd880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:51.534427 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3467d4-bc20-40df-a7bf-e9d42c2dd880 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:51.537038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 122/239] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:41:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:51.542885 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3467d4-bc20-40df-a7bf-e9d42c2dd880 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:51.714694 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3507c4-65ba-49aa-82a1-3cbdb4c334a0 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:51.745561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:51.768410 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc98b03-b3ed-44cf-b592-029466807fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:51.769427 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc98b03-b3ed-44cf-b592-029466807fb2 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:51.769902 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc98b03-b3ed-44cf-b592-029466807fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:51.770397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc98b03-b3ed-44cf-b592-029466807fb2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:51.785606 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc98b03-b3ed-44cf-b592-029466807fb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:51.791184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-5fc98b03-b3ed-44cf-b592-029466807fb2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 03:41:51.791184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:51.791184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:51.791184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:51.791184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:51.791184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:51.791184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:51.791184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:51.791184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:51.791184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:51.791184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:51.791184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:51.791184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:51.791184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:51.791184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:51.791184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:51.792383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:51.792383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:51.792383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:51.792383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:51.792383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:51.792383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:51.792383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:51.792383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:51.792383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:51.792383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:51.792383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:51.792383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:51.792383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:51.792383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:51.792383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:51.792383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:51.793140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:51.793140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:51.793140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:51.793140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:51.793140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:51.793140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:51.793140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:51.793140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:51.793140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:51.793140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:51.793140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 03:41:51.793140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:41:51.795297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 118/240] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:41:51.799653 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbb10e-42fb-49d5-83c0-c8d41cf8f28b None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:51.799653 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbb10e-42fb-49d5-83c0-c8d41cf8f28b None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:51.799653 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbb10e-42fb-49d5-83c0-c8d41cf8f28b None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:51.799653 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 119/241] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:51.803504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbb10e-42fb-49d5-83c0-c8d41cf8f28b None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:51.813521 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3467d4-bc20-40df-a7bf-e9d42c2dd880 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:51.843467 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:51.857936 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dc961-5170-49c1-a691-2b21bb80e015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:51.858591 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dc961-5170-49c1-a691-2b21bb80e015 None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:51.858854 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dc961-5170-49c1-a691-2b21bb80e015 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:51.859124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dc961-5170-49c1-a691-2b21bb80e015 None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:51.859843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512dc961-5170-49c1-a691-2b21bb80e015 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:51.861339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512dc961-5170-49c1-a691-2b21bb80e015 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:51.933231 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbb10e-42fb-49d5-83c0-c8d41cf8f28b None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:51.945838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 123/242] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 28 03:41:51 2022] POST /identity/v3/users => generated 293 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:41:51.946870 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3170b3-de9b-427d-a9bd-487995be56e6 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:51.947178 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3170b3-de9b-427d-a9bd-487995be56e6 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:51.955653 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3170b3-de9b-427d-a9bd-487995be56e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:51.990246 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f674e-c476-4942-a3e7-5ddf9d1c19e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:51.991254 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f674e-c476-4942-a3e7-5ddf9d1c19e4 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:51.991782 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f674e-c476-4942-a3e7-5ddf9d1c19e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:51.992256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f674e-c476-4942-a3e7-5ddf9d1c19e4 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:51.993690 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f674e-c476-4942-a3e7-5ddf9d1c19e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:51.994243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f674e-c476-4942-a3e7-5ddf9d1c19e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:51.996497 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f674e-c476-4942-a3e7-5ddf9d1c19e4 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:52.000470 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-3f3170b3-de9b-427d-a9bd-487995be56e6 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:52.002279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-3f3170b3-de9b-427d-a9bd-487995be56e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:52.014858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 120/243] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:41:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:52.016607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f674e-c476-4942-a3e7-5ddf9d1c19e4 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:52.071235 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:52.153502 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f674e-c476-4942-a3e7-5ddf9d1c19e4 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:52.199359 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b958d-ad37-4f6f-b438-b202198010db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:52.200945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b958d-ad37-4f6f-b438-b202198010db None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:52.201409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b958d-ad37-4f6f-b438-b202198010db None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:52.201808 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b958d-ad37-4f6f-b438-b202198010db None admin] PATH_INFO: `/v3/users/c17ce08baf5d4f4c9d161807c261d9bb` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:52.206161 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 124/244] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:52.219197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b958d-ad37-4f6f-b438-b202198010db None admin] RBAC: Authorizing `identity:get_user(user_id=c17ce08baf5d4f4c9d161807c261d9bb)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:52.221469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b958d-ad37-4f6f-b438-b202198010db None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:52.223484 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 121/245] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:52 2022] GET /identity/v3/users/c17ce08baf5d4f4c9d161807c261d9bb => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:52.229569 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3170b3-de9b-427d-a9bd-487995be56e6 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:52.230701 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b958d-ad37-4f6f-b438-b202198010db None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:52.341182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3170b3-de9b-427d-a9bd-487995be56e6 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:52.359160 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:52.360621 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:52.367215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b958d-ad37-4f6f-b438-b202198010db None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:52.384392 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008cdeb-a6c6-47dd-8bd0-a5db29ee0526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:52.385324 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008cdeb-a6c6-47dd-8bd0-a5db29ee0526 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:52.385841 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008cdeb-a6c6-47dd-8bd0-a5db29ee0526 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:52.386317 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008cdeb-a6c6-47dd-8bd0-a5db29ee0526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:52.414916 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5643b7c-d424-4588-844d-4941724de780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:52.415943 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5643b7c-d424-4588-844d-4941724de780 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:52.416224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5643b7c-d424-4588-844d-4941724de780 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:52.416921 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5643b7c-d424-4588-844d-4941724de780 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:52.433902 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5643b7c-d424-4588-844d-4941724de780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:52.439940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-b5643b7c-d424-4588-844d-4941724de780 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:52.439940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:52.439940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:52.439940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:52.439940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:52.439940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:52.439940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:52.439940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:52.439940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:52.439940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:52.439940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:52.439940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:52.439940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:52.439940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:52.439940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:52.439940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:52.440942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:52.440942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:52.440942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:52.440942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:52.440942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:52.440942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:52.440942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:52.440942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:52.440942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:52.440942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:52.440942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:52.440942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:52.440942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:52.440942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:52.440942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:52.440942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:52.441790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:52.441790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:52.441790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:52.441790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:52.441790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:52.441790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:52.441790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:52.441790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:52.441790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:52.441790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:52.441790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:52.441790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:41:52.444164 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 122/246] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:52.450173 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5643b7c-d424-4588-844d-4941724de780 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:52.485119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008cdeb-a6c6-47dd-8bd0-a5db29ee0526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:52.486009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008cdeb-a6c6-47dd-8bd0-a5db29ee0526 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:52.598505 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5643b7c-d424-4588-844d-4941724de780 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:52.623586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 125/247] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:41:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:52.629981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008cdeb-a6c6-47dd-8bd0-a5db29ee0526 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:52.646852 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a2170-3cc1-48a8-acf7-ed0ea28c01f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:52.648063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a2170-3cc1-48a8-acf7-ed0ea28c01f5 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:52.648350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a2170-3cc1-48a8-acf7-ed0ea28c01f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:52.648625 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a2170-3cc1-48a8-acf7-ed0ea28c01f5 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:52.649763 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a2170-3cc1-48a8-acf7-ed0ea28c01f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:52.649763 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a2170-3cc1-48a8-acf7-ed0ea28c01f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:52.651042 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a2170-3cc1-48a8-acf7-ed0ea28c01f5 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:52.652687 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:52.661396 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 123/248] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:41:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:52.675010 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a2170-3cc1-48a8-acf7-ed0ea28c01f5 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:52.692114 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:52.755915 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008cdeb-a6c6-47dd-8bd0-a5db29ee0526 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:52.800928 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a2170-3cc1-48a8-acf7-ed0ea28c01f5 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:52.816263 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8fb17-9585-4fad-bd9d-06eb7b6a6e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:52.818429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8fb17-9585-4fad-bd9d-06eb7b6a6e0b None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:52.818711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8fb17-9585-4fad-bd9d-06eb7b6a6e0b None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:52.818986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8fb17-9585-4fad-bd9d-06eb7b6a6e0b None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:52.821030 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8fb17-9585-4fad-bd9d-06eb7b6a6e0b None admin] RBAC: Authorizing `identity:get_project(project_id=fad2eddcd9204e1e82453c2e4c58edd0)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:52.822484 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8fb17-9585-4fad-bd9d-06eb7b6a6e0b None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:52.825274 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 126/249] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:52 2022] GET /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:52.827890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830d74f-04fb-45bb-8b45-325fddec8eca None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:52.828170 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830d74f-04fb-45bb-8b45-325fddec8eca None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:52.828444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830d74f-04fb-45bb-8b45-325fddec8eca None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:52.839308 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 127/250] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:52.841505 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830d74f-04fb-45bb-8b45-325fddec8eca None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:52.864863 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bc4e9-f753-4a2c-b996-772dff33cd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:52.865448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bc4e9-f753-4a2c-b996-772dff33cd58 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:52.865727 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bc4e9-f753-4a2c-b996-772dff33cd58 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:52.865999 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bc4e9-f753-4a2c-b996-772dff33cd58 None admin] PATH_INFO: `/v3/users/5e50958576834e33a329ea9e21a348dc` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:52.869069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4bc4e9-f753-4a2c-b996-772dff33cd58 None admin] RBAC: Authorizing `identity:get_user(user_id=5e50958576834e33a329ea9e21a348dc)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:52.870508 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4bc4e9-f753-4a2c-b996-772dff33cd58 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:52.879391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 124/251] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:52 2022] GET /identity/v3/users/5e50958576834e33a329ea9e21a348dc => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:52.880862 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a420727-04e0-425b-841c-e7829336125d None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:52.881144 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a420727-04e0-425b-841c-e7829336125d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:52.881416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a420727-04e0-425b-841c-e7829336125d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:52.918476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-4a420727-04e0-425b-841c-e7829336125d None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:52.919782 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-4a420727-04e0-425b-841c-e7829336125d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:52.996267 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:53.016602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830d74f-04fb-45bb-8b45-325fddec8eca None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:53.054084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4e406-408e-46a6-8423-dc7eb993642c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:53.054705 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4e406-408e-46a6-8423-dc7eb993642c None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:53.054986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4e406-408e-46a6-8423-dc7eb993642c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:53.055313 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4e406-408e-46a6-8423-dc7eb993642c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:53.056130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4e406-408e-46a6-8423-dc7eb993642c None admin] RBAC: Adding query filter params (role.id=e2859598b69d4763beae00133c2d5a83, scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0, user.id=c17ce08baf5d4f4c9d161807c261d9bb) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:53.056489 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4e406-408e-46a6-8423-dc7eb993642c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:53.057940 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4e406-408e-46a6-8423-dc7eb993642c None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:53.064826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 128/252] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:41:52 2022] GET /identity/v3/role_assignments?user.id=c17ce08baf5d4f4c9d161807c261d9bb&scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0&role.id=e2859598b69d4763beae00133c2d5a83 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:53.065587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4e406-408e-46a6-8423-dc7eb993642c None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:53.077055 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 125/253] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:53.128703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a420727-04e0-425b-841c-e7829336125d None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:53.167649 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:53.197593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4e406-408e-46a6-8423-dc7eb993642c None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:53.268768 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adbdbd-3472-48cb-b59d-c32b200f54f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:53.269625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adbdbd-3472-48cb-b59d-c32b200f54f7 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:53.270025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adbdbd-3472-48cb-b59d-c32b200f54f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:53.270401 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adbdbd-3472-48cb-b59d-c32b200f54f7 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:53.276324 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adbdbd-3472-48cb-b59d-c32b200f54f7 None admin] RBAC: Authorizing `identity:get_project(project_id=fad2eddcd9204e1e82453c2e4c58edd0)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:53.278093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adbdbd-3472-48cb-b59d-c32b200f54f7 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:53.280241 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 129/254] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:53 2022] GET /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:53.281790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f105b-0884-47ce-86e4-921c512e8e5c None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:53.282110 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f105b-0884-47ce-86e4-921c512e8e5c None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:53.282457 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f105b-0884-47ce-86e4-921c512e8e5c None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:53.284585 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 130/255] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:53.292610 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f105b-0884-47ce-86e4-921c512e8e5c None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:53.296125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a420727-04e0-425b-841c-e7829336125d None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:53.319531 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:53.360556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15419b6d-02ba-43bc-a7e6-7bea879afea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:53.361628 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15419b6d-02ba-43bc-a7e6-7bea879afea9 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:53.362091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15419b6d-02ba-43bc-a7e6-7bea879afea9 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:53.362562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15419b6d-02ba-43bc-a7e6-7bea879afea9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:53.387908 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15419b6d-02ba-43bc-a7e6-7bea879afea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:53.400321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-15419b6d-02ba-43bc-a7e6-7bea879afea9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:41:53.400321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:53.400321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:53.400321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:53.400321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:53.400321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:53.400321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:53.400321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:53.400321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:53.400321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:53.400321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:53.400321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:53.400321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:53.400321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:53.400321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:53.400321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:53.401285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:53.401285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:53.401285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:53.401285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:53.401285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:53.401285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:53.401285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:53.401285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:53.401285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:53.401285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:53.401285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:53.401285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:53.401285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:53.401285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:53.401285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:53.401285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:53.402082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:53.402082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:53.402082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:53.402082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:53.402082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:53.402082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:53.402082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:53.402082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:53.402082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:53.402082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:53.402082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:41:53.402082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:41:53.406795 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 126/256] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:41:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:53.409908 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b5134-3f44-47fb-b457-5716dd208baf None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:53.413532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b5134-3f44-47fb-b457-5716dd208baf None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:53.414368 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b5134-3f44-47fb-b457-5716dd208baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:53.459591 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-dc6b5134-3f44-47fb-b457-5716dd208baf None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:53.460809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-dc6b5134-3f44-47fb-b457-5716dd208baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:53.468780 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f105b-0884-47ce-86e4-921c512e8e5c None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:53.506480 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883f5c5-5482-4cf8-aaf1-7ce33cd2e302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:53.507430 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883f5c5-5482-4cf8-aaf1-7ce33cd2e302 None admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:53.507860 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883f5c5-5482-4cf8-aaf1-7ce33cd2e302 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:53.508282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883f5c5-5482-4cf8-aaf1-7ce33cd2e302 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0/users/5e50958576834e33a329ea9e21a348dc/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:53.510499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883f5c5-5482-4cf8-aaf1-7ce33cd2e302 None admin] RBAC: Authorizing `identity:create_grant(project_id=fad2eddcd9204e1e82453c2e4c58edd0, user_id=5e50958576834e33a329ea9e21a348dc, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:53.512168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883f5c5-5482-4cf8-aaf1-7ce33cd2e302 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:53.582532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 127/257] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:53.583465 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b5134-3f44-47fb-b457-5716dd208baf None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:53.593691 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 131/258] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:41:53 2022] PUT /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0/users/5e50958576834e33a329ea9e21a348dc/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:41:53.593895 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:53.624400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883f5c5-5482-4cf8-aaf1-7ce33cd2e302 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:53.732382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b5134-3f44-47fb-b457-5716dd208baf None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:53.770444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:53.792633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5430e20-a2f0-42d4-a516-e399075678da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:53.793321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5430e20-a2f0-42d4-a516-e399075678da None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:53.793608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5430e20-a2f0-42d4-a516-e399075678da None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:53.794007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5430e20-a2f0-42d4-a516-e399075678da None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:53.795093 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5430e20-a2f0-42d4-a516-e399075678da None admin] RBAC: Adding query filter params (name=admin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:53.795432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5430e20-a2f0-42d4-a516-e399075678da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:53.797000 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5430e20-a2f0-42d4-a516-e399075678da None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:53.816670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 128/259] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:53.822121 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5430e20-a2f0-42d4-a516-e399075678da None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:53.824730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883f5c5-5482-4cf8-aaf1-7ce33cd2e302 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:53.897876 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d34ce-2220-4b29-bf0c-ddf7be35d406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:53.898565 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d34ce-2220-4b29-bf0c-ddf7be35d406 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:53.898851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d34ce-2220-4b29-bf0c-ddf7be35d406 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:53.899130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d34ce-2220-4b29-bf0c-ddf7be35d406 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:53.925119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d34ce-2220-4b29-bf0c-ddf7be35d406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:53.936202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-ab3d34ce-2220-4b29-bf0c-ddf7be35d406 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:41:53.936202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:53.936202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:53.936202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:53.936202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:53.936202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:53.936202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:53.936202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:53.936202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:53.936202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:53.936202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:53.936202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:53.936202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:53.936202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:53.936202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:53.936202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:53.937101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:53.937101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:53.937101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:53.937101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:53.937101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:53.937101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:53.937101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:53.937101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:53.937101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:53.937101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:53.937101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:53.937101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:53.937101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:53.937101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:53.937101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:53.937101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:53.937863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:53.937863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:53.937863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:53.937863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:53.937863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:53.937863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:53.937863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:53.937863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:53.937863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:53.937863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:53.937863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:41:53.937863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:41:53.938445 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 132/260] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:41:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:53.944218 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:53.945024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d34ce-2220-4b29-bf0c-ddf7be35d406 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:53.981940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5430e20-a2f0-42d4-a516-e399075678da None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:54.018310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc019c-3a70-4d22-a0c9-eeea93444cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:54.018957 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc019c-3a70-4d22-a0c9-eeea93444cb9 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:54.019234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc019c-3a70-4d22-a0c9-eeea93444cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:54.019970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc019c-3a70-4d22-a0c9-eeea93444cb9 None admin] PATH_INFO: `/v3/users/ca5fd5885cb74767a606e64c03ea9b8d` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:54.021840 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc019c-3a70-4d22-a0c9-eeea93444cb9 None admin] RBAC: Authorizing `identity:get_user(user_id=ca5fd5885cb74767a606e64c03ea9b8d)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:54.023678 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc019c-3a70-4d22-a0c9-eeea93444cb9 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:54.025818 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 129/261] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:53 2022] GET /identity/v3/users/ca5fd5885cb74767a606e64c03ea9b8d => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:54.033295 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc019c-3a70-4d22-a0c9-eeea93444cb9 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:54.144320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc019c-3a70-4d22-a0c9-eeea93444cb9 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:54.163125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d34ce-2220-4b29-bf0c-ddf7be35d406 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:54.181060 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412bd2b-8482-4713-9c80-088c6642f74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:54.181824 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412bd2b-8482-4713-9c80-088c6642f74a None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:54.182175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412bd2b-8482-4713-9c80-088c6642f74a None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:54.182781 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412bd2b-8482-4713-9c80-088c6642f74a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:54.203707 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:54.220540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ea39c-0221-4187-afd3-81dfbb593629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:54.221224 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ea39c-0221-4187-afd3-81dfbb593629 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:54.221533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ea39c-0221-4187-afd3-81dfbb593629 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:54.221809 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ea39c-0221-4187-afd3-81dfbb593629 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:54.222545 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ea39c-0221-4187-afd3-81dfbb593629 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:54.222853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ea39c-0221-4187-afd3-81dfbb593629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:54.225518 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ea39c-0221-4187-afd3-81dfbb593629 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:54.230253 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:54.247635 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 133/262] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:41:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:54.253430 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ea39c-0221-4187-afd3-81dfbb593629 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:54.300406 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412bd2b-8482-4713-9c80-088c6642f74a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:54.302623 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412bd2b-8482-4713-9c80-088c6642f74a None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:54.447045 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ea39c-0221-4187-afd3-81dfbb593629 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:54.476887 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 130/263] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:41:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:54.485692 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412bd2b-8482-4713-9c80-088c6642f74a None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:54.515307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fc513-6949-419b-a226-86a6e312c615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:54.515986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc513-6949-419b-a226-86a6e312c615 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:54.516272 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc513-6949-419b-a226-86a6e312c615 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:54.516548 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc513-6949-419b-a226-86a6e312c615 None admin] PATH_INFO: `/v3/users/ca5fd5885cb74767a606e64c03ea9b8d` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:54.519852 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fc513-6949-419b-a226-86a6e312c615 None admin] RBAC: Authorizing `identity:get_user(user_id=ca5fd5885cb74767a606e64c03ea9b8d)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:54.521328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fc513-6949-419b-a226-86a6e312c615 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:54.522980 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 134/264] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:54 2022] GET /identity/v3/users/ca5fd5885cb74767a606e64c03ea9b8d => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:54.536803 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fc513-6949-419b-a226-86a6e312c615 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:54.558972 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:54.687690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:54.709500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412bd2b-8482-4713-9c80-088c6642f74a None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:54.778247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fc513-6949-419b-a226-86a6e312c615 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:54.780115 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32eb9a5-d728-46fa-936e-e921bea0c5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:54.781483 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eb9a5-d728-46fa-936e-e921bea0c5a5 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:54.781968 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eb9a5-d728-46fa-936e-e921bea0c5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:54.782442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eb9a5-d728-46fa-936e-e921bea0c5a5 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:54.784468 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32eb9a5-d728-46fa-936e-e921bea0c5a5 None admin] RBAC: Authorizing `identity:get_project(project_id=fad2eddcd9204e1e82453c2e4c58edd0)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:54.786180 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32eb9a5-d728-46fa-936e-e921bea0c5a5 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:54.788217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 131/265] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:54 2022] GET /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0 => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:54.795924 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32eb9a5-d728-46fa-936e-e921bea0c5a5 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:54.833891 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35283366-1c96-4708-ac34-ca7df7c13746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:54.834627 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35283366-1c96-4708-ac34-ca7df7c13746 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:54.834924 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35283366-1c96-4708-ac34-ca7df7c13746 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:54.835347 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35283366-1c96-4708-ac34-ca7df7c13746 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:54.951545 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35283366-1c96-4708-ac34-ca7df7c13746 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:54.953044 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35283366-1c96-4708-ac34-ca7df7c13746 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:55.027222 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:55.055932 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32eb9a5-d728-46fa-936e-e921bea0c5a5 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:55.061435 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:55.071624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 135/266] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:41:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 03:41:55.077545 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35283366-1c96-4708-ac34-ca7df7c13746 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:55.102529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b2c27-bd20-481e-99cb-ba3af8e6e470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:55.103205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b2c27-bd20-481e-99cb-ba3af8e6e470 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:55.103589 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b2c27-bd20-481e-99cb-ba3af8e6e470 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:55.103935 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b2c27-bd20-481e-99cb-ba3af8e6e470 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:55.104828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b2c27-bd20-481e-99cb-ba3af8e6e470 None admin] RBAC: Adding query filter params (role.id=8a5766c4aef44773834941d1bdbd1e98, scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0, user.id=ca5fd5885cb74767a606e64c03ea9b8d) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:55.105217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b2c27-bd20-481e-99cb-ba3af8e6e470 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:55.107106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b2c27-bd20-481e-99cb-ba3af8e6e470 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:55.114658 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 132/267] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:41:54 2022] GET /identity/v3/role_assignments?user.id=ca5fd5885cb74767a606e64c03ea9b8d&scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0&role.id=8a5766c4aef44773834941d1bdbd1e98 => generated 608 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:55.205097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86cb6b-b3ea-42f3-a6c4-a9668135de76 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:55.205393 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86cb6b-b3ea-42f3-a6c4-a9668135de76 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:55.205833 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86cb6b-b3ea-42f3-a6c4-a9668135de76 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:55.209110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 133/268] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:41:55.213564 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d288f-04fb-4a4e-b3f1-a4e6bbcd7683 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:55.213921 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d288f-04fb-4a4e-b3f1-a4e6bbcd7683 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:55.214270 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d288f-04fb-4a4e-b3f1-a4e6bbcd7683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:55.237753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35283366-1c96-4708-ac34-ca7df7c13746 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:55.248594 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-559d288f-04fb-4a4e-b3f1-a4e6bbcd7683 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:55.249920 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-559d288f-04fb-4a4e-b3f1-a4e6bbcd7683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:55.320127 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aa986-5d96-4d36-8f4c-da16ece151fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:55.321108 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aa986-5d96-4d36-8f4c-da16ece151fc None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:55.321602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aa986-5d96-4d36-8f4c-da16ece151fc None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:55.322055 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aa986-5d96-4d36-8f4c-da16ece151fc None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:55.323502 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7aa986-5d96-4d36-8f4c-da16ece151fc None admin] RBAC: Authorizing `identity:get_project(project_id=fad2eddcd9204e1e82453c2e4c58edd0)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:55.325151 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7aa986-5d96-4d36-8f4c-da16ece151fc None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:55.327031 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 136/269] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:55 2022] GET /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:55.333257 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aa986-5d96-4d36-8f4c-da16ece151fc None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:55.390100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 134/270] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:41:55.410716 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:55.421433 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d288f-04fb-4a4e-b3f1-a4e6bbcd7683 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:55.557396 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aa986-5d96-4d36-8f4c-da16ece151fc None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:55.568918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:55.572536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d288f-04fb-4a4e-b3f1-a4e6bbcd7683 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:55.597412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81273301-2bfa-49f4-aa9c-74cd5ae290fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:55.598385 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81273301-2bfa-49f4-aa9c-74cd5ae290fa None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:55.598853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81273301-2bfa-49f4-aa9c-74cd5ae290fa None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:55.599305 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81273301-2bfa-49f4-aa9c-74cd5ae290fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:55.600359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81273301-2bfa-49f4-aa9c-74cd5ae290fa None admin] RBAC: Adding query filter params (role.id=81c955f5702546679605b5484602ae69, scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0, user.id=ca5fd5885cb74767a606e64c03ea9b8d) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:55.600926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81273301-2bfa-49f4-aa9c-74cd5ae290fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:55.602615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81273301-2bfa-49f4-aa9c-74cd5ae290fa None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:55.609201 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045073ec-28aa-4ef7-91ad-460f87a0ac83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:55.610254 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045073ec-28aa-4ef7-91ad-460f87a0ac83 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:55.611404 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045073ec-28aa-4ef7-91ad-460f87a0ac83 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:55.612154 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045073ec-28aa-4ef7-91ad-460f87a0ac83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:55.612874 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 137/271] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:41:55 2022] GET /identity/v3/role_assignments?user.id=ca5fd5885cb74767a606e64c03ea9b8d&scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0&role.id=81c955f5702546679605b5484602ae69 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:55.614404 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274f8b8-dbc7-4af8-8659-0c7d2150060a None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:55.615022 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274f8b8-dbc7-4af8-8659-0c7d2150060a None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:55.615525 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274f8b8-dbc7-4af8-8659-0c7d2150060a None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:55.622101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 138/272] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:55.624370 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fcb16-2b0a-4cad-83d0-2fa61ca89a76 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:55.625037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fcb16-2b0a-4cad-83d0-2fa61ca89a76 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:55.625523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fcb16-2b0a-4cad-83d0-2fa61ca89a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:55.631135 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045073ec-28aa-4ef7-91ad-460f87a0ac83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:55.637418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-045073ec-28aa-4ef7-91ad-460f87a0ac83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:55.637418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:55.637418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:55.637418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:55.637418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:55.637418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:55.637418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:55.637418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:55.637418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:55.637418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:55.637418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:55.637418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:55.637418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:55.637418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:55.637418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:55.637418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:55.638286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:55.638286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:55.638286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:55.638286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:55.638286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:55.638286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:55.638286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:55.638286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:55.638286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:55.638286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:55.638286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:55.638286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:55.638286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:55.638286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:55.638286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:55.638286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:55.639551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:55.639551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:55.639551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:55.639551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:55.639551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:55.639551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:55.639551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:55.639551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:55.639551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:55.639551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:55.639551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:55.639551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:41:55.639551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 135/273] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:55.646630 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045073ec-28aa-4ef7-91ad-460f87a0ac83 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:55.651007 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-b52fcb16-2b0a-4cad-83d0-2fa61ca89a76 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:55.652628 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b52fcb16-2b0a-4cad-83d0-2fa61ca89a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:55.734219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 139/274] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:41:55.761962 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fcb16-2b0a-4cad-83d0-2fa61ca89a76 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:55.773772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045073ec-28aa-4ef7-91ad-460f87a0ac83 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:55.796269 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:55.827622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eae636-db3a-4ca1-9639-9fcf4094296b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:55.828272 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eae636-db3a-4ca1-9639-9fcf4094296b None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:55.828554 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eae636-db3a-4ca1-9639-9fcf4094296b None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:55.828829 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eae636-db3a-4ca1-9639-9fcf4094296b None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:55.830153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eae636-db3a-4ca1-9639-9fcf4094296b None admin] RBAC: Adding query filter params (name=member) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:55.830487 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eae636-db3a-4ca1-9639-9fcf4094296b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:55.831927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eae636-db3a-4ca1-9639-9fcf4094296b None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:55.847355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 136/275] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:41:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:55.852017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eae636-db3a-4ca1-9639-9fcf4094296b None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:55.887245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:55.904900 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fcb16-2b0a-4cad-83d0-2fa61ca89a76 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:55.944615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031278bb-b294-460e-a877-a07eeb370105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:55.945390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031278bb-b294-460e-a877-a07eeb370105 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:55.945821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031278bb-b294-460e-a877-a07eeb370105 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:55.946094 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031278bb-b294-460e-a877-a07eeb370105 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:55.947411 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031278bb-b294-460e-a877-a07eeb370105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:55.949027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031278bb-b294-460e-a877-a07eeb370105 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:55.950754 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 140/276] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:41:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:55.957047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031278bb-b294-460e-a877-a07eeb370105 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:55.998332 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eae636-db3a-4ca1-9639-9fcf4094296b None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:56.053812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c03df4-8a39-4f9b-a4ca-ea84510ed7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:56.055275 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c03df4-8a39-4f9b-a4ca-ea84510ed7df None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:56.055723 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c03df4-8a39-4f9b-a4ca-ea84510ed7df None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:56.056146 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c03df4-8a39-4f9b-a4ca-ea84510ed7df None admin] PATH_INFO: `/v3/users/267cfbfb95dc4d9cb0049ad3a7d35453` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:56.076395 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c03df4-8a39-4f9b-a4ca-ea84510ed7df None admin] RBAC: Authorizing `identity:get_user(user_id=267cfbfb95dc4d9cb0049ad3a7d35453)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:56.079114 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c03df4-8a39-4f9b-a4ca-ea84510ed7df None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:56.080490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:56.083472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 137/277] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:55 2022] GET /identity/v3/users/267cfbfb95dc4d9cb0049ad3a7d35453 => generated 293 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:56.090060 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c03df4-8a39-4f9b-a4ca-ea84510ed7df None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:56.092364 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031278bb-b294-460e-a877-a07eeb370105 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:56.134773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c16a51-3d19-4eb4-a877-0d1ed85b2050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:56.135613 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c16a51-3d19-4eb4-a877-0d1ed85b2050 None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:56.135999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c16a51-3d19-4eb4-a877-0d1ed85b2050 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:56.136438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c16a51-3d19-4eb4-a877-0d1ed85b2050 None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:56.137269 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c16a51-3d19-4eb4-a877-0d1ed85b2050 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:56.138923 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c16a51-3d19-4eb4-a877-0d1ed85b2050 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:56.199675 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:56.225862 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c03df4-8a39-4f9b-a4ca-ea84510ed7df None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:56.262120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5682dc-17a9-478a-8895-aaa1fb477064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:56.262434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 141/278] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 28 03:41:55 2022] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:41:56.263619 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5682dc-17a9-478a-8895-aaa1fb477064 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:56.263619 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5682dc-17a9-478a-8895-aaa1fb477064 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:56.263619 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5682dc-17a9-478a-8895-aaa1fb477064 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:56.264046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f23de9-f4ce-4231-ac4c-b48ef9eec393 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:56.264724 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f23de9-f4ce-4231-ac4c-b48ef9eec393 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:56.264847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5682dc-17a9-478a-8895-aaa1fb477064 None admin] RBAC: Adding query filter params (role.id=43f173da338d498382fba44911238254, user.id=267cfbfb95dc4d9cb0049ad3a7d35453, scope.system=all) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:56.264935 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f23de9-f4ce-4231-ac4c-b48ef9eec393 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:56.265033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5682dc-17a9-478a-8895-aaa1fb477064 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:56.266217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5682dc-17a9-478a-8895-aaa1fb477064 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:56.271271 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 142/279] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:56.272966 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f92f7d-09b6-4f51-a704-203b79ffe4d0 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:56.273354 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f92f7d-09b6-4f51-a704-203b79ffe4d0 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:56.273537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 138/280] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Jul 28 03:41:56 2022] GET /identity/v3/role_assignments?user.id=267cfbfb95dc4d9cb0049ad3a7d35453&scope.system=all&role.id=43f173da338d498382fba44911238254 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:56.273828 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f92f7d-09b6-4f51-a704-203b79ffe4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:56.302474 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-66f92f7d-09b6-4f51-a704-203b79ffe4d0 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:56.303898 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-66f92f7d-09b6-4f51-a704-203b79ffe4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:56.398785 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 143/281] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:56.421851 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5682dc-17a9-478a-8895-aaa1fb477064 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:56.430000 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7ffee-10db-4b17-8cfe-bcc3d4f042c8 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:56.430291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7ffee-10db-4b17-8cfe-bcc3d4f042c8 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:56.430572 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7ffee-10db-4b17-8cfe-bcc3d4f042c8 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:56.431997 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 144/282] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:56.439270 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed593f-e77f-4636-aaf6-c4c43eeaf32c None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:56.439614 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed593f-e77f-4636-aaf6-c4c43eeaf32c None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:56.439944 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed593f-e77f-4636-aaf6-c4c43eeaf32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:56.461637 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-7eed593f-e77f-4636-aaf6-c4c43eeaf32c None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:56.463097 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-7eed593f-e77f-4636-aaf6-c4c43eeaf32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:56.556235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 145/283] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:56.561430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5682dc-17a9-478a-8895-aaa1fb477064 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:56.584640 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed593f-e77f-4636-aaf6-c4c43eeaf32c None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:56.600497 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:56.613858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e023cd-5976-41e2-a18f-1e2f3778d2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:56.614517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e023cd-5976-41e2-a18f-1e2f3778d2fc None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:56.619791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e023cd-5976-41e2-a18f-1e2f3778d2fc None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:56.619791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e023cd-5976-41e2-a18f-1e2f3778d2fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:56.629341 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e023cd-5976-41e2-a18f-1e2f3778d2fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:56.634500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-d6e023cd-5976-41e2-a18f-1e2f3778d2fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 03:41:56.634500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:56.634500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:56.634500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:56.634500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:56.634500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:56.634500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:56.634500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:56.634500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:56.634500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:56.634500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:56.634500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:56.634500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:56.634500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:56.634500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:56.634500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:56.635440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:56.635440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:56.635440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:56.635440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:56.635440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:56.635440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:56.635440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:56.635440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:56.635440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:56.635440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:56.635440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:56.635440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:56.635440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:56.635440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:56.635440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:56.635440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:56.636247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:56.636247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:56.636247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:56.636247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:56.636247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:56.636247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:56.636247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:56.636247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:56.636247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:56.636247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:56.636247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 03:41:56.636247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:41:56.637345 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 139/284] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:56.642397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e023cd-5976-41e2-a18f-1e2f3778d2fc None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:56.648263 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:56.719312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed593f-e77f-4636-aaf6-c4c43eeaf32c None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:56.757123 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b492c-db6b-4b7a-86ba-374d25e7c6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:56.757889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b492c-db6b-4b7a-86ba-374d25e7c6d0 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:56.758187 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b492c-db6b-4b7a-86ba-374d25e7c6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:56.758481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b492c-db6b-4b7a-86ba-374d25e7c6d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:56.767709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e023cd-5976-41e2-a18f-1e2f3778d2fc None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:56.771017 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b492c-db6b-4b7a-86ba-374d25e7c6d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:56.776460 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-9c1b492c-db6b-4b7a-86ba-374d25e7c6d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:56.776460 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:56.776460 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:56.776460 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:56.776460 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:56.776460 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:56.776460 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:56.776460 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:56.776460 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:56.776460 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:56.776460 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:56.776460 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:56.776460 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:56.776460 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:56.776460 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:56.776460 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:56.777374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:56.777374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:56.777374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:56.777374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:56.777374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:56.777374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:56.777374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:56.777374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:56.777374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:56.777374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:56.777374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:56.777374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:56.777374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:56.777374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:56.777374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:56.777374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:56.778168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:56.778168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:56.778168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:56.778168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:56.778168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:56.778168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:56.778168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:56.778168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:56.778168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:56.778168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:56.778168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:56.778168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:41:56.781176 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 146/285] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:56.795365 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b492c-db6b-4b7a-86ba-374d25e7c6d0 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:56.863681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:56.872062 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cdaeb-092d-4cf8-814f-8db4779bd91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:56.872715 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cdaeb-092d-4cf8-814f-8db4779bd91f None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:56.873000 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cdaeb-092d-4cf8-814f-8db4779bd91f None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:56.873276 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cdaeb-092d-4cf8-814f-8db4779bd91f None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:56.874018 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cdaeb-092d-4cf8-814f-8db4779bd91f None admin] RBAC: Adding query filter params (name=reader) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:56.874325 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cdaeb-092d-4cf8-814f-8db4779bd91f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:56.875876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cdaeb-092d-4cf8-814f-8db4779bd91f None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:56.895775 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b492c-db6b-4b7a-86ba-374d25e7c6d0 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:56.896617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 140/286] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:41:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:56.902170 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cdaeb-092d-4cf8-814f-8db4779bd91f None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:56.933175 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf2ffa-734e-4919-a28a-76694db20832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:56.933858 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf2ffa-734e-4919-a28a-76694db20832 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:56.934143 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf2ffa-734e-4919-a28a-76694db20832 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:56.934420 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf2ffa-734e-4919-a28a-76694db20832 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:56.935200 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf2ffa-734e-4919-a28a-76694db20832 None admin] RBAC: Adding query filter params (name=member) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:56.935556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf2ffa-734e-4919-a28a-76694db20832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:56.936951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf2ffa-734e-4919-a28a-76694db20832 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:56.946238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 147/287] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:41:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:56.951771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf2ffa-734e-4919-a28a-76694db20832 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:57.040106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:57.110053 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf2ffa-734e-4919-a28a-76694db20832 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:57.133445 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cdaeb-092d-4cf8-814f-8db4779bd91f None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:57.147010 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd161bb4-e651-4d1c-98d1-9763fd9e6874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:57.147699 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd161bb4-e651-4d1c-98d1-9763fd9e6874 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:57.147985 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd161bb4-e651-4d1c-98d1-9763fd9e6874 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:57.148263 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd161bb4-e651-4d1c-98d1-9763fd9e6874 None admin] PATH_INFO: `/v3/users/5e50958576834e33a329ea9e21a348dc` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:57.149452 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd161bb4-e651-4d1c-98d1-9763fd9e6874 None admin] RBAC: Authorizing `identity:get_user(user_id=5e50958576834e33a329ea9e21a348dc)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:57.150994 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd161bb4-e651-4d1c-98d1-9763fd9e6874 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:57.155344 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 148/288] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:56 2022] GET /identity/v3/users/5e50958576834e33a329ea9e21a348dc => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:57.155344 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:57.158646 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd161bb4-e651-4d1c-98d1-9763fd9e6874 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:57.218229 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f9e59-676a-423b-aed2-0e8027845f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:57.219184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f9e59-676a-423b-aed2-0e8027845f30 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:57.219681 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f9e59-676a-423b-aed2-0e8027845f30 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:57.220153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f9e59-676a-423b-aed2-0e8027845f30 None admin] PATH_INFO: `/v3/users/c17ce08baf5d4f4c9d161807c261d9bb` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:57.225325 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f9e59-676a-423b-aed2-0e8027845f30 None admin] RBAC: Authorizing `identity:get_user(user_id=c17ce08baf5d4f4c9d161807c261d9bb)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:57.226953 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f9e59-676a-423b-aed2-0e8027845f30 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:57.229075 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 141/289] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:56 2022] GET /identity/v3/users/c17ce08baf5d4f4c9d161807c261d9bb => generated 297 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:57.234138 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f9e59-676a-423b-aed2-0e8027845f30 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:57.264543 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd161bb4-e651-4d1c-98d1-9763fd9e6874 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:57.299775 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f839f96-4315-4af6-9b2a-fcf2445e0570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:57.300548 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f839f96-4315-4af6-9b2a-fcf2445e0570 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:57.300843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f839f96-4315-4af6-9b2a-fcf2445e0570 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:57.301124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f839f96-4315-4af6-9b2a-fcf2445e0570 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:57.387815 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f9e59-676a-423b-aed2-0e8027845f30 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:57.403718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:57.407708 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f839f96-4315-4af6-9b2a-fcf2445e0570 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:57.409226 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f839f96-4315-4af6-9b2a-fcf2445e0570 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:57.424148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:57.433898 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c32f4-1770-45c3-afbe-c936ac5b5e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:57.434818 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c32f4-1770-45c3-afbe-c936ac5b5e5c None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:57.435267 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c32f4-1770-45c3-afbe-c936ac5b5e5c None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:57.435731 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c32f4-1770-45c3-afbe-c936ac5b5e5c None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:57.437820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c32f4-1770-45c3-afbe-c936ac5b5e5c None admin] RBAC: Authorizing `identity:get_project(project_id=fad2eddcd9204e1e82453c2e4c58edd0)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:57.443136 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c32f4-1770-45c3-afbe-c936ac5b5e5c None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:57.444599 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 142/290] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:57 2022] GET /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:57.448288 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c32f4-1770-45c3-afbe-c936ac5b5e5c None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:57.614499 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c32f4-1770-45c3-afbe-c936ac5b5e5c None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:57.623415 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 149/291] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:41:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 03:41:57.629149 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f839f96-4315-4af6-9b2a-fcf2445e0570 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:57.652871 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af315c9d-81d4-407f-ac0b-2501a96b2ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:57.653553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af315c9d-81d4-407f-ac0b-2501a96b2ab2 None admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:57.653831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af315c9d-81d4-407f-ac0b-2501a96b2ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:57.654106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af315c9d-81d4-407f-ac0b-2501a96b2ab2 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0/users/c17ce08baf5d4f4c9d161807c261d9bb/roles/e2859598b69d4763beae00133c2d5a83` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:57.656312 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af315c9d-81d4-407f-ac0b-2501a96b2ab2 None admin] RBAC: Authorizing `identity:create_grant(project_id=fad2eddcd9204e1e82453c2e4c58edd0, user_id=c17ce08baf5d4f4c9d161807c261d9bb, role_id=e2859598b69d4763beae00133c2d5a83)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:57.659009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af315c9d-81d4-407f-ac0b-2501a96b2ab2 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:57.727788 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 143/292] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:41:57 2022] PUT /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0/users/c17ce08baf5d4f4c9d161807c261d9bb/roles/e2859598b69d4763beae00133c2d5a83 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:41:57.763928 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:57.767668 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f839f96-4315-4af6-9b2a-fcf2445e0570 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:57.835082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8437972-3eb7-418c-bb70-3fee2a9515b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:57.835839 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8437972-3eb7-418c-bb70-3fee2a9515b9 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:57.836122 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8437972-3eb7-418c-bb70-3fee2a9515b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:57.836392 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8437972-3eb7-418c-bb70-3fee2a9515b9 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:57.837672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8437972-3eb7-418c-bb70-3fee2a9515b9 None admin] RBAC: Authorizing `identity:get_project(project_id=fad2eddcd9204e1e82453c2e4c58edd0)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:57.839198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8437972-3eb7-418c-bb70-3fee2a9515b9 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:57.841202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 150/293] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:41:57 2022] GET /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:57.848338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af315c9d-81d4-407f-ac0b-2501a96b2ab2 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:57.930100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:57.977533 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af315c9d-81d4-407f-ac0b-2501a96b2ab2 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:58.013514 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf349714-cbab-48d0-a579-515bd5cb0c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:58.014189 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf349714-cbab-48d0-a579-515bd5cb0c3b None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:58.014469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf349714-cbab-48d0-a579-515bd5cb0c3b None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:58.014767 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf349714-cbab-48d0-a579-515bd5cb0c3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:58.015580 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf349714-cbab-48d0-a579-515bd5cb0c3b None admin] RBAC: Adding query filter params (role.id=43f173da338d498382fba44911238254, scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0, user.id=5e50958576834e33a329ea9e21a348dc) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:58.015890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf349714-cbab-48d0-a579-515bd5cb0c3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:58.018674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf349714-cbab-48d0-a579-515bd5cb0c3b None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:58.024999 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 144/294] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:41:57 2022] GET /identity/v3/role_assignments?user.id=5e50958576834e33a329ea9e21a348dc&scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0&role.id=43f173da338d498382fba44911238254 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:58.512723 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac879ce2-b26a-4319-8527-849394b83f51 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:58.513114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac879ce2-b26a-4319-8527-849394b83f51 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:58.513278 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac879ce2-b26a-4319-8527-849394b83f51 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:58.514912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 151/295] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:58.520446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16afcda-2f94-4380-83ef-cf61afb042c4 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:58.520915 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16afcda-2f94-4380-83ef-cf61afb042c4 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:58.520987 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16afcda-2f94-4380-83ef-cf61afb042c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:58.542115 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-f16afcda-2f94-4380-83ef-cf61afb042c4 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:58.543365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f16afcda-2f94-4380-83ef-cf61afb042c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:58.619468 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 145/296] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:58.639368 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac879ce2-b26a-4319-8527-849394b83f51 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:58.777846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac879ce2-b26a-4319-8527-849394b83f51 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:58.820578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75e647-5687-454a-a828-603c760e670b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:58.821255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75e647-5687-454a-a828-603c760e670b None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:58.821537 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75e647-5687-454a-a828-603c760e670b None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:58.821815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75e647-5687-454a-a828-603c760e670b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:58.834498 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75e647-5687-454a-a828-603c760e670b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:58.839564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-ed75e647-5687-454a-a828-603c760e670b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:58.839564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:58.839564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:58.839564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:58.839564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:58.839564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:58.839564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:58.839564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:58.839564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:58.839564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:58.839564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:58.839564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:58.839564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:58.839564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:58.839564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:58.839564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:58.841141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:58.841141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:58.841141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:58.841141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:58.841141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:58.841141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:58.841141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:58.841141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:58.841141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:58.841141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:58.841141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:58.841141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:58.841141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:58.841141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:58.841141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:58.841141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:58.842583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:58.842583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:58.842583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:58.842583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:58.842583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:58.842583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:58.842583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:58.842583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:58.842583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:58.842583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:58.842583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:41:58.842583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:41:58.846285 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 152/297] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:58.847749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16afcda-2f94-4380-83ef-cf61afb042c4 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:58.905019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:58.952475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16afcda-2f94-4380-83ef-cf61afb042c4 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:58.962911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e77e8b-0a71-44ab-be61-99d6fcb70db3 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:58.962911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e77e8b-0a71-44ab-be61-99d6fcb70db3 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:58.962911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e77e8b-0a71-44ab-be61-99d6fcb70db3 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:58.962911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 153/298] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:41:58.971257 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62e546-de45-4bb8-a741-6a028c829b51 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:58.971571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62e546-de45-4bb8-a741-6a028c829b51 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:58.971853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62e546-de45-4bb8-a741-6a028c829b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:58.994911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-7c62e546-de45-4bb8-a741-6a028c829b51 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:58.996662 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-7c62e546-de45-4bb8-a741-6a028c829b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:59.002517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5205dcd-0f3a-4d97-a529-d7c0a11cefeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:59.003480 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5205dcd-0f3a-4d97-a529-d7c0a11cefeb None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:59.003961 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5205dcd-0f3a-4d97-a529-d7c0a11cefeb None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:59.004431 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5205dcd-0f3a-4d97-a529-d7c0a11cefeb None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:59.005371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5205dcd-0f3a-4d97-a529-d7c0a11cefeb None admin] RBAC: Adding query filter params (name=member) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:59.005891 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5205dcd-0f3a-4d97-a529-d7c0a11cefeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:59.008081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5205dcd-0f3a-4d97-a529-d7c0a11cefeb None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:59.020361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 146/299] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:41:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:59.026129 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5205dcd-0f3a-4d97-a529-d7c0a11cefeb None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:59.029411 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:59.082019 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 154/300] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:41:59.083707 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f64a05-dd3f-42fd-be50-0bf7384ba751 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:59.084142 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f64a05-dd3f-42fd-be50-0bf7384ba751 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:59.084563 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f64a05-dd3f-42fd-be50-0bf7384ba751 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:59.085960 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 155/301] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:41:59.093006 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0f6e3-0e9f-444d-a791-aab8f1920e92 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:59.093329 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0f6e3-0e9f-444d-a791-aab8f1920e92 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:59.093611 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0f6e3-0e9f-444d-a791-aab8f1920e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:59.115709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-f1c0f6e3-0e9f-444d-a791-aab8f1920e92 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:41:59.117043 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f1c0f6e3-0e9f-444d-a791-aab8f1920e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:41:59.139121 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5205dcd-0f3a-4d97-a529-d7c0a11cefeb None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:59.156459 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:59.177265 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2139b-baff-4f61-9178-62fec60b6675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:59.177931 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2139b-baff-4f61-9178-62fec60b6675 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:59.178215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2139b-baff-4f61-9178-62fec60b6675 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:59.178493 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2139b-baff-4f61-9178-62fec60b6675 None admin] PATH_INFO: `/v3/users/267cfbfb95dc4d9cb0049ad3a7d35453` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:59.179803 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2139b-baff-4f61-9178-62fec60b6675 None admin] RBAC: Authorizing `identity:get_user(user_id=267cfbfb95dc4d9cb0049ad3a7d35453)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:59.181326 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2139b-baff-4f61-9178-62fec60b6675 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:59.182968 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 147/302] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:59 2022] GET /identity/v3/users/267cfbfb95dc4d9cb0049ad3a7d35453 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:59.183765 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2139b-baff-4f61-9178-62fec60b6675 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:59.205157 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 156/303] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:59.206409 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0f6e3-0e9f-444d-a791-aab8f1920e92 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:59.303097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2139b-baff-4f61-9178-62fec60b6675 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:59.320701 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:59.334572 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0f6e3-0e9f-444d-a791-aab8f1920e92 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:59.341518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7e2c1-605a-4041-8bea-22e4a3e606c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:59.342180 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7e2c1-605a-4041-8bea-22e4a3e606c0 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:59.342741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7e2c1-605a-4041-8bea-22e4a3e606c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:59.342741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7e2c1-605a-4041-8bea-22e4a3e606c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:59.354245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7e2c1-605a-4041-8bea-22e4a3e606c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:41:59.359792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-31c7e2c1-605a-4041-8bea-22e4a3e606c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 03:41:59.359792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:41:59.359792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:41:59.359792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:41:59.359792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:41:59.359792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:41:59.359792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:41:59.359792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:41:59.359792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:41:59.359792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:41:59.359792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:41:59.359792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:41:59.359792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:41:59.359792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:41:59.359792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:41:59.359792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:41:59.361274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:41:59.361274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:41:59.361274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:41:59.361274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:41:59.361274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:41:59.361274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:41:59.361274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:41:59.361274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:41:59.361274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:41:59.361274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:41:59.361274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:41:59.361274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:41:59.361274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:41:59.361274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:41:59.361274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:41:59.361274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:41:59.362044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:41:59.362044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:41:59.362044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:41:59.362044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:41:59.362044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:41:59.362044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:41:59.362044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:41:59.362044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:41:59.362044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:41:59.362044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:41:59.362044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 03:41:59.362044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:41:59.362044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 148/304] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:41:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:41:59.362696 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7e2c1-605a-4041-8bea-22e4a3e606c0 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:59.377671 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18090ef8-a1a7-4250-b0af-4694c76e784c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:59.378388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18090ef8-a1a7-4250-b0af-4694c76e784c None admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:59.378670 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18090ef8-a1a7-4250-b0af-4694c76e784c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:59.378946 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18090ef8-a1a7-4250-b0af-4694c76e784c None admin] PATH_INFO: `/v3/system/users/267cfbfb95dc4d9cb0049ad3a7d35453/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:59.380462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18090ef8-a1a7-4250-b0af-4694c76e784c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=267cfbfb95dc4d9cb0049ad3a7d35453, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:59.381849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18090ef8-a1a7-4250-b0af-4694c76e784c None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:59.416116 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:59.469580 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7e2c1-605a-4041-8bea-22e4a3e606c0 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:59.491518 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 157/305] 10.222.0.64 () {58 vars in 1334 bytes} [Thu Jul 28 03:41:59 2022] PUT /identity/v3/system/users/267cfbfb95dc4d9cb0049ad3a7d35453/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:41:59.500763 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18090ef8-a1a7-4250-b0af-4694c76e784c None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:59.505826 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00038c25-6558-4c89-8bb0-78e8272822f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:59.506619 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00038c25-6558-4c89-8bb0-78e8272822f0 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:59.506949 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00038c25-6558-4c89-8bb0-78e8272822f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:59.507253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00038c25-6558-4c89-8bb0-78e8272822f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:59.508952 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00038c25-6558-4c89-8bb0-78e8272822f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:59.510531 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00038c25-6558-4c89-8bb0-78e8272822f0 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:59.517540 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 149/306] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:41:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:59.519499 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00038c25-6558-4c89-8bb0-78e8272822f0 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:59.645628 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00038c25-6558-4c89-8bb0-78e8272822f0 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:59.657518 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18090ef8-a1a7-4250-b0af-4694c76e784c None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:59.660682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:59.699430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5038e-20f8-4c6b-b1c7-1038c97e9be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:59.700139 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5038e-20f8-4c6b-b1c7-1038c97e9be4 None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:59.700526 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5038e-20f8-4c6b-b1c7-1038c97e9be4 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:59.700806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5038e-20f8-4c6b-b1c7-1038c97e9be4 None admin] PATH_INFO: `/v3/groups` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:59.701497 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5038e-20f8-4c6b-b1c7-1038c97e9be4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:59.703081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5038e-20f8-4c6b-b1c7-1038c97e9be4 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:59.705852 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d57806-a63d-49cd-8e5a-c616af56f064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:59.706492 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d57806-a63d-49cd-8e5a-c616af56f064 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:59.706778 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d57806-a63d-49cd-8e5a-c616af56f064 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:59.707061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d57806-a63d-49cd-8e5a-c616af56f064 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:59.708266 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d57806-a63d-49cd-8e5a-c616af56f064 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:41:59.708577 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d57806-a63d-49cd-8e5a-c616af56f064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:59.710801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d57806-a63d-49cd-8e5a-c616af56f064 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:59.720854 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 158/307] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:41:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:41:59.726814 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d57806-a63d-49cd-8e5a-c616af56f064 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:41:59.743940 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:59.789451 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 150/308] 10.222.0.64 () {60 vars in 1134 bytes} [Thu Jul 28 03:41:59 2022] POST /identity/v3/groups => generated 229 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:41:59.872199 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d57806-a63d-49cd-8e5a-c616af56f064 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:41:59.914784 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd47d04-e1cb-4994-a9be-604704332f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:41:59.915398 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd47d04-e1cb-4994-a9be-604704332f1d None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:41:59.915727 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd47d04-e1cb-4994-a9be-604704332f1d None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:41:59.916102 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd47d04-e1cb-4994-a9be-604704332f1d None admin] PATH_INFO: `/v3/users/aebaaabd555c48d28396d8860d586926` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:41:59.932416 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd47d04-e1cb-4994-a9be-604704332f1d None admin] RBAC: Authorizing `identity:get_user(user_id=aebaaabd555c48d28396d8860d586926)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:41:59.934047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd47d04-e1cb-4994-a9be-604704332f1d None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:41:59.936045 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 159/309] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:41:59 2022] GET /identity/v3/users/aebaaabd555c48d28396d8860d586926 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:41:59.942672 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5038e-20f8-4c6b-b1c7-1038c97e9be4 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:00.058006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5038e-20f8-4c6b-b1c7-1038c97e9be4 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:00.102196 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3041b9-5aad-4098-881e-e0fe89676afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:00.102828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3041b9-5aad-4098-881e-e0fe89676afd None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:00.103108 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3041b9-5aad-4098-881e-e0fe89676afd None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:00.103420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3041b9-5aad-4098-881e-e0fe89676afd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:00.104217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3041b9-5aad-4098-881e-e0fe89676afd None admin] RBAC: Adding query filter params (role.id=e2859598b69d4763beae00133c2d5a83, user.id=aebaaabd555c48d28396d8860d586926, scope.system=all) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:00.104526 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3041b9-5aad-4098-881e-e0fe89676afd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:00.106053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3041b9-5aad-4098-881e-e0fe89676afd None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:00.113153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 151/310] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Jul 28 03:41:59 2022] GET /identity/v3/role_assignments?user.id=aebaaabd555c48d28396d8860d586926&scope.system=all&role.id=e2859598b69d4763beae00133c2d5a83 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:00.184481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4aefe-7273-446d-9f74-07afdc7d0743 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:00.184796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4aefe-7273-446d-9f74-07afdc7d0743 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:00.185018 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4aefe-7273-446d-9f74-07afdc7d0743 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:00.186863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 160/311] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:00.192934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a16b7-8a39-4c9e-b271-f4128c36e60a None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:00.193223 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a16b7-8a39-4c9e-b271-f4128c36e60a None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:00.193501 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a16b7-8a39-4c9e-b271-f4128c36e60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:00.214587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-b49a16b7-8a39-4c9e-b271-f4128c36e60a None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:00.215862 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b49a16b7-8a39-4c9e-b271-f4128c36e60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:00.254414 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:00.301742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 152/312] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:00.327046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4aefe-7273-446d-9f74-07afdc7d0743 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:00.413600 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:00.449538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4aefe-7273-446d-9f74-07afdc7d0743 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:00.488541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e34938-e7d4-43c7-a0b3-63030fa209dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:00.489196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e34938-e7d4-43c7-a0b3-63030fa209dc None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:00.489526 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e34938-e7d4-43c7-a0b3-63030fa209dc None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:00.489875 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e34938-e7d4-43c7-a0b3-63030fa209dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:00.500819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e34938-e7d4-43c7-a0b3-63030fa209dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:00.507371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-80e34938-e7d4-43c7-a0b3-63030fa209dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 03:42:00.507371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:00.507371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:00.507371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:00.507371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:00.507371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:00.507371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:00.507371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:00.507371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:00.507371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:00.507371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:00.507371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:00.507371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:00.507371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:00.507371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:00.507371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:00.508268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:00.508268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:00.508268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:00.508268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:00.508268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:00.508268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:00.508268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:00.508268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:00.508268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:00.508268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:00.508268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:00.508268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:00.508268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:00.508268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:00.508268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:00.508268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:00.509128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:00.509128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:00.509128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:00.509128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:00.509128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:00.509128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:00.509128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:00.509128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:00.509128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:00.509128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:00.509128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 03:42:00.509128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:00.509128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 161/313] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:00.514464 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a16b7-8a39-4c9e-b271-f4128c36e60a None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:00.622208 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a16b7-8a39-4c9e-b271-f4128c36e60a None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:00.658929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a68ff-f873-4e99-b347-454b01212f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:00.660072 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a68ff-f873-4e99-b347-454b01212f04 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:00.660072 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a68ff-f873-4e99-b347-454b01212f04 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:00.660525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a68ff-f873-4e99-b347-454b01212f04 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:00.661469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a68ff-f873-4e99-b347-454b01212f04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:00.661994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a68ff-f873-4e99-b347-454b01212f04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:00.664429 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a68ff-f873-4e99-b347-454b01212f04 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:00.675114 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 153/314] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:42:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:00.680849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e34938-e7d4-43c7-a0b3-63030fa209dc None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:00.805854 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e34938-e7d4-43c7-a0b3-63030fa209dc None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:00.844157 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:00.852429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11aeb7-dc7a-4fc8-b86d-e3dfa55e1a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:00.853447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11aeb7-dc7a-4fc8-b86d-e3dfa55e1a7d None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:00.853915 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11aeb7-dc7a-4fc8-b86d-e3dfa55e1a7d None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:00.854366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11aeb7-dc7a-4fc8-b86d-e3dfa55e1a7d None admin] PATH_INFO: `/v3/users/c17ce08baf5d4f4c9d161807c261d9bb` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:00.855881 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11aeb7-dc7a-4fc8-b86d-e3dfa55e1a7d None admin] RBAC: Authorizing `identity:get_user(user_id=c17ce08baf5d4f4c9d161807c261d9bb)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:00.857535 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11aeb7-dc7a-4fc8-b86d-e3dfa55e1a7d None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:00.859829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 162/315] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:42:00 2022] GET /identity/v3/users/c17ce08baf5d4f4c9d161807c261d9bb => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:00.865947 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a68ff-f873-4e99-b347-454b01212f04 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:00.919955 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:01.013075 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a68ff-f873-4e99-b347-454b01212f04 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:01.057960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8120e6-ae74-40a5-b5ee-eef0144a458d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:01.058699 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8120e6-ae74-40a5-b5ee-eef0144a458d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:01.059071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8120e6-ae74-40a5-b5ee-eef0144a458d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:01.059378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8120e6-ae74-40a5-b5ee-eef0144a458d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:01.173815 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8120e6-ae74-40a5-b5ee-eef0144a458d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:01.176399 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8120e6-ae74-40a5-b5ee-eef0144a458d None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:01.237234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:01.327111 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 154/316] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:01.333378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11aeb7-dc7a-4fc8-b86d-e3dfa55e1a7d None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:01.463843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11aeb7-dc7a-4fc8-b86d-e3dfa55e1a7d None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:01.501130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8320d81-427d-4dfc-9d5f-8cb47d93ff57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:01.502516 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8320d81-427d-4dfc-9d5f-8cb47d93ff57 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:01.502808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8320d81-427d-4dfc-9d5f-8cb47d93ff57 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:01.503228 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8320d81-427d-4dfc-9d5f-8cb47d93ff57 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:01.504429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8320d81-427d-4dfc-9d5f-8cb47d93ff57 None admin] RBAC: Authorizing `identity:get_project(project_id=fad2eddcd9204e1e82453c2e4c58edd0)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:01.505905 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8320d81-427d-4dfc-9d5f-8cb47d93ff57 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:01.507960 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 163/317] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:42:01 2022] GET /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:01.514155 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8120e6-ae74-40a5-b5ee-eef0144a458d None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:01.646191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8120e6-ae74-40a5-b5ee-eef0144a458d None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:01.677461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:01.686685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baf4a7-47f8-49c3-8e55-8cf5d760acc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:01.687676 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baf4a7-47f8-49c3-8e55-8cf5d760acc4 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:01.688283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baf4a7-47f8-49c3-8e55-8cf5d760acc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:01.694517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baf4a7-47f8-49c3-8e55-8cf5d760acc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:01.694517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baf4a7-47f8-49c3-8e55-8cf5d760acc4 None admin] RBAC: Adding query filter params (role.id=e2859598b69d4763beae00133c2d5a83, scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0, user.id=c17ce08baf5d4f4c9d161807c261d9bb) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:01.694517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baf4a7-47f8-49c3-8e55-8cf5d760acc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:01.694517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baf4a7-47f8-49c3-8e55-8cf5d760acc4 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:01.698684 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 155/318] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:42:01 2022] GET /identity/v3/role_assignments?user.id=c17ce08baf5d4f4c9d161807c261d9bb&scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0&role.id=e2859598b69d4763beae00133c2d5a83 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:01.774377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19229056-27bd-42b5-bb55-59745adced26 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:01.775476 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19229056-27bd-42b5-bb55-59745adced26 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:01.775921 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19229056-27bd-42b5-bb55-59745adced26 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:01.777652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 164/319] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:01.799453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6083450-0a71-4045-a0e3-ad8efe15f1e5 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:01.799995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6083450-0a71-4045-a0e3-ad8efe15f1e5 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:01.800467 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6083450-0a71-4045-a0e3-ad8efe15f1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:01.822954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-e6083450-0a71-4045-a0e3-ad8efe15f1e5 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:01.824801 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e6083450-0a71-4045-a0e3-ad8efe15f1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:01.913690 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 156/320] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:01.944317 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19229056-27bd-42b5-bb55-59745adced26 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:02.056281 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:02.102085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19229056-27bd-42b5-bb55-59745adced26 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:02.146601 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541581dd-f590-4dda-85bb-7d6d1ccc3f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:02.147774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541581dd-f590-4dda-85bb-7d6d1ccc3f35 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:02.148287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541581dd-f590-4dda-85bb-7d6d1ccc3f35 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:02.148797 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541581dd-f590-4dda-85bb-7d6d1ccc3f35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:02.164262 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541581dd-f590-4dda-85bb-7d6d1ccc3f35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:02.169633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-541581dd-f590-4dda-85bb-7d6d1ccc3f35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:42:02.169633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:02.169633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:02.169633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:02.169633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:02.169633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:02.169633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:02.169633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:02.169633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:02.169633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:02.169633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:02.169633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:02.169633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:02.169633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:02.169633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:02.169633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:02.170529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:02.170529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:02.170529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:02.170529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:02.170529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:02.170529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:02.170529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:02.170529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:02.170529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:02.170529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:02.170529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:02.170529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:02.170529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:02.170529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:02.170529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:02.170529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:02.171309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:02.171309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:02.171309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:02.171309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:02.171309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:02.171309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:02.171309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:02.171309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:02.171309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:02.171309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:02.171309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:42:02.171309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:02.171309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 165/321] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:02.178660 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6083450-0a71-4045-a0e3-ad8efe15f1e5 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:02.267439 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599e13e-03b0-4387-a828-d1baeba52c02 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:02.267826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599e13e-03b0-4387-a828-d1baeba52c02 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:02.268019 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599e13e-03b0-4387-a828-d1baeba52c02 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:02.269541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 166/322] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:42:02.274561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48dc87-074c-400e-a49e-0d4344895533 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:02.274845 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48dc87-074c-400e-a49e-0d4344895533 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:02.275119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48dc87-074c-400e-a49e-0d4344895533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:02.295883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-2d48dc87-074c-400e-a49e-0d4344895533 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:02.295883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-2d48dc87-074c-400e-a49e-0d4344895533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:02.312497 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6083450-0a71-4045-a0e3-ad8efe15f1e5 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:02.339359 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:02.356601 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44367083-b3a7-4b6c-98f1-500030b9d15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:02.357650 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44367083-b3a7-4b6c-98f1-500030b9d15a None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:02.357650 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44367083-b3a7-4b6c-98f1-500030b9d15a None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:02.357851 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44367083-b3a7-4b6c-98f1-500030b9d15a None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:02.358537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44367083-b3a7-4b6c-98f1-500030b9d15a None admin] RBAC: Adding query filter params (name=member) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:02.358829 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44367083-b3a7-4b6c-98f1-500030b9d15a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:02.360258 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44367083-b3a7-4b6c-98f1-500030b9d15a None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:02.369212 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 157/323] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:42:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:02.371349 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04c295-0121-491d-962d-80c27c06572e None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:02.371751 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04c295-0121-491d-962d-80c27c06572e None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:02.371937 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04c295-0121-491d-962d-80c27c06572e None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:02.373366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 158/324] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:42:02.374340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 167/325] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:42:02.374920 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04c295-0121-491d-962d-80c27c06572e None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:02.379438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7b1c0-bb50-48dd-8c1b-402e49366ecd None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:02.379730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7b1c0-bb50-48dd-8c1b-402e49366ecd None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:02.380008 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7b1c0-bb50-48dd-8c1b-402e49366ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:02.399522 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-44e7b1c0-bb50-48dd-8c1b-402e49366ecd None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:02.400721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-44e7b1c0-bb50-48dd-8c1b-402e49366ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:02.458748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:02.473811 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 168/326] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:42:02.474736 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7b1c0-bb50-48dd-8c1b-402e49366ecd None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:02.487266 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04c295-0121-491d-962d-80c27c06572e None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:02.523609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a2ed3-8151-4558-a30b-03f336b3bc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:02.524192 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a2ed3-8151-4558-a30b-03f336b3bc60 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:02.524475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a2ed3-8151-4558-a30b-03f336b3bc60 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:02.524753 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a2ed3-8151-4558-a30b-03f336b3bc60 None admin] PATH_INFO: `/v3/users/267cfbfb95dc4d9cb0049ad3a7d35453` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:02.525937 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a2ed3-8151-4558-a30b-03f336b3bc60 None admin] RBAC: Authorizing `identity:get_user(user_id=267cfbfb95dc4d9cb0049ad3a7d35453)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:02.527414 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a2ed3-8151-4558-a30b-03f336b3bc60 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:02.534872 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 159/327] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:42:02 2022] GET /identity/v3/users/267cfbfb95dc4d9cb0049ad3a7d35453 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:02.534872 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a2ed3-8151-4558-a30b-03f336b3bc60 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:02.578525 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7b1c0-bb50-48dd-8c1b-402e49366ecd None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:02.584423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:02.615311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3507906-7fb8-4f83-bde1-dd41cd6e3572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:02.615993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3507906-7fb8-4f83-bde1-dd41cd6e3572 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:02.616262 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3507906-7fb8-4f83-bde1-dd41cd6e3572 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:02.616533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3507906-7fb8-4f83-bde1-dd41cd6e3572 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:02.617728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3507906-7fb8-4f83-bde1-dd41cd6e3572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:02.619181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3507906-7fb8-4f83-bde1-dd41cd6e3572 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:02.620802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 169/328] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:02.621555 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3507906-7fb8-4f83-bde1-dd41cd6e3572 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:02.635348 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a2ed3-8151-4558-a30b-03f336b3bc60 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:02.670247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9b432-c286-4ae6-b205-9c27ac78ad6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:02.670903 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9b432-c286-4ae6-b205-9c27ac78ad6c None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:02.671185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9b432-c286-4ae6-b205-9c27ac78ad6c None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:02.671496 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9b432-c286-4ae6-b205-9c27ac78ad6c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:02.682582 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9b432-c286-4ae6-b205-9c27ac78ad6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:02.684322 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:02.688120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-08c9b432-c286-4ae6-b205-9c27ac78ad6c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 03:42:02.688120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:02.688120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:02.688120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:02.688120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:02.688120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:02.688120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:02.688120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:02.688120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:02.688120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:02.688120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:02.688120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:02.688120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:02.688120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:02.688120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:02.688120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:02.689886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:02.689886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:02.689886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:02.689886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:02.689886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:02.689886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:02.689886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:02.689886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:02.689886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:02.689886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:02.689886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:02.689886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:02.689886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:02.689886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:02.689886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:02.689886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:02.690689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:02.690689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:02.690689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:02.690689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:02.690689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:02.690689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:02.690689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:02.690689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:02.690689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:02.690689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:02.690689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 03:42:02.690689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:02.690689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 160/329] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:02.691354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9b432-c286-4ae6-b205-9c27ac78ad6c None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:02.730779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3507906-7fb8-4f83-bde1-dd41cd6e3572 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:02.764430 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75802972-d93e-42d2-aa38-0d22a0992de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:02.765046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75802972-d93e-42d2-aa38-0d22a0992de7 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:02.765330 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75802972-d93e-42d2-aa38-0d22a0992de7 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:02.765602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75802972-d93e-42d2-aa38-0d22a0992de7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:02.766436 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75802972-d93e-42d2-aa38-0d22a0992de7 None admin] RBAC: Adding query filter params (role.id=43f173da338d498382fba44911238254, user.id=267cfbfb95dc4d9cb0049ad3a7d35453, scope.system=all) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:02.766755 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75802972-d93e-42d2-aa38-0d22a0992de7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:02.768323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75802972-d93e-42d2-aa38-0d22a0992de7 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:02.783473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 170/330] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Jul 28 03:42:02 2022] GET /identity/v3/role_assignments?user.id=267cfbfb95dc4d9cb0049ad3a7d35453&scope.system=all&role.id=43f173da338d498382fba44911238254 => generated 510 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:02.784405 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75802972-d93e-42d2-aa38-0d22a0992de7 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:02.804555 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9b432-c286-4ae6-b205-9c27ac78ad6c None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:02.821527 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:02.846438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1f614-a10e-47e4-9ab7-94f91225687b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:02.847107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1f614-a10e-47e4-9ab7-94f91225687b None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:02.847416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1f614-a10e-47e4-9ab7-94f91225687b None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:02.847800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1f614-a10e-47e4-9ab7-94f91225687b None admin] PATH_INFO: `/v3/groups` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:02.848490 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1f614-a10e-47e4-9ab7-94f91225687b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:02.849964 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1f614-a10e-47e4-9ab7-94f91225687b None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:02.898908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75802972-d93e-42d2-aa38-0d22a0992de7 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:02.915223 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:02.936269 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b65e9-2c20-4466-b962-a75c6158216a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:02.936895 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b65e9-2c20-4466-b962-a75c6158216a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:02.937175 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b65e9-2c20-4466-b962-a75c6158216a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:02.937446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b65e9-2c20-4466-b962-a75c6158216a None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:02.938255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b65e9-2c20-4466-b962-a75c6158216a None admin] RBAC: Adding query filter params (name=reader) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:02.938560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b65e9-2c20-4466-b962-a75c6158216a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:02.940543 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b65e9-2c20-4466-b962-a75c6158216a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:02.949797 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 171/331] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:42:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:02.956064 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b65e9-2c20-4466-b962-a75c6158216a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:02.980538 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 161/332] 10.222.0.64 () {60 vars in 1134 bytes} [Thu Jul 28 03:42:02 2022] POST /identity/v3/groups => generated 226 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:42:03.076184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b65e9-2c20-4466-b962-a75c6158216a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:03.114073 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861f86a-cd09-43c9-b952-a742c5fc63aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:03.114725 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861f86a-cd09-43c9-b952-a742c5fc63aa None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:03.115012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861f86a-cd09-43c9-b952-a742c5fc63aa None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:03.115279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861f86a-cd09-43c9-b952-a742c5fc63aa None admin] PATH_INFO: `/v3/users/aebaaabd555c48d28396d8860d586926` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:03.116624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861f86a-cd09-43c9-b952-a742c5fc63aa None admin] RBAC: Authorizing `identity:get_user(user_id=aebaaabd555c48d28396d8860d586926)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:03.118094 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861f86a-cd09-43c9-b952-a742c5fc63aa None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:03.119968 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 172/333] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:42:02 2022] GET /identity/v3/users/aebaaabd555c48d28396d8860d586926 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:03.125726 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1f614-a10e-47e4-9ab7-94f91225687b None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:03.233223 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1f614-a10e-47e4-9ab7-94f91225687b None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:03.271083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860defd-9002-4667-8176-74d0a18b68d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:03.272350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860defd-9002-4667-8176-74d0a18b68d2 None admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:03.272350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860defd-9002-4667-8176-74d0a18b68d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:03.272350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860defd-9002-4667-8176-74d0a18b68d2 None admin] PATH_INFO: `/v3/system/users/aebaaabd555c48d28396d8860d586926/roles/e2859598b69d4763beae00133c2d5a83` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:03.273838 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860defd-9002-4667-8176-74d0a18b68d2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=aebaaabd555c48d28396d8860d586926, role_id=e2859598b69d4763beae00133c2d5a83)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:03.275244 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860defd-9002-4667-8176-74d0a18b68d2 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:03.348172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 162/334] 10.222.0.64 () {58 vars in 1334 bytes} [Thu Jul 28 03:42:03 2022] PUT /identity/v3/system/users/aebaaabd555c48d28396d8860d586926/roles/e2859598b69d4763beae00133c2d5a83 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:42:05.575526 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbeff31-04de-43fd-bcf1-e6c261366524 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:05.576130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbeff31-04de-43fd-bcf1-e6c261366524 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:05.576403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbeff31-04de-43fd-bcf1-e6c261366524 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:05.579105 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 173/335] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:05.588297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9432ada-d4d3-4320-a73a-002c1b7c1d2a None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:05.588813 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9432ada-d4d3-4320-a73a-002c1b7c1d2a None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:05.588891 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9432ada-d4d3-4320-a73a-002c1b7c1d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:05.628879 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-a9432ada-d4d3-4320-a73a-002c1b7c1d2a None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:05.630876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a9432ada-d4d3-4320-a73a-002c1b7c1d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:05.670638 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:05.731485 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 163/336] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:05.767558 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbeff31-04de-43fd-bcf1-e6c261366524 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:05.858022 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:05.936937 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbeff31-04de-43fd-bcf1-e6c261366524 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:05.981158 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3218a-747b-4768-ad7e-6c8ce6ead2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:05.981818 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3218a-747b-4768-ad7e-6c8ce6ead2e2 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:05.982100 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3218a-747b-4768-ad7e-6c8ce6ead2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:05.982374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3218a-747b-4768-ad7e-6c8ce6ead2e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:05.995787 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3218a-747b-4768-ad7e-6c8ce6ead2e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:06.000840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-c4e3218a-747b-4768-ad7e-6c8ce6ead2e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:42:06.000840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:06.000840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:06.000840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:06.000840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:06.000840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:06.000840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:06.000840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:06.000840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:06.000840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:06.000840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:06.000840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:06.000840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:06.000840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:06.000840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:06.000840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:06.003065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:06.003065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:06.003065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:06.003065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:06.003065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:06.003065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:06.003065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:06.003065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:06.003065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:06.003065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:06.003065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:06.003065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:06.003065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:06.003065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:06.003065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:06.003065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:06.003904 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:06.003904 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:06.003904 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:06.003904 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:06.003904 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:06.003904 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:06.003904 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:06.003904 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:06.003904 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:06.003904 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:06.003904 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:42:06.003904 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:06.003904 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 174/337] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:06.012013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9432ada-d4d3-4320-a73a-002c1b7c1d2a None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:06.164722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee12111-d6fd-40de-859c-53d1efa6b16e None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:06.164906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee12111-d6fd-40de-859c-53d1efa6b16e None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:06.165185 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee12111-d6fd-40de-859c-53d1efa6b16e None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:06.166821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 175/338] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:42:06.180844 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a418bea-f303-41b4-b714-2861dea6551d None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:06.181195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a418bea-f303-41b4-b714-2861dea6551d None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:06.181400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a418bea-f303-41b4-b714-2861dea6551d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:06.182405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9432ada-d4d3-4320-a73a-002c1b7c1d2a None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:06.213918 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-4a418bea-f303-41b4-b714-2861dea6551d None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:06.215150 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-4a418bea-f303-41b4-b714-2861dea6551d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:06.236896 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6a320-3c18-4876-a59d-d4c1e1ef0f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:06.237266 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6a320-3c18-4876-a59d-d4c1e1ef0f3f None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:06.237623 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6a320-3c18-4876-a59d-d4c1e1ef0f3f None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:06.237911 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6a320-3c18-4876-a59d-d4c1e1ef0f3f None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:06.238649 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6a320-3c18-4876-a59d-d4c1e1ef0f3f None admin] RBAC: Adding query filter params (name=member) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:06.238956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6a320-3c18-4876-a59d-d4c1e1ef0f3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:06.240405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6a320-3c18-4876-a59d-d4c1e1ef0f3f None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:06.259645 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 164/339] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:42:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:06.260941 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56a0d8-bd88-4bc3-a31f-ac08e4e29aa1 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:06.261236 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56a0d8-bd88-4bc3-a31f-ac08e4e29aa1 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:06.261515 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56a0d8-bd88-4bc3-a31f-ac08e4e29aa1 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:06.263980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 165/340] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:06.268736 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56a0d8-bd88-4bc3-a31f-ac08e4e29aa1 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:06.341453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:06.358386 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 176/341] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:06.364073 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83176690-bf77-4425-ac57-ff5025d6d751 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:06.364073 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83176690-bf77-4425-ac57-ff5025d6d751 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:06.364073 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83176690-bf77-4425-ac57-ff5025d6d751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:06.395451 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-83176690-bf77-4425-ac57-ff5025d6d751 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:06.396751 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-83176690-bf77-4425-ac57-ff5025d6d751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:06.444119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:06.482112 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56a0d8-bd88-4bc3-a31f-ac08e4e29aa1 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:06.521863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 177/342] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:06.523573 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593837b-079e-4449-a6d8-25dbe676af37 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:06.523870 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593837b-079e-4449-a6d8-25dbe676af37 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:06.524265 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593837b-079e-4449-a6d8-25dbe676af37 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:06.526358 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 178/343] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:06.527285 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593837b-079e-4449-a6d8-25dbe676af37 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:06.527506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d11550-7f18-4645-9615-62f57fb4da6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:06.528212 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d11550-7f18-4645-9615-62f57fb4da6b None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:06.528586 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d11550-7f18-4645-9615-62f57fb4da6b None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:06.528919 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d11550-7f18-4645-9615-62f57fb4da6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:06.621005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d11550-7f18-4645-9615-62f57fb4da6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:06.622923 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d11550-7f18-4645-9615-62f57fb4da6b None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:06.670683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:06.677268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593837b-079e-4449-a6d8-25dbe676af37 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:06.717785 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cb091-7606-432a-b04d-66d6948ab812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:06.718361 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cb091-7606-432a-b04d-66d6948ab812 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:06.718757 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cb091-7606-432a-b04d-66d6948ab812 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:06.719035 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cb091-7606-432a-b04d-66d6948ab812 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:06.748353 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1cb091-7606-432a-b04d-66d6948ab812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:06.753830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-2f1cb091-7606-432a-b04d-66d6948ab812 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:42:06.753830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:06.753830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:06.753830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:06.753830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:06.753830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:06.753830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:06.753830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:06.753830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:06.753830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:06.753830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:06.753830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:06.753830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:06.753830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:06.753830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:06.753830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:06.754913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:06.754913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:06.754913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:06.754913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:06.754913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:06.754913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:06.754913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:06.754913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:06.754913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:06.754913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:06.754913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:06.754913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:06.754913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:06.754913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:06.754913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:06.754913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:06.755732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:06.755732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:06.755732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:06.755732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:06.755732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:06.755732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:06.755732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:06.755732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:06.755732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:06.755732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:06.755732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:42:06.755732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:06.758418 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 179/344] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:42:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:06.759901 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd9ae5-0205-4368-a8f1-ad46d21709a9 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:06.760102 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd9ae5-0205-4368-a8f1-ad46d21709a9 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:06.760358 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd9ae5-0205-4368-a8f1-ad46d21709a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:06.784348 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-1abd9ae5-0205-4368-a8f1-ad46d21709a9 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:06.788057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-1abd9ae5-0205-4368-a8f1-ad46d21709a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:06.798931 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 166/345] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:06.800710 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d11550-7f18-4645-9615-62f57fb4da6b None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:06.817603 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:06.881031 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 180/346] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:06.882252 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd9ae5-0205-4368-a8f1-ad46d21709a9 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:06.929527 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d11550-7f18-4645-9615-62f57fb4da6b None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:06.962251 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:06.976393 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b9672-f033-47f2-ac85-218eac86fb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:06.976393 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b9672-f033-47f2-ac85-218eac86fb42 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:06.976393 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b9672-f033-47f2-ac85-218eac86fb42 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:06.976393 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b9672-f033-47f2-ac85-218eac86fb42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:06.989086 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b9672-f033-47f2-ac85-218eac86fb42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:06.995596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-f48b9672-f033-47f2-ac85-218eac86fb42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:42:06.995596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:06.995596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:06.995596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:06.995596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:06.995596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:06.995596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:06.995596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:06.995596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:06.995596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:06.995596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:06.995596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:06.995596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:06.995596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:06.995596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:06.995596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:06.996633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:06.996633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:06.996633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:06.996633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:06.996633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:06.996633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:06.996633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:06.996633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:06.996633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:06.996633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:06.996633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:06.996633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:06.996633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:06.996633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:06.996633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:06.996633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:06.997419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:06.997419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:06.997419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:06.997419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:06.997419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:06.997419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:06.997419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:06.997419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:06.997419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:06.997419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:06.997419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:42:06.997419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:06.997419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 167/347] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:06.998070 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b9672-f033-47f2-ac85-218eac86fb42 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:07.017874 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd9ae5-0205-4368-a8f1-ad46d21709a9 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:07.066974 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6d74d-1415-4edf-a32d-7bcad0a37f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:07.067703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6d74d-1415-4edf-a32d-7bcad0a37f1b None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:07.067986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6d74d-1415-4edf-a32d-7bcad0a37f1b None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:07.068362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6d74d-1415-4edf-a32d-7bcad0a37f1b None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:07.069201 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6d74d-1415-4edf-a32d-7bcad0a37f1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:07.069509 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6d74d-1415-4edf-a32d-7bcad0a37f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:07.070987 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6d74d-1415-4edf-a32d-7bcad0a37f1b None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:07.084138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 181/348] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:07.085238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6d74d-1415-4edf-a32d-7bcad0a37f1b None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:07.116104 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:07.146555 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b9672-f033-47f2-ac85-218eac86fb42 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:07.203727 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e235ff0-4913-4610-8bef-ebe415a3fe89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:07.205310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e235ff0-4913-4610-8bef-ebe415a3fe89 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:07.205812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e235ff0-4913-4610-8bef-ebe415a3fe89 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:07.206300 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e235ff0-4913-4610-8bef-ebe415a3fe89 None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:07.208491 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e235ff0-4913-4610-8bef-ebe415a3fe89 None admin] RBAC: Authorizing `identity:get_project(project_id=856293872ed14cbda37a5830759ee4e7)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:07.210626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e235ff0-4913-4610-8bef-ebe415a3fe89 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:07.217956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 168/349] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:42:06 2022] GET /identity/v3/projects/856293872ed14cbda37a5830759ee4e7 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:07.219554 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e235ff0-4913-4610-8bef-ebe415a3fe89 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:07.250257 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6d74d-1415-4edf-a32d-7bcad0a37f1b None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:07.301717 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd3c4a-15a5-4253-a161-0dad7fc323e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:07.303193 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd3c4a-15a5-4253-a161-0dad7fc323e8 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:07.303803 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd3c4a-15a5-4253-a161-0dad7fc323e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:07.304348 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd3c4a-15a5-4253-a161-0dad7fc323e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:07.306626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:07.328457 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd3c4a-15a5-4253-a161-0dad7fc323e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:07.336152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-68fd3c4a-15a5-4253-a161-0dad7fc323e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 03:42:07.336152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:07.336152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:07.336152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:07.336152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:07.336152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:07.336152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:07.336152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:07.336152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:07.336152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:07.336152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:07.336152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:07.336152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:07.336152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:07.336152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:07.336152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:07.337311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:07.337311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:07.337311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:07.337311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:07.337311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:07.337311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:07.337311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:07.337311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:07.337311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:07.337311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:07.337311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:07.337311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:07.337311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:07.337311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:07.337311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:07.337311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:07.338287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:07.338287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:07.338287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:07.338287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:07.338287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:07.338287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:07.338287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:07.338287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:07.338287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:07.338287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:07.338287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 03:42:07.338287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:07.340375 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 182/350] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:07.342054 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd3c4a-15a5-4253-a161-0dad7fc323e8 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:07.374024 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e235ff0-4913-4610-8bef-ebe415a3fe89 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:07.421365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585779de-6cc3-4521-9687-b0c5a56d0da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:07.422039 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585779de-6cc3-4521-9687-b0c5a56d0da0 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:07.422321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585779de-6cc3-4521-9687-b0c5a56d0da0 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:07.422594 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585779de-6cc3-4521-9687-b0c5a56d0da0 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:07.423462 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585779de-6cc3-4521-9687-b0c5a56d0da0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:07.423806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585779de-6cc3-4521-9687-b0c5a56d0da0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:07.425207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585779de-6cc3-4521-9687-b0c5a56d0da0 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:07.434358 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 169/351] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:42:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:07.435023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585779de-6cc3-4521-9687-b0c5a56d0da0 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:07.449276 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:07.478239 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd3c4a-15a5-4253-a161-0dad7fc323e8 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:07.528595 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8822f-7a50-460b-b6b3-e6fb2f79623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:07.529295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8822f-7a50-460b-b6b3-e6fb2f79623b None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:07.529587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8822f-7a50-460b-b6b3-e6fb2f79623b None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:07.529849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8822f-7a50-460b-b6b3-e6fb2f79623b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:07.557783 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585779de-6cc3-4521-9687-b0c5a56d0da0 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:07.575467 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:07.601511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328ea5e-0e7a-419d-888c-c79c78d95bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:07.602202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328ea5e-0e7a-419d-888c-c79c78d95bd0 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:07.602484 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328ea5e-0e7a-419d-888c-c79c78d95bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:07.602790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328ea5e-0e7a-419d-888c-c79c78d95bd0 None admin] PATH_INFO: `/v3/groups/e1b9f11ad1c44a82b10de08faf70d971` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:07.609165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328ea5e-0e7a-419d-888c-c79c78d95bd0 None admin] RBAC: Authorizing `identity:get_group(group_id=e1b9f11ad1c44a82b10de08faf70d971)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:07.612214 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328ea5e-0e7a-419d-888c-c79c78d95bd0 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:07.618844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 170/352] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 28 03:42:07 2022] GET /identity/v3/groups/e1b9f11ad1c44a82b10de08faf70d971 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:07.619882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328ea5e-0e7a-419d-888c-c79c78d95bd0 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:07.624392 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8822f-7a50-460b-b6b3-e6fb2f79623b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:07.626059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8822f-7a50-460b-b6b3-e6fb2f79623b None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:07.715033 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:07.744158 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 183/353] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:07.745680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a5833-0fa4-47d3-939f-0c720932f6f5 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:07.745966 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a5833-0fa4-47d3-939f-0c720932f6f5 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:07.746239 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a5833-0fa4-47d3-939f-0c720932f6f5 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:07.747586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 184/354] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:07.748278 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a5833-0fa4-47d3-939f-0c720932f6f5 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:07.770708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328ea5e-0e7a-419d-888c-c79c78d95bd0 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:07.818337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d63e1-b192-46ad-b2ac-a3472ede222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:07.818981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d63e1-b192-46ad-b2ac-a3472ede222e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:07.819262 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d63e1-b192-46ad-b2ac-a3472ede222e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:07.819571 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d63e1-b192-46ad-b2ac-a3472ede222e None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:07.820302 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d63e1-b192-46ad-b2ac-a3472ede222e None admin] RBAC: Adding query filter params (name=reader) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:07.820608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d63e1-b192-46ad-b2ac-a3472ede222e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:07.821993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d63e1-b192-46ad-b2ac-a3472ede222e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:07.831681 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 171/355] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:42:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:07.833330 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4036f-978e-4dad-9b73-3e48ad2c60b2 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:07.834816 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4036f-978e-4dad-9b73-3e48ad2c60b2 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:07.835243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4036f-978e-4dad-9b73-3e48ad2c60b2 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:07.837157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 172/356] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:07.838100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4036f-978e-4dad-9b73-3e48ad2c60b2 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:07.888516 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a5833-0fa4-47d3-939f-0c720932f6f5 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:07.899289 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:07.938015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3167d7b-0e86-4c9e-bf09-623f2f5ccb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:07.939446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3167d7b-0e86-4c9e-bf09-623f2f5ccb54 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:07.939737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3167d7b-0e86-4c9e-bf09-623f2f5ccb54 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:07.940010 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3167d7b-0e86-4c9e-bf09-623f2f5ccb54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:07.972248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4036f-978e-4dad-9b73-3e48ad2c60b2 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:08.004324 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:08.018063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59953fc6-318a-4079-ba5c-f8d0eea68a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:08.018701 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59953fc6-318a-4079-ba5c-f8d0eea68a6c None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:08.019701 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59953fc6-318a-4079-ba5c-f8d0eea68a6c None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:08.019701 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59953fc6-318a-4079-ba5c-f8d0eea68a6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:08.020855 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59953fc6-318a-4079-ba5c-f8d0eea68a6c None admin] RBAC: Adding query filter params (group.id=e1b9f11ad1c44a82b10de08faf70d971, role.id=43f173da338d498382fba44911238254, scope.project.id=856293872ed14cbda37a5830759ee4e7) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:08.022112 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59953fc6-318a-4079-ba5c-f8d0eea68a6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:08.023585 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59953fc6-318a-4079-ba5c-f8d0eea68a6c None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:08.031107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 173/357] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 28 03:42:07 2022] GET /identity/v3/role_assignments?group.id=e1b9f11ad1c44a82b10de08faf70d971&scope.project.id=856293872ed14cbda37a5830759ee4e7&role.id=43f173da338d498382fba44911238254 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:08.033485 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59953fc6-318a-4079-ba5c-f8d0eea68a6c None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:08.039245 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3167d7b-0e86-4c9e-bf09-623f2f5ccb54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:08.040706 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3167d7b-0e86-4c9e-bf09-623f2f5ccb54 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:08.185741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59953fc6-318a-4079-ba5c-f8d0eea68a6c None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:08.187406 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 185/358] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:08.189501 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c97934-eddb-49a5-9f45-831c6e1d972a None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:08.189885 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c97934-eddb-49a5-9f45-831c6e1d972a None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:08.190282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c97934-eddb-49a5-9f45-831c6e1d972a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:08.198023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:08.215696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-d5c97934-eddb-49a5-9f45-831c6e1d972a None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:08.216917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-d5c97934-eddb-49a5-9f45-831c6e1d972a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:08.236781 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7adb36-a023-4476-82ee-a828fd2b8a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:08.237704 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7adb36-a023-4476-82ee-a828fd2b8a1d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:08.238300 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7adb36-a023-4476-82ee-a828fd2b8a1d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:08.238574 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7adb36-a023-4476-82ee-a828fd2b8a1d None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:08.240372 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7adb36-a023-4476-82ee-a828fd2b8a1d None admin] RBAC: Authorizing `identity:get_project(project_id=856293872ed14cbda37a5830759ee4e7)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:08.245994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7adb36-a023-4476-82ee-a828fd2b8a1d None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:08.245994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 174/359] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:42:08 2022] GET /identity/v3/projects/856293872ed14cbda37a5830759ee4e7 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:08.245994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7adb36-a023-4476-82ee-a828fd2b8a1d None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:08.304930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 186/360] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:08.306281 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4ba03-b5d1-441a-bf79-960a63df4c8b None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:08.306506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4ba03-b5d1-441a-bf79-960a63df4c8b None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:08.306814 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4ba03-b5d1-441a-bf79-960a63df4c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:08.322620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:08.328696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-a7c4ba03-b5d1-441a-bf79-960a63df4c8b None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:08.330231 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a7c4ba03-b5d1-441a-bf79-960a63df4c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:08.379609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7adb36-a023-4476-82ee-a828fd2b8a1d None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:08.419370 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 187/361] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:08.419370 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4ba03-b5d1-441a-bf79-960a63df4c8b None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:08.427942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16436c4-90b0-49bf-9eef-2ec64de80b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:08.428609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16436c4-90b0-49bf-9eef-2ec64de80b53 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:08.428896 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16436c4-90b0-49bf-9eef-2ec64de80b53 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:08.429270 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16436c4-90b0-49bf-9eef-2ec64de80b53 None admin] PATH_INFO: `/v3/users/aebaaabd555c48d28396d8860d586926` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:08.430484 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16436c4-90b0-49bf-9eef-2ec64de80b53 None admin] RBAC: Authorizing `identity:get_user(user_id=aebaaabd555c48d28396d8860d586926)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:08.432686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16436c4-90b0-49bf-9eef-2ec64de80b53 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:08.435826 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 175/362] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:42:08 2022] GET /identity/v3/users/aebaaabd555c48d28396d8860d586926 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:08.436512 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16436c4-90b0-49bf-9eef-2ec64de80b53 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:08.495164 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:08.545255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4ba03-b5d1-441a-bf79-960a63df4c8b None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:08.577084 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16436c4-90b0-49bf-9eef-2ec64de80b53 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:08.592570 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1dd31-8cb9-4c2e-bbcc-fbef90094151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:08.593268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1dd31-8cb9-4c2e-bbcc-fbef90094151 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:08.593554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1dd31-8cb9-4c2e-bbcc-fbef90094151 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:08.593823 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1dd31-8cb9-4c2e-bbcc-fbef90094151 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:08.595612 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1dd31-8cb9-4c2e-bbcc-fbef90094151 None admin] RBAC: Authorizing `identity:get_project(project_id=fad2eddcd9204e1e82453c2e4c58edd0)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:08.597104 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1dd31-8cb9-4c2e-bbcc-fbef90094151 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:08.598863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 188/363] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:42:08 2022] GET /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:08.600499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1dd31-8cb9-4c2e-bbcc-fbef90094151 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:08.604601 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:08.624307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd875e-6290-487b-8dec-3ce4cbef63f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:08.624995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd875e-6290-487b-8dec-3ce4cbef63f2 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:08.625251 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd875e-6290-487b-8dec-3ce4cbef63f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:08.625529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd875e-6290-487b-8dec-3ce4cbef63f2 None admin] PATH_INFO: `/v3/groups/e1b9f11ad1c44a82b10de08faf70d971` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:08.626792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd875e-6290-487b-8dec-3ce4cbef63f2 None admin] RBAC: Authorizing `identity:get_group(group_id=e1b9f11ad1c44a82b10de08faf70d971)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:08.628491 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd875e-6290-487b-8dec-3ce4cbef63f2 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:08.630100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 176/364] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 28 03:42:08 2022] GET /identity/v3/groups/e1b9f11ad1c44a82b10de08faf70d971 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:08.630868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd875e-6290-487b-8dec-3ce4cbef63f2 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:08.744087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1dd31-8cb9-4c2e-bbcc-fbef90094151 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:08.777687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd875e-6290-487b-8dec-3ce4cbef63f2 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:08.794855 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d725ec2-8cf9-42f3-9465-85cbac0068eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:08.795774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d725ec2-8cf9-42f3-9465-85cbac0068eb None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:08.796068 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d725ec2-8cf9-42f3-9465-85cbac0068eb None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:08.796349 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d725ec2-8cf9-42f3-9465-85cbac0068eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:08.799982 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:08.810541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d725ec2-8cf9-42f3-9465-85cbac0068eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:08.817970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-5d725ec2-8cf9-42f3-9465-85cbac0068eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:42:08.817970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:08.817970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:08.817970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:08.817970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:08.817970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:08.817970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:08.817970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:08.817970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:08.817970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:08.817970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:08.817970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:08.817970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:08.817970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:08.817970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:08.817970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:08.818897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:08.818897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:08.818897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:08.818897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:08.818897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:08.818897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:08.818897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:08.818897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:08.818897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:08.818897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:08.818897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:08.818897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:08.818897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:08.818897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:08.818897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:08.818897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:08.819774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:08.819774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:08.819774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:08.819774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:08.819774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:08.819774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:08.819774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:08.819774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:08.819774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:08.819774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:08.819774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:42:08.819774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:08.819774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 189/365] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:42:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:08.820421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d725ec2-8cf9-42f3-9465-85cbac0068eb None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:08.838425 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322496c2-7523-4c18-b04c-47984183dece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:08.839106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322496c2-7523-4c18-b04c-47984183dece None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:08.839588 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322496c2-7523-4c18-b04c-47984183dece None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:08.839965 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322496c2-7523-4c18-b04c-47984183dece None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:08.840675 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322496c2-7523-4c18-b04c-47984183dece None admin] RBAC: Adding query filter params (role.id=e2859598b69d4763beae00133c2d5a83, user.id=aebaaabd555c48d28396d8860d586926, scope.system=all) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:08.840987 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322496c2-7523-4c18-b04c-47984183dece None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:08.842468 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322496c2-7523-4c18-b04c-47984183dece None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:08.861682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 177/366] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Jul 28 03:42:08 2022] GET /identity/v3/role_assignments?user.id=aebaaabd555c48d28396d8860d586926&scope.system=all&role.id=e2859598b69d4763beae00133c2d5a83 => generated 510 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:08.863177 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322496c2-7523-4c18-b04c-47984183dece None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:08.916502 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:08.967949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d725ec2-8cf9-42f3-9465-85cbac0068eb None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:09.011609 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c29caa-72b7-408e-b0de-783cb8c7a1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:09.012803 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c29caa-72b7-408e-b0de-783cb8c7a1df None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:09.013296 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c29caa-72b7-408e-b0de-783cb8c7a1df None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:09.013790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c29caa-72b7-408e-b0de-783cb8c7a1df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:09.022587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322496c2-7523-4c18-b04c-47984183dece None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:09.028911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c29caa-72b7-408e-b0de-783cb8c7a1df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:09.038746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-d9c29caa-72b7-408e-b0de-783cb8c7a1df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:42:09.038746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:09.038746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:09.038746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:09.038746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:09.038746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:09.038746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:09.038746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:09.038746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:09.038746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:09.038746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:09.038746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:09.038746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:09.038746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:09.038746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:09.038746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:09.039733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:09.039733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:09.039733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:09.039733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:09.039733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:09.039733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:09.039733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:09.039733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:09.039733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:09.039733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:09.039733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:09.039733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:09.039733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:09.039733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:09.039733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:09.039733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:09.040540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:09.040540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:09.040540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:09.040540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:09.040540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:09.040540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:09.040540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:09.040540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:09.040540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:09.040540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:09.040540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:42:09.040540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:09.043565 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 190/367] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:42:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:09.045004 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c29caa-72b7-408e-b0de-783cb8c7a1df None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:09.082700 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67882c21-f2fc-44af-bee8-0ab152e1d4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:09.083456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67882c21-f2fc-44af-bee8-0ab152e1d4b7 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:09.083823 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67882c21-f2fc-44af-bee8-0ab152e1d4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:09.084099 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67882c21-f2fc-44af-bee8-0ab152e1d4b7 None admin] PATH_INFO: `/v3/groups/e1b9f11ad1c44a82b10de08faf70d971` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:09.085429 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67882c21-f2fc-44af-bee8-0ab152e1d4b7 None admin] RBAC: Authorizing `identity:get_group(group_id=e1b9f11ad1c44a82b10de08faf70d971)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:09.086944 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67882c21-f2fc-44af-bee8-0ab152e1d4b7 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:09.088839 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 178/368] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 28 03:42:08 2022] GET /identity/v3/groups/e1b9f11ad1c44a82b10de08faf70d971 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:09.089726 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67882c21-f2fc-44af-bee8-0ab152e1d4b7 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:09.155004 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:09.191163 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c29caa-72b7-408e-b0de-783cb8c7a1df None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:09.228673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:09.245483 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef4b7f-ddbc-4b45-85e5-73d85ce7cc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:09.245906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef4b7f-ddbc-4b45-85e5-73d85ce7cc6b None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:09.246193 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef4b7f-ddbc-4b45-85e5-73d85ce7cc6b None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:09.246478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef4b7f-ddbc-4b45-85e5-73d85ce7cc6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:09.247807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef4b7f-ddbc-4b45-85e5-73d85ce7cc6b None admin] RBAC: Adding query filter params (group.id=e1b9f11ad1c44a82b10de08faf70d971, role.id=81c955f5702546679605b5484602ae69, scope.project.id=856293872ed14cbda37a5830759ee4e7) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:09.247958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef4b7f-ddbc-4b45-85e5-73d85ce7cc6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:09.249604 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef4b7f-ddbc-4b45-85e5-73d85ce7cc6b None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:09.256607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 191/369] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 28 03:42:09 2022] GET /identity/v3/role_assignments?group.id=e1b9f11ad1c44a82b10de08faf70d971&scope.project.id=856293872ed14cbda37a5830759ee4e7&role.id=81c955f5702546679605b5484602ae69 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:09.257561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef4b7f-ddbc-4b45-85e5-73d85ce7cc6b None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:09.271401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67882c21-f2fc-44af-bee8-0ab152e1d4b7 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:09.325925 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc445667-0ae2-4f7f-93a5-9a66a7621607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:09.327354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc445667-0ae2-4f7f-93a5-9a66a7621607 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:09.327853 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc445667-0ae2-4f7f-93a5-9a66a7621607 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:09.328313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc445667-0ae2-4f7f-93a5-9a66a7621607 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:09.329298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc445667-0ae2-4f7f-93a5-9a66a7621607 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:09.329905 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc445667-0ae2-4f7f-93a5-9a66a7621607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:09.332536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc445667-0ae2-4f7f-93a5-9a66a7621607 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:09.346737 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 179/370] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:09.347965 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc445667-0ae2-4f7f-93a5-9a66a7621607 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:09.406365 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef4b7f-ddbc-4b45-85e5-73d85ce7cc6b None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:09.462499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb7846-ec63-4e43-bfeb-740d30d271a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:09.463487 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb7846-ec63-4e43-bfeb-740d30d271a6 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:09.463937 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb7846-ec63-4e43-bfeb-740d30d271a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:09.464362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb7846-ec63-4e43-bfeb-740d30d271a6 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:09.465244 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb7846-ec63-4e43-bfeb-740d30d271a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:09.465721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb7846-ec63-4e43-bfeb-740d30d271a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:09.467192 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb7846-ec63-4e43-bfeb-740d30d271a6 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:09.478558 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 192/371] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:09.479233 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb7846-ec63-4e43-bfeb-740d30d271a6 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:09.510165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:09.517238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc445667-0ae2-4f7f-93a5-9a66a7621607 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:09.564820 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:09.568009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa4ad7-18e5-4635-addc-4739e7067fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:09.569252 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa4ad7-18e5-4635-addc-4739e7067fee None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:09.569542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa4ad7-18e5-4635-addc-4739e7067fee None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:09.569822 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa4ad7-18e5-4635-addc-4739e7067fee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:09.571049 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa4ad7-18e5-4635-addc-4739e7067fee None admin] RBAC: Adding query filter params (group.id=e1b9f11ad1c44a82b10de08faf70d971, role.id=43f173da338d498382fba44911238254, scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:09.571412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa4ad7-18e5-4635-addc-4739e7067fee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:09.573561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa4ad7-18e5-4635-addc-4739e7067fee None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:09.582880 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 180/372] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 28 03:42:09 2022] GET /identity/v3/role_assignments?group.id=e1b9f11ad1c44a82b10de08faf70d971&scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0&role.id=43f173da338d498382fba44911238254 => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:09.583917 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa4ad7-18e5-4635-addc-4739e7067fee None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:09.690674 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb7846-ec63-4e43-bfeb-740d30d271a6 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:09.759107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa4ad7-18e5-4635-addc-4739e7067fee None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:09.765326 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1fdb9-d8ef-4d33-80b2-5e4769f5666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:09.765984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1fdb9-d8ef-4d33-80b2-5e4769f5666a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:09.766259 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1fdb9-d8ef-4d33-80b2-5e4769f5666a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:09.766606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1fdb9-d8ef-4d33-80b2-5e4769f5666a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:09.841363 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc445d17-5f45-4699-8e6d-691d74574d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:09.842040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc445d17-5f45-4699-8e6d-691d74574d7f None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:09.842293 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc445d17-5f45-4699-8e6d-691d74574d7f None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:09.842567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc445d17-5f45-4699-8e6d-691d74574d7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:09.907442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1fdb9-d8ef-4d33-80b2-5e4769f5666a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:09.908945 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1fdb9-d8ef-4d33-80b2-5e4769f5666a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:09.912310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:09.984245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc445d17-5f45-4699-8e6d-691d74574d7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:09.985707 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc445d17-5f45-4699-8e6d-691d74574d7f None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:10.018859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:10.110215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 181/373] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:10.116353 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc445d17-5f45-4699-8e6d-691d74574d7f None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:10.134469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 193/374] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:10.140779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1fdb9-d8ef-4d33-80b2-5e4769f5666a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:10.183750 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:10.226055 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc445d17-5f45-4699-8e6d-691d74574d7f None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:10.265766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ad9e4-cd0b-470a-9ca6-8362de585f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:10.266525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ad9e4-cd0b-470a-9ca6-8362de585f3f None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:10.266917 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ad9e4-cd0b-470a-9ca6-8362de585f3f None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:10.267200 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ad9e4-cd0b-470a-9ca6-8362de585f3f None admin] PATH_INFO: `/v3/projects/7ea31e38f3a74a13b1debf11d300a6d6` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:10.271346 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ad9e4-cd0b-470a-9ca6-8362de585f3f None admin] RBAC: Authorizing `identity:get_project(project_id=7ea31e38f3a74a13b1debf11d300a6d6)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:10.271346 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ad9e4-cd0b-470a-9ca6-8362de585f3f None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:10.272470 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 182/375] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:42:10 2022] GET /identity/v3/projects/7ea31e38f3a74a13b1debf11d300a6d6 => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:10.277934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ad9e4-cd0b-470a-9ca6-8362de585f3f None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:10.358054 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1fdb9-d8ef-4d33-80b2-5e4769f5666a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:10.402530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ad9e4-cd0b-470a-9ca6-8362de585f3f None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:10.406384 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb47e13-4dfa-46f9-9595-99408f3b8603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:10.407235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb47e13-4dfa-46f9-9595-99408f3b8603 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:10.407817 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb47e13-4dfa-46f9-9595-99408f3b8603 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:10.408241 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb47e13-4dfa-46f9-9595-99408f3b8603 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:10.409653 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb47e13-4dfa-46f9-9595-99408f3b8603 None admin] RBAC: Authorizing `identity:get_project(project_id=fad2eddcd9204e1e82453c2e4c58edd0)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:10.411238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb47e13-4dfa-46f9-9595-99408f3b8603 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:10.413409 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 194/376] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:42:10 2022] GET /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:10.414724 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14c0aa-d7cb-471f-bde3-24b4f83459c6 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:10.415366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14c0aa-d7cb-471f-bde3-24b4f83459c6 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:10.415497 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14c0aa-d7cb-471f-bde3-24b4f83459c6 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:10.417127 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 195/377] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:10.422302 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ec051-c6b1-4ea8-aa8c-2d3bbcabb586 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:10.422880 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ec051-c6b1-4ea8-aa8c-2d3bbcabb586 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:10.423439 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ec051-c6b1-4ea8-aa8c-2d3bbcabb586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:10.448374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:10.450277 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-aa5ec051-c6b1-4ea8-aa8c-2d3bbcabb586 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:10.451656 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-aa5ec051-c6b1-4ea8-aa8c-2d3bbcabb586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:10.456081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8113b53-eb77-4c36-8801-4e2867ecd7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:10.457049 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8113b53-eb77-4c36-8801-4e2867ecd7a9 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:10.457539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8113b53-eb77-4c36-8801-4e2867ecd7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:10.457979 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8113b53-eb77-4c36-8801-4e2867ecd7a9 None admin] PATH_INFO: `/v3/groups/f8bc3aeb2e3244c8a8e872b9b586fddd` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:10.464542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8113b53-eb77-4c36-8801-4e2867ecd7a9 None admin] RBAC: Authorizing `identity:get_group(group_id=f8bc3aeb2e3244c8a8e872b9b586fddd)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:10.466909 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8113b53-eb77-4c36-8801-4e2867ecd7a9 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:10.467713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:10.469125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 183/378] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 28 03:42:10 2022] GET /identity/v3/groups/f8bc3aeb2e3244c8a8e872b9b586fddd => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:10.475473 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8113b53-eb77-4c36-8801-4e2867ecd7a9 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:10.551599 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 196/379] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:42:10.552543 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ec051-c6b1-4ea8-aa8c-2d3bbcabb586 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:10.620809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8113b53-eb77-4c36-8801-4e2867ecd7a9 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:10.671540 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fd077-9e23-4535-adea-b818ffa30dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:10.673155 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fd077-9e23-4535-adea-b818ffa30dba None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:10.673927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fd077-9e23-4535-adea-b818ffa30dba None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:10.674444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fd077-9e23-4535-adea-b818ffa30dba None admin] PATH_INFO: `/v3/groups/e1b9f11ad1c44a82b10de08faf70d971` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:10.676682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fd077-9e23-4535-adea-b818ffa30dba None admin] RBAC: Authorizing `identity:get_group(group_id=e1b9f11ad1c44a82b10de08faf70d971)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:10.678391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fd077-9e23-4535-adea-b818ffa30dba None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:10.681062 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 184/380] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 28 03:42:10 2022] GET /identity/v3/groups/e1b9f11ad1c44a82b10de08faf70d971 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:10.685986 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fd077-9e23-4535-adea-b818ffa30dba None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:10.702108 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ec051-c6b1-4ea8-aa8c-2d3bbcabb586 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:10.751879 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d55ae6-33b8-481a-a367-8e74bc258ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:10.753501 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d55ae6-33b8-481a-a367-8e74bc258ffe None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:10.754005 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d55ae6-33b8-481a-a367-8e74bc258ffe None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:10.754685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d55ae6-33b8-481a-a367-8e74bc258ffe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:10.755925 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d55ae6-33b8-481a-a367-8e74bc258ffe None admin] RBAC: Adding query filter params (group.id=f8bc3aeb2e3244c8a8e872b9b586fddd, role.id=8a5766c4aef44773834941d1bdbd1e98, scope.project.id=7ea31e38f3a74a13b1debf11d300a6d6) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:10.756390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d55ae6-33b8-481a-a367-8e74bc258ffe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:10.758752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d55ae6-33b8-481a-a367-8e74bc258ffe None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:10.763475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:10.770264 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 197/381] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 28 03:42:10 2022] GET /identity/v3/role_assignments?group.id=f8bc3aeb2e3244c8a8e872b9b586fddd&scope.project.id=7ea31e38f3a74a13b1debf11d300a6d6&role.id=8a5766c4aef44773834941d1bdbd1e98 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:10.772085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d55ae6-33b8-481a-a367-8e74bc258ffe None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:10.793998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:10.817307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fd077-9e23-4535-adea-b818ffa30dba None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:10.865497 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf8ae5-12dd-4393-85ca-b8e3a7445f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:10.866253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf8ae5-12dd-4393-85ca-b8e3a7445f5b None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:10.866509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf8ae5-12dd-4393-85ca-b8e3a7445f5b None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:10.866786 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf8ae5-12dd-4393-85ca-b8e3a7445f5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:10.887809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf8ae5-12dd-4393-85ca-b8e3a7445f5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:10.897466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-b7bf8ae5-12dd-4393-85ca-b8e3a7445f5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:42:10.897466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:10.897466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:10.897466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:10.897466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:10.897466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:10.897466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:10.897466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:10.897466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:10.897466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:10.897466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:10.897466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:10.897466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:10.897466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:10.897466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:10.897466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:10.898442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:10.898442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:10.898442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:10.898442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:10.898442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:10.898442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:10.898442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:10.898442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:10.898442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:10.898442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:10.898442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:10.898442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:10.898442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:10.898442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:10.898442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:10.898442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:10.899238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:10.899238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:10.899238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:10.899238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:10.899238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:10.899238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:10.899238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:10.899238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:10.899238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:10.899238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:10.899238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:42:10.899238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:10.899238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 185/382] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:10.906033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf8ae5-12dd-4393-85ca-b8e3a7445f5b None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:10.967095 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d55ae6-33b8-481a-a367-8e74bc258ffe None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:11.053240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8f155-cd30-49df-a892-b79e7f908561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:11.053877 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8f155-cd30-49df-a892-b79e7f908561 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:11.054162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8f155-cd30-49df-a892-b79e7f908561 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:11.054435 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8f155-cd30-49df-a892-b79e7f908561 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:11.055239 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8f155-cd30-49df-a892-b79e7f908561 None admin] RBAC: Adding query filter params (group.id=e1b9f11ad1c44a82b10de08faf70d971, role.id=81c955f5702546679605b5484602ae69, scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:11.055578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8f155-cd30-49df-a892-b79e7f908561 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:11.057040 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c8f155-cd30-49df-a892-b79e7f908561 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:11.074102 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 198/383] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 28 03:42:10 2022] GET /identity/v3/role_assignments?group.id=e1b9f11ad1c44a82b10de08faf70d971&scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0&role.id=81c955f5702546679605b5484602ae69 => generated 260 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:11.091139 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf8ae5-12dd-4393-85ca-b8e3a7445f5b None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:11.135687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:11.156198 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3c067-d1ce-4bd1-a0ed-22f982fc0e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:11.156856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3c067-d1ce-4bd1-a0ed-22f982fc0e5e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:11.157192 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3c067-d1ce-4bd1-a0ed-22f982fc0e5e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:11.158085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3c067-d1ce-4bd1-a0ed-22f982fc0e5e None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:11.158715 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3c067-d1ce-4bd1-a0ed-22f982fc0e5e None admin] RBAC: Adding query filter params (name=member) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:11.159002 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3c067-d1ce-4bd1-a0ed-22f982fc0e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:11.160468 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3c067-d1ce-4bd1-a0ed-22f982fc0e5e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:11.176087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 186/384] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:42:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:11.184708 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8f155-cd30-49df-a892-b79e7f908561 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:11.296827 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:11.331253 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8f155-cd30-49df-a892-b79e7f908561 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:11.391237 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049d8ce-cc15-4899-95ed-e7f421819454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:11.392895 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049d8ce-cc15-4899-95ed-e7f421819454 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:11.393410 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049d8ce-cc15-4899-95ed-e7f421819454 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:11.393922 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049d8ce-cc15-4899-95ed-e7f421819454 None admin] PATH_INFO: `/v3/groups/e1b9f11ad1c44a82b10de08faf70d971` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:11.398226 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049d8ce-cc15-4899-95ed-e7f421819454 None admin] RBAC: Authorizing `identity:get_group(group_id=e1b9f11ad1c44a82b10de08faf70d971)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:11.400184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049d8ce-cc15-4899-95ed-e7f421819454 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:11.402293 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 199/385] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 28 03:42:11 2022] GET /identity/v3/groups/e1b9f11ad1c44a82b10de08faf70d971 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:11.408770 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3c067-d1ce-4bd1-a0ed-22f982fc0e5e None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:11.580344 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3c067-d1ce-4bd1-a0ed-22f982fc0e5e None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:11.632151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e7be8-6ad5-443a-84b9-9b5b53c70cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:11.632716 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e7be8-6ad5-443a-84b9-9b5b53c70cb2 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:11.632998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e7be8-6ad5-443a-84b9-9b5b53c70cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:11.633271 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e7be8-6ad5-443a-84b9-9b5b53c70cb2 None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:11.634489 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e7be8-6ad5-443a-84b9-9b5b53c70cb2 None admin] RBAC: Authorizing `identity:get_project(project_id=856293872ed14cbda37a5830759ee4e7)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:11.635981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e7be8-6ad5-443a-84b9-9b5b53c70cb2 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:11.637650 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 187/386] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:42:11 2022] GET /identity/v3/projects/856293872ed14cbda37a5830759ee4e7 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:11.653144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049d8ce-cc15-4899-95ed-e7f421819454 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:11.894075 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049d8ce-cc15-4899-95ed-e7f421819454 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:11.976737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f5817-c5c4-4039-b6f9-902fd12a4a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:11.977857 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f5817-c5c4-4039-b6f9-902fd12a4a94 None admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:11.978354 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f5817-c5c4-4039-b6f9-902fd12a4a94 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:11.978848 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f5817-c5c4-4039-b6f9-902fd12a4a94 None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7/groups/e1b9f11ad1c44a82b10de08faf70d971/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:11.982401 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f5817-c5c4-4039-b6f9-902fd12a4a94 None admin] RBAC: Authorizing `identity:create_grant(project_id=856293872ed14cbda37a5830759ee4e7, group_id=e1b9f11ad1c44a82b10de08faf70d971, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:11.985117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f5817-c5c4-4039-b6f9-902fd12a4a94 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:12.016141 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61ed7a-cd37-465a-893e-121ba2c26494 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:12.017557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61ed7a-cd37-465a-893e-121ba2c26494 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:12.017893 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61ed7a-cd37-465a-893e-121ba2c26494 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:12.020923 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 188/387] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:42:12.025005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a95aa-e6cf-4f3e-9846-27f5697096d1 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:12.025318 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a95aa-e6cf-4f3e-9846-27f5697096d1 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:12.025553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a95aa-e6cf-4f3e-9846-27f5697096d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:12.047470 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-0d7a95aa-e6cf-4f3e-9846-27f5697096d1 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:12.049570 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-0d7a95aa-e6cf-4f3e-9846-27f5697096d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:12.080886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 200/388] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Jul 28 03:42:11 2022] PUT /identity/v3/projects/856293872ed14cbda37a5830759ee4e7/groups/e1b9f11ad1c44a82b10de08faf70d971/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:42:12.109591 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:12.133267 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 189/389] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:42:12.169721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f5817-c5c4-4039-b6f9-902fd12a4a94 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:12.181417 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:12.382018 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f5817-c5c4-4039-b6f9-902fd12a4a94 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:12.444683 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd55c2-acde-4d3f-8994-7d4336458c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:12.445670 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd55c2-acde-4d3f-8994-7d4336458c54 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:12.446169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd55c2-acde-4d3f-8994-7d4336458c54 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:12.446669 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd55c2-acde-4d3f-8994-7d4336458c54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:12.466006 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd55c2-acde-4d3f-8994-7d4336458c54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:12.477024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-4bfd55c2-acde-4d3f-8994-7d4336458c54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:42:12.477024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:12.477024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:12.477024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:12.477024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:12.477024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:12.477024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:12.477024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:12.477024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:12.477024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:12.477024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:12.477024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:12.477024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:12.477024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:12.477024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:12.477024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:12.477989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:12.477989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:12.477989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:12.477989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:12.477989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:12.477989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:12.477989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:12.477989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:12.477989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:12.477989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:12.477989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:12.477989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:12.477989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:12.477989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:12.477989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:12.477989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:12.478791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:12.478791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:12.478791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:12.478791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:12.478791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:12.478791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:12.478791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:12.478791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:12.478791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:12.478791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:12.478791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:42:12.478791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:12.479935 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 201/390] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:12.489481 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a95aa-e6cf-4f3e-9846-27f5697096d1 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:12.611089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a95aa-e6cf-4f3e-9846-27f5697096d1 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:12.647922 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05ceca-8e72-4c7d-95ed-dfbe25099a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:12.648565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05ceca-8e72-4c7d-95ed-dfbe25099a66 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:12.648847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05ceca-8e72-4c7d-95ed-dfbe25099a66 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:12.649121 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05ceca-8e72-4c7d-95ed-dfbe25099a66 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:12.649845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05ceca-8e72-4c7d-95ed-dfbe25099a66 None admin] RBAC: Adding query filter params (name=member) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:12.650150 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05ceca-8e72-4c7d-95ed-dfbe25099a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:12.651561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05ceca-8e72-4c7d-95ed-dfbe25099a66 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:12.665921 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 190/391] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:42:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:12.667370 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd55c2-acde-4d3f-8994-7d4336458c54 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:12.687073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cb432-0bc3-43ac-a24f-075ac41d5457 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:12.687452 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cb432-0bc3-43ac-a24f-075ac41d5457 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:12.687647 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cb432-0bc3-43ac-a24f-075ac41d5457 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:12.693389 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 191/392] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:42:12.695809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79970818-c482-4ee7-8323-c8979877fd65 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:12.696309 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79970818-c482-4ee7-8323-c8979877fd65 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:12.696781 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79970818-c482-4ee7-8323-c8979877fd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:12.740388 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-79970818-c482-4ee7-8323-c8979877fd65 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:12.742271 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-79970818-c482-4ee7-8323-c8979877fd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:12.751971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:12.799359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd55c2-acde-4d3f-8994-7d4336458c54 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:12.833462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb81e3-c3cb-46f5-a893-55391d056761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:12.834127 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb81e3-c3cb-46f5-a893-55391d056761 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:12.834412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb81e3-c3cb-46f5-a893-55391d056761 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:12.834690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb81e3-c3cb-46f5-a893-55391d056761 None admin] PATH_INFO: `/v3/groups/e1b9f11ad1c44a82b10de08faf70d971` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:12.835895 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb81e3-c3cb-46f5-a893-55391d056761 None admin] RBAC: Authorizing `identity:get_group(group_id=e1b9f11ad1c44a82b10de08faf70d971)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:12.837775 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb81e3-c3cb-46f5-a893-55391d056761 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:12.839570 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 202/393] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 28 03:42:12 2022] GET /identity/v3/groups/e1b9f11ad1c44a82b10de08faf70d971 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:12.853903 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb81e3-c3cb-46f5-a893-55391d056761 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:12.887230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:12.944889 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 192/394] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:12.979298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79970818-c482-4ee7-8323-c8979877fd65 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:13.045524 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb81e3-c3cb-46f5-a893-55391d056761 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:13.114626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79970818-c482-4ee7-8323-c8979877fd65 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:13.129482 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:13.139629 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6e60b-11e1-4ac4-983b-650812cbcf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:13.140295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6e60b-11e1-4ac4-983b-650812cbcf43 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:13.140580 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6e60b-11e1-4ac4-983b-650812cbcf43 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:13.140856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6e60b-11e1-4ac4-983b-650812cbcf43 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:13.143448 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6e60b-11e1-4ac4-983b-650812cbcf43 None admin] RBAC: Authorizing `identity:get_project(project_id=fad2eddcd9204e1e82453c2e4c58edd0)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:13.144919 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6e60b-11e1-4ac4-983b-650812cbcf43 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:13.146621 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 203/395] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:42:12 2022] GET /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:13.152723 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6e60b-11e1-4ac4-983b-650812cbcf43 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:13.181175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcfe61-f985-4795-b0a3-3b23971628c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:13.181850 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcfe61-f985-4795-b0a3-3b23971628c5 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:13.182133 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcfe61-f985-4795-b0a3-3b23971628c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:13.182409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcfe61-f985-4795-b0a3-3b23971628c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:13.210574 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcfe61-f985-4795-b0a3-3b23971628c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:13.223686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-8cbcfe61-f985-4795-b0a3-3b23971628c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:42:13.223686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:13.223686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:13.223686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:13.223686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:13.223686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:13.223686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:13.223686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:13.223686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:13.223686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:13.223686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:13.223686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:13.223686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:13.223686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:13.223686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:13.223686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:13.224614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:13.224614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:13.224614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:13.224614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:13.224614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:13.224614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:13.224614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:13.224614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:13.224614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:13.224614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:13.224614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:13.224614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:13.224614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:13.224614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:13.224614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:13.224614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:13.225401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:13.225401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:13.225401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:13.225401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:13.225401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:13.225401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:13.225401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:13.225401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:13.225401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:13.225401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:13.225401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:42:13.225401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:13.229008 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 193/396] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:42:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:42:13.231029 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcfe61-f985-4795-b0a3-3b23971628c5 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:13.305168 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:13.353763 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6e60b-11e1-4ac4-983b-650812cbcf43 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:13.409133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f27a3-a433-4a2e-bc95-adbaf859f061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:13.409835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f27a3-a433-4a2e-bc95-adbaf859f061 None admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:13.410121 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f27a3-a433-4a2e-bc95-adbaf859f061 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:13.410403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f27a3-a433-4a2e-bc95-adbaf859f061 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0/groups/e1b9f11ad1c44a82b10de08faf70d971/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:13.412445 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f27a3-a433-4a2e-bc95-adbaf859f061 None admin] RBAC: Authorizing `identity:create_grant(project_id=fad2eddcd9204e1e82453c2e4c58edd0, group_id=e1b9f11ad1c44a82b10de08faf70d971, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:13.413911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f27a3-a433-4a2e-bc95-adbaf859f061 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:13.419768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcfe61-f985-4795-b0a3-3b23971628c5 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:13.458845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc9a07-b415-4f5a-85d3-4869bc901ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:13.459567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc9a07-b415-4f5a-85d3-4869bc901ff4 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:13.459858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc9a07-b415-4f5a-85d3-4869bc901ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:13.464929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc9a07-b415-4f5a-85d3-4869bc901ff4 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:13.464929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc9a07-b415-4f5a-85d3-4869bc901ff4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:13.464929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc9a07-b415-4f5a-85d3-4869bc901ff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:13.464929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc9a07-b415-4f5a-85d3-4869bc901ff4 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:13.477582 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 194/397] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:13.477582 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c60b0-1289-4896-be41-eb82888dbffd None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:13.477582 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c60b0-1289-4896-be41-eb82888dbffd None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:13.477582 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c60b0-1289-4896-be41-eb82888dbffd None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:13.477582 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 195/398] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:13.478872 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c60b0-1289-4896-be41-eb82888dbffd None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:13.495695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 204/399] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Jul 28 03:42:13 2022] PUT /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0/groups/e1b9f11ad1c44a82b10de08faf70d971/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:42:13.503372 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1defc-d879-40db-98cc-5b6900b4b2f3 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:13.504020 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1defc-d879-40db-98cc-5b6900b4b2f3 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:13.504804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1defc-d879-40db-98cc-5b6900b4b2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:13.528417 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-2cf1defc-d879-40db-98cc-5b6900b4b2f3 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:13.530365 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-2cf1defc-d879-40db-98cc-5b6900b4b2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:13.639770 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:13.643791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:13.646323 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c60b0-1289-4896-be41-eb82888dbffd None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:13.660547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 205/400] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:13.664534 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eea58-37b0-42d6-b33e-af3a86b13ee3 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:13.665242 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eea58-37b0-42d6-b33e-af3a86b13ee3 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:13.666149 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eea58-37b0-42d6-b33e-af3a86b13ee3 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:13.670625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 206/401] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:13.676789 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa97cbb-c982-4b2e-ad4a-4d2d7c81b553 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:13.677514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa97cbb-c982-4b2e-ad4a-4d2d7c81b553 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:13.678341 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa97cbb-c982-4b2e-ad4a-4d2d7c81b553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:13.699983 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463a460-d81b-49c2-9cd9-4717db1e40db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:13.700876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463a460-d81b-49c2-9cd9-4717db1e40db None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:13.701178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463a460-d81b-49c2-9cd9-4717db1e40db None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:13.701471 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463a460-d81b-49c2-9cd9-4717db1e40db None admin] PATH_INFO: `/v3/groups/e1b9f11ad1c44a82b10de08faf70d971` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:13.702677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-efa97cbb-c982-4b2e-ad4a-4d2d7c81b553 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:13.702797 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463a460-d81b-49c2-9cd9-4717db1e40db None admin] RBAC: Authorizing `identity:get_group(group_id=e1b9f11ad1c44a82b10de08faf70d971)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:13.704485 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-efa97cbb-c982-4b2e-ad4a-4d2d7c81b553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:13.704629 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463a460-d81b-49c2-9cd9-4717db1e40db None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:13.706666 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 196/402] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 28 03:42:13 2022] GET /identity/v3/groups/e1b9f11ad1c44a82b10de08faf70d971 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:13.711789 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463a460-d81b-49c2-9cd9-4717db1e40db None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:13.815730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 207/403] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:42:13.816690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa97cbb-c982-4b2e-ad4a-4d2d7c81b553 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:13.861562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463a460-d81b-49c2-9cd9-4717db1e40db None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:13.899552 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090f998-a7aa-442a-a5c3-622e0727c7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:13.900264 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090f998-a7aa-442a-a5c3-622e0727c7a6 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:13.900552 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090f998-a7aa-442a-a5c3-622e0727c7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:13.900830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090f998-a7aa-442a-a5c3-622e0727c7a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:13.914186 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090f998-a7aa-442a-a5c3-622e0727c7a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:13.920313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-6090f998-a7aa-442a-a5c3-622e0727c7a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:42:13.920313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:13.920313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:13.920313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:13.920313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:13.920313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:13.920313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:13.920313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:13.920313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:13.920313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:13.920313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:13.920313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:13.920313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:13.920313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:13.920313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:13.920313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:13.921292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:13.921292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:13.921292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:13.921292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:13.921292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:13.921292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:13.921292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:13.921292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:13.921292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:13.921292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:13.921292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:13.921292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:13.921292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:13.921292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:13.921292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:13.921292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:13.922182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:13.922182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:13.922182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:13.922182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:13.922182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:13.922182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:13.922182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:13.922182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:13.922182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:13.922182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:13.922182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:42:13.922182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:13.922182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 197/404] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:42:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:13.923435 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090f998-a7aa-442a-a5c3-622e0727c7a6 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:13.934296 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa97cbb-c982-4b2e-ad4a-4d2d7c81b553 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:13.955296 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:13.958105 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:13.973809 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc21eb-10b0-48aa-948e-7b6886c6afbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:13.974623 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc21eb-10b0-48aa-948e-7b6886c6afbf None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:13.974911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc21eb-10b0-48aa-948e-7b6886c6afbf None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:13.975180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc21eb-10b0-48aa-948e-7b6886c6afbf None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:13.976435 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc21eb-10b0-48aa-948e-7b6886c6afbf None admin] RBAC: Authorizing `identity:get_project(project_id=856293872ed14cbda37a5830759ee4e7)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:13.978122 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc21eb-10b0-48aa-948e-7b6886c6afbf None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:13.980461 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 208/405] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:42:13 2022] GET /identity/v3/projects/856293872ed14cbda37a5830759ee4e7 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:13.981382 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc21eb-10b0-48aa-948e-7b6886c6afbf None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:14.039701 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090f998-a7aa-442a-a5c3-622e0727c7a6 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:14.082569 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cd0f1-6b67-4571-9580-e5631a5bdde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:14.083240 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cd0f1-6b67-4571-9580-e5631a5bdde5 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:14.083554 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cd0f1-6b67-4571-9580-e5631a5bdde5 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:14.083836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cd0f1-6b67-4571-9580-e5631a5bdde5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:14.098752 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cd0f1-6b67-4571-9580-e5631a5bdde5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:14.099093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc21eb-10b0-48aa-948e-7b6886c6afbf None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:14.105083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-3d0cd0f1-6b67-4571-9580-e5631a5bdde5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:42:14.105083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:14.105083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:14.105083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:14.105083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:14.105083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:14.105083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:14.105083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:14.105083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:14.105083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:14.105083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:14.105083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:14.105083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:14.105083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:14.105083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:14.105083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:14.107206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:14.107206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:14.107206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:14.107206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:14.107206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:14.107206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:14.107206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:14.107206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:14.107206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:14.107206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:14.107206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:14.107206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:14.107206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:14.107206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:14.107206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:14.107206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:14.108362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:14.108362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:14.108362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:14.108362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:14.108362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:14.108362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:14.108362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:14.108362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:14.108362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:14.108362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:14.108362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:42:14.108362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:14.108362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 198/406] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:42:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:14.114756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cd0f1-6b67-4571-9580-e5631a5bdde5 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:14.159537 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b63ecb-047a-485c-b92e-2e3259136f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:14.160336 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b63ecb-047a-485c-b92e-2e3259136f4b None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:14.160721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b63ecb-047a-485c-b92e-2e3259136f4b None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:14.161102 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b63ecb-047a-485c-b92e-2e3259136f4b None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:14.161940 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b63ecb-047a-485c-b92e-2e3259136f4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:14.162993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b63ecb-047a-485c-b92e-2e3259136f4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:14.165173 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b63ecb-047a-485c-b92e-2e3259136f4b None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:14.178784 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 209/407] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:14.180082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b63ecb-047a-485c-b92e-2e3259136f4b None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:14.221036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:14.238199 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cd0f1-6b67-4571-9580-e5631a5bdde5 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:14.246536 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:14.277526 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f108b3-7e5f-4d4b-ada4-c5d6833f56dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:14.278399 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f108b3-7e5f-4d4b-ada4-c5d6833f56dd None admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:14.278516 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f108b3-7e5f-4d4b-ada4-c5d6833f56dd None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:14.278762 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f108b3-7e5f-4d4b-ada4-c5d6833f56dd None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7/groups/e1b9f11ad1c44a82b10de08faf70d971/roles/81c955f5702546679605b5484602ae69` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:14.281466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f108b3-7e5f-4d4b-ada4-c5d6833f56dd None admin] RBAC: Authorizing `identity:create_grant(project_id=856293872ed14cbda37a5830759ee4e7, group_id=e1b9f11ad1c44a82b10de08faf70d971, role_id=81c955f5702546679605b5484602ae69)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:14.283796 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f108b3-7e5f-4d4b-ada4-c5d6833f56dd None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:14.305545 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b63ecb-047a-485c-b92e-2e3259136f4b None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:14.365231 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a027d9-70d5-4fa8-b11b-2c37126de46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:14.365790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a027d9-70d5-4fa8-b11b-2c37126de46f None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:14.366079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a027d9-70d5-4fa8-b11b-2c37126de46f None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:14.366359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a027d9-70d5-4fa8-b11b-2c37126de46f None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:14.367159 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a027d9-70d5-4fa8-b11b-2c37126de46f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:14.367508 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a027d9-70d5-4fa8-b11b-2c37126de46f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:14.373252 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a027d9-70d5-4fa8-b11b-2c37126de46f None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:14.373389 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 199/408] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Jul 28 03:42:14 2022] PUT /identity/v3/projects/856293872ed14cbda37a5830759ee4e7/groups/e1b9f11ad1c44a82b10de08faf70d971/roles/81c955f5702546679605b5484602ae69 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:42:14.373389 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f108b3-7e5f-4d4b-ada4-c5d6833f56dd None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:14.389900 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 210/409] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:14.395697 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a027d9-70d5-4fa8-b11b-2c37126de46f None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:14.514127 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f108b3-7e5f-4d4b-ada4-c5d6833f56dd None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:14.562984 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfaa4c-140d-4395-a8f7-c0c34763fd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:14.564119 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfaa4c-140d-4395-a8f7-c0c34763fd93 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:14.564624 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfaa4c-140d-4395-a8f7-c0c34763fd93 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:14.565098 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfaa4c-140d-4395-a8f7-c0c34763fd93 None admin] PATH_INFO: `/v3/groups/f8bc3aeb2e3244c8a8e872b9b586fddd` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:14.566620 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfaa4c-140d-4395-a8f7-c0c34763fd93 None admin] RBAC: Authorizing `identity:get_group(group_id=f8bc3aeb2e3244c8a8e872b9b586fddd)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:14.569054 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfaa4c-140d-4395-a8f7-c0c34763fd93 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:14.573836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 200/410] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 28 03:42:14 2022] GET /identity/v3/groups/f8bc3aeb2e3244c8a8e872b9b586fddd => generated 229 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:14.579858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfaa4c-140d-4395-a8f7-c0c34763fd93 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:14.607736 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:14.611870 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a027d9-70d5-4fa8-b11b-2c37126de46f None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:14.627872 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:14.650525 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8902449-f535-41b1-866b-703194cb69e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:14.651193 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8902449-f535-41b1-866b-703194cb69e6 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:14.651509 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8902449-f535-41b1-866b-703194cb69e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:14.656350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8902449-f535-41b1-866b-703194cb69e6 None admin] PATH_INFO: `/v3/groups/e1b9f11ad1c44a82b10de08faf70d971` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:14.656350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8902449-f535-41b1-866b-703194cb69e6 None admin] RBAC: Authorizing `identity:get_group(group_id=e1b9f11ad1c44a82b10de08faf70d971)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:14.656350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8902449-f535-41b1-866b-703194cb69e6 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:14.657916 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 211/411] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 28 03:42:14 2022] GET /identity/v3/groups/e1b9f11ad1c44a82b10de08faf70d971 => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:14.664039 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8902449-f535-41b1-866b-703194cb69e6 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:14.704347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfaa4c-140d-4395-a8f7-c0c34763fd93 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:14.748722 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0da858-82a8-4587-b4e6-2c4339afc5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:14.750225 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0da858-82a8-4587-b4e6-2c4339afc5ce None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:14.750660 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0da858-82a8-4587-b4e6-2c4339afc5ce None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:14.751273 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0da858-82a8-4587-b4e6-2c4339afc5ce None admin] PATH_INFO: `/v3/projects/7ea31e38f3a74a13b1debf11d300a6d6` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:14.753089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0da858-82a8-4587-b4e6-2c4339afc5ce None admin] RBAC: Authorizing `identity:get_project(project_id=7ea31e38f3a74a13b1debf11d300a6d6)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:14.755453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0da858-82a8-4587-b4e6-2c4339afc5ce None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:14.758322 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 201/412] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:42:14 2022] GET /identity/v3/projects/7ea31e38f3a74a13b1debf11d300a6d6 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:14.764234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0da858-82a8-4587-b4e6-2c4339afc5ce None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:14.797226 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8902449-f535-41b1-866b-703194cb69e6 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:14.834505 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a5367-0dd5-4f96-a141-81e34d857c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:14.835351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a5367-0dd5-4f96-a141-81e34d857c57 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:14.835855 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a5367-0dd5-4f96-a141-81e34d857c57 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:14.835855 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a5367-0dd5-4f96-a141-81e34d857c57 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:14.837136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a5367-0dd5-4f96-a141-81e34d857c57 None admin] RBAC: Authorizing `identity:get_project(project_id=fad2eddcd9204e1e82453c2e4c58edd0)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:14.838713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a5367-0dd5-4f96-a141-81e34d857c57 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:14.841176 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 212/413] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:42:14 2022] GET /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:14.842438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff0569-4db2-4ca7-a60b-ed67707d0117 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:14.849425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff0569-4db2-4ca7-a60b-ed67707d0117 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:14.849425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff0569-4db2-4ca7-a60b-ed67707d0117 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:14.849425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 213/414] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:14.857156 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe817ae0-bad4-41b4-a44f-13fdc4ac4f75 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:14.857448 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe817ae0-bad4-41b4-a44f-13fdc4ac4f75 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:14.857738 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe817ae0-bad4-41b4-a44f-13fdc4ac4f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:14.869781 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:14.879439 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-fe817ae0-bad4-41b4-a44f-13fdc4ac4f75 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:14.880627 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-fe817ae0-bad4-41b4-a44f-13fdc4ac4f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:14.890385 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0da858-82a8-4587-b4e6-2c4339afc5ce None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:14.933902 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca987b30-c15b-4afd-addf-7d25b9c667d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:14.935296 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca987b30-c15b-4afd-addf-7d25b9c667d4 None admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:14.935904 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca987b30-c15b-4afd-addf-7d25b9c667d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:14.936485 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca987b30-c15b-4afd-addf-7d25b9c667d4 None admin] PATH_INFO: `/v3/projects/7ea31e38f3a74a13b1debf11d300a6d6/groups/f8bc3aeb2e3244c8a8e872b9b586fddd/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:14.939735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:14.940206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca987b30-c15b-4afd-addf-7d25b9c667d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ea31e38f3a74a13b1debf11d300a6d6, group_id=f8bc3aeb2e3244c8a8e872b9b586fddd, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:14.942230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca987b30-c15b-4afd-addf-7d25b9c667d4 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:14.975364 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 214/415] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:14.975364 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe817ae0-bad4-41b4-a44f-13fdc4ac4f75 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:15.029469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 202/416] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Jul 28 03:42:14 2022] PUT /identity/v3/projects/7ea31e38f3a74a13b1debf11d300a6d6/groups/f8bc3aeb2e3244c8a8e872b9b586fddd/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:42:15.030354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca987b30-c15b-4afd-addf-7d25b9c667d4 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:15.156499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe817ae0-bad4-41b4-a44f-13fdc4ac4f75 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:15.220929 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2ab64-b60d-4b98-9af5-07444bca2193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:15.221547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2ab64-b60d-4b98-9af5-07444bca2193 None admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:15.221835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2ab64-b60d-4b98-9af5-07444bca2193 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:15.222109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2ab64-b60d-4b98-9af5-07444bca2193 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0/groups/e1b9f11ad1c44a82b10de08faf70d971/roles/81c955f5702546679605b5484602ae69` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:15.231581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2ab64-b60d-4b98-9af5-07444bca2193 None admin] RBAC: Authorizing `identity:create_grant(project_id=fad2eddcd9204e1e82453c2e4c58edd0, group_id=e1b9f11ad1c44a82b10de08faf70d971, role_id=81c955f5702546679605b5484602ae69)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:15.233086 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2ab64-b60d-4b98-9af5-07444bca2193 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:15.253211 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca987b30-c15b-4afd-addf-7d25b9c667d4 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:15.294136 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bd487-71cf-4e97-b5d1-3f8051aff61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:15.294904 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bd487-71cf-4e97-b5d1-3f8051aff61e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:15.295187 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bd487-71cf-4e97-b5d1-3f8051aff61e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:15.295493 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bd487-71cf-4e97-b5d1-3f8051aff61e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:15.312576 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bd487-71cf-4e97-b5d1-3f8051aff61e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:15.320299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-769bd487-71cf-4e97-b5d1-3f8051aff61e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:42:15.320299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:15.320299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:15.320299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:15.320299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:15.320299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:15.320299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:15.320299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:15.320299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:15.320299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:15.320299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:15.320299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:15.320299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:15.320299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:15.320299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:15.320299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:15.321299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:15.321299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:15.321299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:15.321299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:15.321299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:15.321299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:15.321299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:15.321299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:15.321299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:15.321299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:15.321299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:15.321299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:15.321299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:15.321299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:15.321299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:15.321299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:15.322158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:15.322158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:15.322158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:15.322158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:15.322158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:15.322158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:15.322158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:15.322158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:15.322158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:15.322158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:15.322158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:42:15.322158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:15.324940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 203/417] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:15.335741 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 215/418] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Jul 28 03:42:14 2022] PUT /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0/groups/e1b9f11ad1c44a82b10de08faf70d971/roles/81c955f5702546679605b5484602ae69 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:42:15.337135 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bd487-71cf-4e97-b5d1-3f8051aff61e None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:15.341197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:15.502411 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bd487-71cf-4e97-b5d1-3f8051aff61e None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:15.540804 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073edd6d-9d40-4acd-a928-849e632fbb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:15.541781 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073edd6d-9d40-4acd-a928-849e632fbb68 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:15.542242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073edd6d-9d40-4acd-a928-849e632fbb68 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:15.542702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073edd6d-9d40-4acd-a928-849e632fbb68 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:15.543658 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073edd6d-9d40-4acd-a928-849e632fbb68 None admin] RBAC: Adding query filter params (name=member) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:15.544144 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073edd6d-9d40-4acd-a928-849e632fbb68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:15.545756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073edd6d-9d40-4acd-a928-849e632fbb68 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:15.555693 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 204/419] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:42:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:15.561123 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2ab64-b60d-4b98-9af5-07444bca2193 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:15.634761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:15.731774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2ab64-b60d-4b98-9af5-07444bca2193 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:15.781090 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52efe0d-f17c-4029-9e8e-7e409035f0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:15.781655 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52efe0d-f17c-4029-9e8e-7e409035f0ff None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:15.781965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52efe0d-f17c-4029-9e8e-7e409035f0ff None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:15.782242 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52efe0d-f17c-4029-9e8e-7e409035f0ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:15.861601 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52efe0d-f17c-4029-9e8e-7e409035f0ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:15.863108 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52efe0d-f17c-4029-9e8e-7e409035f0ff None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:15.908079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:15.974876 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 216/420] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:15.980739 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073edd6d-9d40-4acd-a928-849e632fbb68 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:16.088844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:16.095216 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fed01-c153-4c5f-ab22-19cda1ae46ea None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:16.095655 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fed01-c153-4c5f-ab22-19cda1ae46ea None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:16.096088 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fed01-c153-4c5f-ab22-19cda1ae46ea None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:16.097721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 217/421] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:16.103550 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb261ba-6000-4876-a55d-c4dc5354ab98 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:16.103932 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb261ba-6000-4876-a55d-c4dc5354ab98 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:16.104219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb261ba-6000-4876-a55d-c4dc5354ab98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:16.122990 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-bdb261ba-6000-4876-a55d-c4dc5354ab98 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:16.124292 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-bdb261ba-6000-4876-a55d-c4dc5354ab98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:16.159760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073edd6d-9d40-4acd-a928-849e632fbb68 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:16.211528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 218/422] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:42:16.231501 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb261ba-6000-4876-a55d-c4dc5354ab98 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:16.237660 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ee4d2-6f4b-4be2-89f8-e5d622aa794f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:16.238349 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ee4d2-6f4b-4be2-89f8-e5d622aa794f None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:16.238627 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ee4d2-6f4b-4be2-89f8-e5d622aa794f None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:16.238903 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ee4d2-6f4b-4be2-89f8-e5d622aa794f None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:16.241560 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ee4d2-6f4b-4be2-89f8-e5d622aa794f None admin] RBAC: Authorizing `identity:get_project(project_id=856293872ed14cbda37a5830759ee4e7)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:16.243216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ee4d2-6f4b-4be2-89f8-e5d622aa794f None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:16.245371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 205/423] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:42:15 2022] GET /identity/v3/projects/856293872ed14cbda37a5830759ee4e7 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:16.252809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ee4d2-6f4b-4be2-89f8-e5d622aa794f None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:16.340054 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:16.409824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb261ba-6000-4876-a55d-c4dc5354ab98 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:16.444441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ee4d2-6f4b-4be2-89f8-e5d622aa794f None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:16.482872 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892acbc-146b-4f27-a442-63fe09cc1909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:16.483627 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892acbc-146b-4f27-a442-63fe09cc1909 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:16.483923 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892acbc-146b-4f27-a442-63fe09cc1909 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:16.484202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892acbc-146b-4f27-a442-63fe09cc1909 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:16.498365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:16.507960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a32c4-1e65-4dd1-9d62-98380705789b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:16.508872 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892acbc-146b-4f27-a442-63fe09cc1909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:16.509116 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a32c4-1e65-4dd1-9d62-98380705789b None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:16.509608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a32c4-1e65-4dd1-9d62-98380705789b None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:16.510076 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a32c4-1e65-4dd1-9d62-98380705789b None admin] PATH_INFO: `/v3/groups/e1b9f11ad1c44a82b10de08faf70d971` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:16.519433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-0892acbc-146b-4f27-a442-63fe09cc1909 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:42:16.519433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:16.519433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:16.519433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:16.519433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:16.519433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:16.519433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:16.519433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:16.519433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:16.519433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:16.519433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:16.519433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:16.519433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:16.519433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:16.519433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:16.519433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:16.520350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:16.520350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:16.520350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:16.520350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:16.520350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:16.520350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:16.520350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:16.520350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:16.520350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:16.520350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:16.520350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:16.520350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:16.520350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:16.520350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:16.520350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:16.520350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:16.521136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:16.521136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:16.521136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:16.521136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:16.521136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:16.521136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:16.521136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:16.521136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:16.521136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:16.521136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:16.521136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 03:42:16.521136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:16.521733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 219/424] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:42:16.522123 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a32c4-1e65-4dd1-9d62-98380705789b None admin] RBAC: Authorizing `identity:get_group(group_id=e1b9f11ad1c44a82b10de08faf70d971)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:16.523174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892acbc-146b-4f27-a442-63fe09cc1909 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:16.523923 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a32c4-1e65-4dd1-9d62-98380705789b None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:16.525971 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 206/425] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 28 03:42:16 2022] GET /identity/v3/groups/e1b9f11ad1c44a82b10de08faf70d971 => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:16.536359 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a32c4-1e65-4dd1-9d62-98380705789b None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:16.711582 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892acbc-146b-4f27-a442-63fe09cc1909 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:16.732313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a32c4-1e65-4dd1-9d62-98380705789b None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:16.775233 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:16.809779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9a67f-e114-4f5c-9694-19e3e15cdbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:16.810436 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9a67f-e114-4f5c-9694-19e3e15cdbe4 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:16.810723 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9a67f-e114-4f5c-9694-19e3e15cdbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:16.811059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9a67f-e114-4f5c-9694-19e3e15cdbe4 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:16.811705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29d8f0-7d84-4fc6-bdf1-ce00a63b963e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:16.811838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9a67f-e114-4f5c-9694-19e3e15cdbe4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:16.812065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9a67f-e114-4f5c-9694-19e3e15cdbe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:16.812330 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29d8f0-7d84-4fc6-bdf1-ce00a63b963e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:16.812609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29d8f0-7d84-4fc6-bdf1-ce00a63b963e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:16.812879 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29d8f0-7d84-4fc6-bdf1-ce00a63b963e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:16.813497 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9a67f-e114-4f5c-9694-19e3e15cdbe4 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:16.813748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29d8f0-7d84-4fc6-bdf1-ce00a63b963e None admin] RBAC: Adding query filter params (group.id=e1b9f11ad1c44a82b10de08faf70d971, role.id=43f173da338d498382fba44911238254, scope.project.id=856293872ed14cbda37a5830759ee4e7) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:16.814057 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29d8f0-7d84-4fc6-bdf1-ce00a63b963e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:16.815736 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29d8f0-7d84-4fc6-bdf1-ce00a63b963e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:16.822899 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 207/426] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 28 03:42:16 2022] GET /identity/v3/role_assignments?group.id=e1b9f11ad1c44a82b10de08faf70d971&scope.project.id=856293872ed14cbda37a5830759ee4e7&role.id=43f173da338d498382fba44911238254 => generated 611 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:16.846438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 220/427] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:42:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:16.852343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29d8f0-7d84-4fc6-bdf1-ce00a63b963e None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:16.972789 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:17.031236 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29d8f0-7d84-4fc6-bdf1-ce00a63b963e None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:17.067020 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135e1d9-634b-41de-9b76-c8bb0ba52cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:17.067935 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135e1d9-634b-41de-9b76-c8bb0ba52cd8 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:17.068365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135e1d9-634b-41de-9b76-c8bb0ba52cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:17.068812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135e1d9-634b-41de-9b76-c8bb0ba52cd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:17.118853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db86353-77f6-42c3-9dc0-044b5eeb17fd None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:17.119172 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db86353-77f6-42c3-9dc0-044b5eeb17fd None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:17.119447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db86353-77f6-42c3-9dc0-044b5eeb17fd None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:17.124792 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 221/428] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:17.126252 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb76411-03f4-47bf-8500-9faa1f9bd953 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:17.126549 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb76411-03f4-47bf-8500-9faa1f9bd953 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:17.126829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb76411-03f4-47bf-8500-9faa1f9bd953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:17.150190 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135e1d9-634b-41de-9b76-c8bb0ba52cd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:17.152044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135e1d9-634b-41de-9b76-c8bb0ba52cd8 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:17.166652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-deb76411-03f4-47bf-8500-9faa1f9bd953 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:17.168305 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-deb76411-03f4-47bf-8500-9faa1f9bd953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:17.234160 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:17.269778 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 222/429] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:17.288131 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 208/430] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:17.293470 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb76411-03f4-47bf-8500-9faa1f9bd953 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:17.299567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135e1d9-634b-41de-9b76-c8bb0ba52cd8 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:17.425026 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135e1d9-634b-41de-9b76-c8bb0ba52cd8 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:17.429543 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb76411-03f4-47bf-8500-9faa1f9bd953 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:17.456743 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:17.463618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9797cbd-31dd-4156-bdd8-b6698112c4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:17.466248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9797cbd-31dd-4156-bdd8-b6698112c4e8 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:17.467717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9797cbd-31dd-4156-bdd8-b6698112c4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:17.467717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9797cbd-31dd-4156-bdd8-b6698112c4e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:17.476624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7615f65-d810-42b6-8655-69c79f3da243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:17.477289 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7615f65-d810-42b6-8655-69c79f3da243 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:17.477569 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7615f65-d810-42b6-8655-69c79f3da243 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:17.478039 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7615f65-d810-42b6-8655-69c79f3da243 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:17.479413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7615f65-d810-42b6-8655-69c79f3da243 None admin] RBAC: Authorizing `identity:get_project(project_id=fad2eddcd9204e1e82453c2e4c58edd0)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:17.480152 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9797cbd-31dd-4156-bdd8-b6698112c4e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:17.481165 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7615f65-d810-42b6-8655-69c79f3da243 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:17.483391 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 223/431] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:42:17 2022] GET /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:17.484776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932e7ba-74c9-4a51-9342-f2263d7b6d43 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:17.485841 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932e7ba-74c9-4a51-9342-f2263d7b6d43 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:17.486252 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932e7ba-74c9-4a51-9342-f2263d7b6d43 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:17.487087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-c9797cbd-31dd-4156-bdd8-b6698112c4e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:42:17.487087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:17.487087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:17.487087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:17.487087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:17.487087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:17.487087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:17.487087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:17.487087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:17.487087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:17.487087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:17.487087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:17.487087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:17.487087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:17.487087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:17.487087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:17.488094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:17.488094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:17.488094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:17.488094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:17.488094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:17.488094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:17.488094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:17.488094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:17.488094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:17.488094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:17.488094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:17.488094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:17.488094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:17.488094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:17.488094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:17.488094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:17.489006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:17.489006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:17.489006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:17.489006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:17.489006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:17.489006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:17.489006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:17.489006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:17.489006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:17.489006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:17.489006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:42:17.489006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:17.489620 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 209/432] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:42:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:42:17.490620 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9797cbd-31dd-4156-bdd8-b6698112c4e8 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:17.490917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 224/433] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:17.495583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932e7ba-74c9-4a51-9342-f2263d7b6d43 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:17.525230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:17.621498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9797cbd-31dd-4156-bdd8-b6698112c4e8 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:17.632721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932e7ba-74c9-4a51-9342-f2263d7b6d43 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:17.658815 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a7660-cdf8-47a1-99b9-fa06027abfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:17.659524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a7660-cdf8-47a1-99b9-fa06027abfa4 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:17.659805 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a7660-cdf8-47a1-99b9-fa06027abfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:17.660097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a7660-cdf8-47a1-99b9-fa06027abfa4 None admin] PATH_INFO: `/v3/groups/e1b9f11ad1c44a82b10de08faf70d971` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:17.661485 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a7660-cdf8-47a1-99b9-fa06027abfa4 None admin] RBAC: Authorizing `identity:get_group(group_id=e1b9f11ad1c44a82b10de08faf70d971)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:17.662949 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a7660-cdf8-47a1-99b9-fa06027abfa4 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:17.664586 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 210/434] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 28 03:42:17 2022] GET /identity/v3/groups/e1b9f11ad1c44a82b10de08faf70d971 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:17.665945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0c858-5cf4-4f35-978a-37964fde632a None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:17.666229 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0c858-5cf4-4f35-978a-37964fde632a None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:17.666501 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0c858-5cf4-4f35-978a-37964fde632a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:17.677348 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae12d10-5a81-41aa-b304-856d127bac05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:17.677982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae12d10-5a81-41aa-b304-856d127bac05 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:17.678265 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae12d10-5a81-41aa-b304-856d127bac05 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:17.678537 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae12d10-5a81-41aa-b304-856d127bac05 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:17.679265 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae12d10-5a81-41aa-b304-856d127bac05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:17.679927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae12d10-5a81-41aa-b304-856d127bac05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:17.680995 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae12d10-5a81-41aa-b304-856d127bac05 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:17.686222 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-f8b0c858-5cf4-4f35-978a-37964fde632a None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:17.687955 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f8b0c858-5cf4-4f35-978a-37964fde632a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:17.689730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 225/435] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:17.695240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae12d10-5a81-41aa-b304-856d127bac05 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:17.751669 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:17.771382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 211/436] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:17.771382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0c858-5cf4-4f35-978a-37964fde632a None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:17.792394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:17.833248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae12d10-5a81-41aa-b304-856d127bac05 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:17.872154 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716873f4-5590-4f95-b509-a183d436b8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:17.873142 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716873f4-5590-4f95-b509-a183d436b8cd None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:17.873642 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716873f4-5590-4f95-b509-a183d436b8cd None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:17.874066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716873f4-5590-4f95-b509-a183d436b8cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:17.875012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716873f4-5590-4f95-b509-a183d436b8cd None admin] RBAC: Adding query filter params (group.id=e1b9f11ad1c44a82b10de08faf70d971, role.id=43f173da338d498382fba44911238254, scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:17.875502 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716873f4-5590-4f95-b509-a183d436b8cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:17.876366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0c858-5cf4-4f35-978a-37964fde632a None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:17.877541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716873f4-5590-4f95-b509-a183d436b8cd None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:17.884225 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 226/437] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 28 03:42:17 2022] GET /identity/v3/role_assignments?group.id=e1b9f11ad1c44a82b10de08faf70d971&scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0&role.id=43f173da338d498382fba44911238254 => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:17.885236 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716873f4-5590-4f95-b509-a183d436b8cd None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:17.928446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4db47-9832-4276-b4eb-cb66b58aedbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:17.929674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4db47-9832-4276-b4eb-cb66b58aedbd None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:17.930268 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4db47-9832-4276-b4eb-cb66b58aedbd None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:17.930554 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4db47-9832-4276-b4eb-cb66b58aedbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:18.012884 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716873f4-5590-4f95-b509-a183d436b8cd None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:18.017351 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4db47-9832-4276-b4eb-cb66b58aedbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:18.018864 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4db47-9832-4276-b4eb-cb66b58aedbd None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:18.028184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:18.046512 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:18.054816 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8c6c1-a07f-4fed-ae36-2d18ec6a154e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:18.055511 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8c6c1-a07f-4fed-ae36-2d18ec6a154e None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:18.055801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8c6c1-a07f-4fed-ae36-2d18ec6a154e None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:18.056080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8c6c1-a07f-4fed-ae36-2d18ec6a154e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:18.079140 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8c6c1-a07f-4fed-ae36-2d18ec6a154e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:18.084773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-b6d8c6c1-a07f-4fed-ae36-2d18ec6a154e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:42:18.084773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:18.084773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:18.084773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:18.084773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:18.084773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:18.084773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:18.084773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:18.084773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:18.084773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:18.084773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:18.084773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:18.084773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:18.084773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:18.084773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:18.084773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:18.085906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:18.085906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:18.085906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:18.085906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:18.085906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:18.085906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:18.085906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:18.085906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:18.085906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:18.085906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:18.085906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:18.085906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:18.085906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:18.085906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:18.085906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:18.085906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:18.086850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:18.086850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:18.086850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:18.086850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:18.086850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:18.086850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:18.086850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:18.086850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:18.086850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:18.086850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:18.086850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:42:18.086850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:18.088900 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 227/438] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:42:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:18.090389 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ee08f-1058-491b-8c1a-5ee1478cbc05 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:18.090846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ee08f-1058-491b-8c1a-5ee1478cbc05 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:18.091300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ee08f-1058-491b-8c1a-5ee1478cbc05 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:18.092992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 228/439] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:18.095356 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ee08f-1058-491b-8c1a-5ee1478cbc05 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:18.142217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 212/440] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:18.143520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065873f-ebbf-489c-8732-1d4797d2ed25 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:18.143808 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065873f-ebbf-489c-8732-1d4797d2ed25 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:18.144082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065873f-ebbf-489c-8732-1d4797d2ed25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:18.163753 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-0065873f-ebbf-489c-8732-1d4797d2ed25 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:18.164979 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-0065873f-ebbf-489c-8732-1d4797d2ed25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:18.205182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ee08f-1058-491b-8c1a-5ee1478cbc05 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:18.232495 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 213/441] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:18.233355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065873f-ebbf-489c-8732-1d4797d2ed25 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:18.243365 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e403e5-7dae-47c8-b996-037d0337e7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:18.244002 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e403e5-7dae-47c8-b996-037d0337e7da None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:18.244285 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e403e5-7dae-47c8-b996-037d0337e7da None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:18.244903 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e403e5-7dae-47c8-b996-037d0337e7da None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:18.245645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e403e5-7dae-47c8-b996-037d0337e7da None admin] RBAC: Adding query filter params (name=admin) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:18.245955 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e403e5-7dae-47c8-b996-037d0337e7da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:18.247945 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e403e5-7dae-47c8-b996-037d0337e7da None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:18.259826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 229/442] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:18.260542 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e403e5-7dae-47c8-b996-037d0337e7da None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:18.289477 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:18.295535 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:18.341123 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065873f-ebbf-489c-8732-1d4797d2ed25 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:18.372982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e403e5-7dae-47c8-b996-037d0337e7da None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:18.378401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727da35d-f432-40a4-9fed-9a2cdef55156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:18.379058 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727da35d-f432-40a4-9fed-9a2cdef55156 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:18.379363 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727da35d-f432-40a4-9fed-9a2cdef55156 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:18.379646 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727da35d-f432-40a4-9fed-9a2cdef55156 None admin] PATH_INFO: `/v3/projects/856293872ed14cbda37a5830759ee4e7` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:18.380905 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727da35d-f432-40a4-9fed-9a2cdef55156 None admin] RBAC: Authorizing `identity:get_project(project_id=856293872ed14cbda37a5830759ee4e7)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:18.382350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727da35d-f432-40a4-9fed-9a2cdef55156 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:18.384060 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 214/443] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:42:18 2022] GET /identity/v3/projects/856293872ed14cbda37a5830759ee4e7 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:18.384833 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727da35d-f432-40a4-9fed-9a2cdef55156 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:18.418216 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4887ad8-10a7-4c7c-82f5-3776fabbdf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:18.418711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4887ad8-10a7-4c7c-82f5-3776fabbdf5c None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:18.418862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4887ad8-10a7-4c7c-82f5-3776fabbdf5c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:18.419142 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4887ad8-10a7-4c7c-82f5-3776fabbdf5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:18.430486 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4887ad8-10a7-4c7c-82f5-3776fabbdf5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:18.435205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-d4887ad8-10a7-4c7c-82f5-3776fabbdf5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:42:18.435205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:18.435205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:18.435205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:18.435205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:18.435205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:18.435205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:18.435205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:18.435205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:18.435205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:18.435205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:18.435205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:18.435205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:18.435205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:18.435205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:18.435205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:18.436124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:18.436124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:18.436124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:18.436124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:18.436124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:18.436124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:18.436124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:18.436124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:18.436124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:18.436124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:18.436124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:18.436124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:18.436124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:18.436124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:18.436124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:18.436124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:18.436902 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:18.436902 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:18.436902 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:18.436902 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:18.436902 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:18.436902 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:18.436902 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:18.436902 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:18.436902 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:18.436902 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:18.436902 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:42:18.436902 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:18.436902 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 230/444] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:42:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:18.437563 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4887ad8-10a7-4c7c-82f5-3776fabbdf5c None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:18.491986 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727da35d-f432-40a4-9fed-9a2cdef55156 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:18.513386 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:18.527480 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13487c44-c341-40f0-9f47-24476732039e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:18.528117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13487c44-c341-40f0-9f47-24476732039e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:18.528499 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13487c44-c341-40f0-9f47-24476732039e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:18.528744 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13487c44-c341-40f0-9f47-24476732039e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:18.540352 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:18.546090 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4887ad8-10a7-4c7c-82f5-3776fabbdf5c None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:18.583791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd67fda-574b-44c2-9ab0-9bf5f33b8161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:18.584431 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd67fda-574b-44c2-9ab0-9bf5f33b8161 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:18.584691 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd67fda-574b-44c2-9ab0-9bf5f33b8161 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:18.584963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd67fda-574b-44c2-9ab0-9bf5f33b8161 None admin] PATH_INFO: `/v3/groups/e1b9f11ad1c44a82b10de08faf70d971` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:18.586132 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd67fda-574b-44c2-9ab0-9bf5f33b8161 None admin] RBAC: Authorizing `identity:get_group(group_id=e1b9f11ad1c44a82b10de08faf70d971)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:18.587613 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd67fda-574b-44c2-9ab0-9bf5f33b8161 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:18.589200 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 231/445] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 28 03:42:18 2022] GET /identity/v3/groups/e1b9f11ad1c44a82b10de08faf70d971 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:18.589961 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd67fda-574b-44c2-9ab0-9bf5f33b8161 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:18.607889 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13487c44-c341-40f0-9f47-24476732039e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:18.609400 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13487c44-c341-40f0-9f47-24476732039e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:18.697459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd67fda-574b-44c2-9ab0-9bf5f33b8161 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:18.718512 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 215/446] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:18.720490 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13487c44-c341-40f0-9f47-24476732039e None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:18.736223 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a72b8-8d99-4562-b667-ac2a564b66d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:18.736852 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a72b8-8d99-4562-b667-ac2a564b66d4 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:18.737145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a72b8-8d99-4562-b667-ac2a564b66d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:18.737407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a72b8-8d99-4562-b667-ac2a564b66d4 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:18.738129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a72b8-8d99-4562-b667-ac2a564b66d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:18.738427 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a72b8-8d99-4562-b667-ac2a564b66d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:18.740134 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a72b8-8d99-4562-b667-ac2a564b66d4 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:18.744361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:18.748476 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 232/447] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:18.749357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a72b8-8d99-4562-b667-ac2a564b66d4 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:18.786146 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:18.848133 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13487c44-c341-40f0-9f47-24476732039e None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:18.867934 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a72b8-8d99-4562-b667-ac2a564b66d4 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:18.884545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff1d42-e5de-4538-b293-cfbc538b616a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:18.885175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff1d42-e5de-4538-b293-cfbc538b616a None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:18.885450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff1d42-e5de-4538-b293-cfbc538b616a None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:18.885721 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff1d42-e5de-4538-b293-cfbc538b616a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:18.886509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff1d42-e5de-4538-b293-cfbc538b616a None admin] RBAC: Adding query filter params (group.id=e1b9f11ad1c44a82b10de08faf70d971, role.id=81c955f5702546679605b5484602ae69, scope.project.id=856293872ed14cbda37a5830759ee4e7) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:18.886812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff1d42-e5de-4538-b293-cfbc538b616a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:18.888275 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff1d42-e5de-4538-b293-cfbc538b616a None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:18.894462 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 216/448] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 28 03:42:18 2022] GET /identity/v3/role_assignments?group.id=e1b9f11ad1c44a82b10de08faf70d971&scope.project.id=856293872ed14cbda37a5830759ee4e7&role.id=81c955f5702546679605b5484602ae69 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:18.895255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff1d42-e5de-4538-b293-cfbc538b616a None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:18.912279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd2bf7-a240-4d86-9d9e-1885f6f62446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:18.912853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd2bf7-a240-4d86-9d9e-1885f6f62446 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:18.913137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd2bf7-a240-4d86-9d9e-1885f6f62446 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:18.913414 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd2bf7-a240-4d86-9d9e-1885f6f62446 None admin] PATH_INFO: `/v3/projects/7ea31e38f3a74a13b1debf11d300a6d6` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:18.914807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd2bf7-a240-4d86-9d9e-1885f6f62446 None admin] RBAC: Authorizing `identity:get_project(project_id=7ea31e38f3a74a13b1debf11d300a6d6)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:18.916342 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd2bf7-a240-4d86-9d9e-1885f6f62446 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:18.924701 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 233/449] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:42:18 2022] GET /identity/v3/projects/7ea31e38f3a74a13b1debf11d300a6d6 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:18.925330 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd2bf7-a240-4d86-9d9e-1885f6f62446 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:19.012566 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:19.049793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff1d42-e5de-4538-b293-cfbc538b616a None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:19.068166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:19.078937 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd2bf7-a240-4d86-9d9e-1885f6f62446 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:19.098822 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f96bf-db43-4e98-818a-b83876235a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:19.099727 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f96bf-db43-4e98-818a-b83876235a7f None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:19.103357 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f96bf-db43-4e98-818a-b83876235a7f None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:19.103357 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f96bf-db43-4e98-818a-b83876235a7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:19.128420 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e862b8-8814-4928-a347-1baaf5f0bf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:19.130028 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e862b8-8814-4928-a347-1baaf5f0bf46 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:19.131364 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e862b8-8814-4928-a347-1baaf5f0bf46 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:19.131656 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e862b8-8814-4928-a347-1baaf5f0bf46 None admin] PATH_INFO: `/v3/groups/f8bc3aeb2e3244c8a8e872b9b586fddd` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:19.132929 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e862b8-8814-4928-a347-1baaf5f0bf46 None admin] RBAC: Authorizing `identity:get_group(group_id=f8bc3aeb2e3244c8a8e872b9b586fddd)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:19.134409 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e862b8-8814-4928-a347-1baaf5f0bf46 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:19.136103 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 234/450] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 28 03:42:18 2022] GET /identity/v3/groups/f8bc3aeb2e3244c8a8e872b9b586fddd => generated 229 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:19.143458 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e862b8-8814-4928-a347-1baaf5f0bf46 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:19.195372 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f96bf-db43-4e98-818a-b83876235a7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:19.196363 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f96bf-db43-4e98-818a-b83876235a7f None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:19.284744 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e862b8-8814-4928-a347-1baaf5f0bf46 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:19.316838 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:19.332552 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80c526-d79c-451d-86af-b52d072003ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:19.333552 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80c526-d79c-451d-86af-b52d072003ce None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:19.333552 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80c526-d79c-451d-86af-b52d072003ce None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:19.333717 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80c526-d79c-451d-86af-b52d072003ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:19.334530 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80c526-d79c-451d-86af-b52d072003ce None admin] RBAC: Adding query filter params (group.id=f8bc3aeb2e3244c8a8e872b9b586fddd, role.id=8a5766c4aef44773834941d1bdbd1e98, scope.project.id=7ea31e38f3a74a13b1debf11d300a6d6) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:19.334840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80c526-d79c-451d-86af-b52d072003ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:19.336361 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80c526-d79c-451d-86af-b52d072003ce None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:19.345408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 217/452] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:19.345696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 235/452] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 28 03:42:19 2022] GET /identity/v3/role_assignments?group.id=f8bc3aeb2e3244c8a8e872b9b586fddd&scope.project.id=7ea31e38f3a74a13b1debf11d300a6d6&role.id=8a5766c4aef44773834941d1bdbd1e98 => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:19.351105 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f96bf-db43-4e98-818a-b83876235a7f None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:19.495474 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f96bf-db43-4e98-818a-b83876235a7f None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:19.533295 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07354893-4e6f-4073-9ccb-8105a456d826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:19.533997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07354893-4e6f-4073-9ccb-8105a456d826 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:19.534280 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07354893-4e6f-4073-9ccb-8105a456d826 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:19.534552 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07354893-4e6f-4073-9ccb-8105a456d826 None admin] PATH_INFO: `/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:19.535790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07354893-4e6f-4073-9ccb-8105a456d826 None admin] RBAC: Authorizing `identity:get_project(project_id=fad2eddcd9204e1e82453c2e4c58edd0)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:19.537249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07354893-4e6f-4073-9ccb-8105a456d826 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:19.538917 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 218/453] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:42:19 2022] GET /identity/v3/projects/fad2eddcd9204e1e82453c2e4c58edd0 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:19.544520 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80c526-d79c-451d-86af-b52d072003ce None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:19.576459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:19.654811 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80c526-d79c-451d-86af-b52d072003ce None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:19.691380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be0382-059c-490e-899f-1f24afe1e9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:19.692020 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be0382-059c-490e-899f-1f24afe1e9e3 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:19.692304 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be0382-059c-490e-899f-1f24afe1e9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:19.692584 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be0382-059c-490e-899f-1f24afe1e9e3 None admin] PATH_INFO: `/v3/groups/e1b9f11ad1c44a82b10de08faf70d971` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:19.693770 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be0382-059c-490e-899f-1f24afe1e9e3 None admin] RBAC: Authorizing `identity:get_group(group_id=e1b9f11ad1c44a82b10de08faf70d971)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:19.695416 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be0382-059c-490e-899f-1f24afe1e9e3 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:19.697034 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 236/454] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 28 03:42:19 2022] GET /identity/v3/groups/e1b9f11ad1c44a82b10de08faf70d971 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:19.702987 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07354893-4e6f-4073-9ccb-8105a456d826 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:19.758010 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:19.806097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07354893-4e6f-4073-9ccb-8105a456d826 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:19.838927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3427eb-5593-4c8a-9278-c392db086bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:19.839573 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3427eb-5593-4c8a-9278-c392db086bce None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:19.839852 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3427eb-5593-4c8a-9278-c392db086bce None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:19.840121 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3427eb-5593-4c8a-9278-c392db086bce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:19.840934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3427eb-5593-4c8a-9278-c392db086bce None admin] RBAC: Adding query filter params (group.id=e1b9f11ad1c44a82b10de08faf70d971, role.id=81c955f5702546679605b5484602ae69, scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:19.841207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3427eb-5593-4c8a-9278-c392db086bce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:19.842735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3427eb-5593-4c8a-9278-c392db086bce None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:19.849270 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 219/455] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 28 03:42:19 2022] GET /identity/v3/role_assignments?group.id=e1b9f11ad1c44a82b10de08faf70d971&scope.project.id=fad2eddcd9204e1e82453c2e4c58edd0&role.id=81c955f5702546679605b5484602ae69 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:22.548200 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66a27b-e80e-4e78-ad85-d6d5f26c6bc6 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:22.548718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66a27b-e80e-4e78-ad85-d6d5f26c6bc6 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:22.548718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66a27b-e80e-4e78-ad85-d6d5f26c6bc6 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:22.550343 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 237/456] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:22.556952 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d8d09-6e2f-49ed-b8ed-28c4f05940c7 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:22.557452 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d8d09-6e2f-49ed-b8ed-28c4f05940c7 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:22.557528 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d8d09-6e2f-49ed-b8ed-28c4f05940c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:22.584391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-ec1d8d09-6e2f-49ed-b8ed-28c4f05940c7 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:22.585655 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ec1d8d09-6e2f-49ed-b8ed-28c4f05940c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:22.681208 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 220/457] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:42:22.716790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66a27b-e80e-4e78-ad85-d6d5f26c6bc6 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:22.824996 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb643e-41ed-4672-8f21-b4028af1d12f None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:22.825269 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb643e-41ed-4672-8f21-b4028af1d12f None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:22.825513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb643e-41ed-4672-8f21-b4028af1d12f None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:22.827011 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 221/458] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:22.833537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe27afb-aafe-4211-a239-e252a6966f37 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:22.833812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe27afb-aafe-4211-a239-e252a6966f37 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:22.834076 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe27afb-aafe-4211-a239-e252a6966f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:22.850866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:22.866139 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66a27b-e80e-4e78-ad85-d6d5f26c6bc6 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:22.878229 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-bbe27afb-aafe-4211-a239-e252a6966f37 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:22.879817 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-bbe27afb-aafe-4211-a239-e252a6966f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:22.942049 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613409e1-9b3c-4624-b2d6-b642bfe7ad8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:22.943783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613409e1-9b3c-4624-b2d6-b642bfe7ad8c None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:22.944446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613409e1-9b3c-4624-b2d6-b642bfe7ad8c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:22.946112 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613409e1-9b3c-4624-b2d6-b642bfe7ad8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:22.969572 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613409e1-9b3c-4624-b2d6-b642bfe7ad8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:22.970171 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:22.972390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613409e1-9b3c-4624-b2d6-b642bfe7ad8c None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:23.001444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-613409e1-9b3c-4624-b2d6-b642bfe7ad8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:23.001444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:23.001444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:23.001444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:23.001444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:23.001444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:23.001444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:23.001444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:23.001444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:23.001444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:23.001444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:23.001444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:23.001444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:23.001444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:23.001444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:23.002711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:23.002711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:23.002711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:23.002711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:23.002711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:23.002711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:23.002711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:23.002711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:23.002711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:23.002711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:23.002711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:23.002711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:23.002711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:23.002711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:23.002711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:23.002711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:23.002711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:23.003610 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:23.003610 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:23.003610 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:23.003610 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:23.005865 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 238/459] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:23.010774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 222/460] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:42:23.012011 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613409e1-9b3c-4624-b2d6-b642bfe7ad8c None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:23.055752 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe27afb-aafe-4211-a239-e252a6966f37 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:23.212705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe27afb-aafe-4211-a239-e252a6966f37 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:23.220517 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613409e1-9b3c-4624-b2d6-b642bfe7ad8c None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:23.255969 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a5ddc-be68-4faa-ab70-eadaf0a203b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:23.256626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a5ddc-be68-4faa-ab70-eadaf0a203b8 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:23.256963 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a5ddc-be68-4faa-ab70-eadaf0a203b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:23.257228 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a5ddc-be68-4faa-ab70-eadaf0a203b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:23.264457 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7316ed-a644-4c8d-bbd2-1d1ce0e3f6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:23.265099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7316ed-a644-4c8d-bbd2-1d1ce0e3f6c0 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:23.265384 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7316ed-a644-4c8d-bbd2-1d1ce0e3f6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:23.266665 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7316ed-a644-4c8d-bbd2-1d1ce0e3f6c0 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:23.267488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7316ed-a644-4c8d-bbd2-1d1ce0e3f6c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:23.268148 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7316ed-a644-4c8d-bbd2-1d1ce0e3f6c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:23.268666 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a5ddc-be68-4faa-ab70-eadaf0a203b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:23.269549 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7316ed-a644-4c8d-bbd2-1d1ce0e3f6c0 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:23.270215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a5ddc-be68-4faa-ab70-eadaf0a203b8 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:23.289027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 239/461] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:23.289027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8d21b-8770-407f-8b31-306e2e4a994f None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:23.289027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8d21b-8770-407f-8b31-306e2e4a994f None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:23.289027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8d21b-8770-407f-8b31-306e2e4a994f None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:23.289407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-6d1a5ddc-be68-4faa-ab70-eadaf0a203b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:23.289407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:23.289407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:23.289407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:23.289407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:23.289407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:23.289407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:23.289407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:23.289407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:23.289407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:23.289407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:23.289407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:23.289407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:23.289407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:23.289407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:23.290412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:23.290412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:23.290412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:23.290412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:23.290412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:23.290412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:23.290412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:23.290412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:23.290412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:23.290412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:23.290412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:23.290412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:23.290412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:23.290412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:23.290412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:23.290412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:23.290412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:23.291434 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:23.291434 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:23.291434 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:23.291434 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:23.291434 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 223/462] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:42:23.291691 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 240/463] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:23.291691 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8d21b-8770-407f-8b31-306e2e4a994f None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:23.296311 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3861ed0-6595-4a04-8fc3-79bd9f51cef4 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:23.296311 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3861ed0-6595-4a04-8fc3-79bd9f51cef4 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:23.296311 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3861ed0-6595-4a04-8fc3-79bd9f51cef4 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:23.297043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 224/464] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:23.298848 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578a48e-9a30-4b2b-ad58-23ed6c9662f5 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:23.299138 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578a48e-9a30-4b2b-ad58-23ed6c9662f5 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:23.299829 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578a48e-9a30-4b2b-ad58-23ed6c9662f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:23.303853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:23.321235 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-9578a48e-9a30-4b2b-ad58-23ed6c9662f5 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:23.322532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9578a48e-9a30-4b2b-ad58-23ed6c9662f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:23.348086 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:23.415373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 225/465] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:23.415373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578a48e-9a30-4b2b-ad58-23ed6c9662f5 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:23.451911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8d21b-8770-407f-8b31-306e2e4a994f None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:23.491118 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ec689-37c4-4668-a286-81479851720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:23.491714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ec689-37c4-4668-a286-81479851720e None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:23.492002 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ec689-37c4-4668-a286-81479851720e None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:23.492282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ec689-37c4-4668-a286-81479851720e None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:23.492972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ec689-37c4-4668-a286-81479851720e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:23.494441 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ec689-37c4-4668-a286-81479851720e None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:23.538706 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578a48e-9a30-4b2b-ad58-23ed6c9662f5 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:23.576039 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2451c4e-9bd8-44fd-a700-2207004d1caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:23.576875 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2451c4e-9bd8-44fd-a700-2207004d1caa None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:23.576962 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2451c4e-9bd8-44fd-a700-2207004d1caa None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:23.577294 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2451c4e-9bd8-44fd-a700-2207004d1caa None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:23.578010 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2451c4e-9bd8-44fd-a700-2207004d1caa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:23.578311 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2451c4e-9bd8-44fd-a700-2207004d1caa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:23.580471 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2451c4e-9bd8-44fd-a700-2207004d1caa None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:23.604329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 226/466] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:23.604329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb782e-795b-48f6-9feb-1fe66a07baa3 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:23.604329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb782e-795b-48f6-9feb-1fe66a07baa3 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:23.604329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb782e-795b-48f6-9feb-1fe66a07baa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:23.607684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 241/467] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 28 03:42:23 2022] POST /identity/v3/users => generated 246 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:42:23.608583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ec689-37c4-4668-a286-81479851720e None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:23.629674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-51fb782e-795b-48f6-9feb-1fe66a07baa3 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:23.631185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-51fb782e-795b-48f6-9feb-1fe66a07baa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:23.649525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:23.714193 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:23.731115 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 227/468] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:23.732730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb782e-795b-48f6-9feb-1fe66a07baa3 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:23.777585 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ec689-37c4-4668-a286-81479851720e None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:23.837650 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd956e-3ad6-4652-a7de-88d39d8af109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:23.838327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd956e-3ad6-4652-a7de-88d39d8af109 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:23.838620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd956e-3ad6-4652-a7de-88d39d8af109 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:23.838898 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd956e-3ad6-4652-a7de-88d39d8af109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:23.855673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd956e-3ad6-4652-a7de-88d39d8af109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:23.857182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd956e-3ad6-4652-a7de-88d39d8af109 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:23.876371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-08cd956e-3ad6-4652-a7de-88d39d8af109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:23.876371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:23.876371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:23.876371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:23.876371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:23.876371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:23.876371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:23.876371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:23.876371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:23.876371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:23.876371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:23.876371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:23.876371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:23.876371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:23.876371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:23.877321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:23.877321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:23.877321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:23.877321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:23.877321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:23.877321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:23.877321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:23.877321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:23.877321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:23.877321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:23.877321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:23.877321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:23.877321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:23.877321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:23.877321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:23.877321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:23.877321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:23.878597 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:23.878597 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:23.878597 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:23.878597 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:23.878597 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 242/469] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:23.878872 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd956e-3ad6-4652-a7de-88d39d8af109 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:23.902104 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb782e-795b-48f6-9feb-1fe66a07baa3 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:23.949629 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d2f77-96da-4e53-91c6-e4f89355c44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:23.950293 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d2f77-96da-4e53-91c6-e4f89355c44a None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:23.950867 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d2f77-96da-4e53-91c6-e4f89355c44a None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:23.951146 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d2f77-96da-4e53-91c6-e4f89355c44a None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:23.952076 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d2f77-96da-4e53-91c6-e4f89355c44a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:23.954876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d2f77-96da-4e53-91c6-e4f89355c44a None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:24.004463 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd956e-3ad6-4652-a7de-88d39d8af109 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:24.020553 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:24.046255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f16e8-f49d-4fbc-9088-ce713358e49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:24.046875 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 228/470] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 28 03:42:23 2022] POST /identity/v3/users => generated 248 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:42:24.046984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f16e8-f49d-4fbc-9088-ce713358e49f None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:24.051493 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f16e8-f49d-4fbc-9088-ce713358e49f None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:24.051493 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f16e8-f49d-4fbc-9088-ce713358e49f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:24.053949 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d2f77-96da-4e53-91c6-e4f89355c44a None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:24.062609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:24.075682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f16e8-f49d-4fbc-9088-ce713358e49f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:24.079791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f16e8-f49d-4fbc-9088-ce713358e49f None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:24.110578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-fa1f16e8-f49d-4fbc-9088-ce713358e49f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:24.110578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:24.110578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:24.110578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:24.110578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:24.110578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:24.110578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:24.110578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:24.110578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:24.110578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:24.110578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:24.110578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:24.110578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:24.110578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:24.110578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:24.111826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:24.111826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:24.111826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:24.111826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:24.111826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:24.111826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:24.111826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:24.111826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:24.111826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:24.111826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:24.111826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:24.111826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:24.111826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:24.111826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:24.111826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:24.111826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:24.111826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:24.112692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:24.112692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:24.112692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:24.112692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:24.117628 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 243/471] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:24.119155 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924fb27-e6b9-4d26-be9b-725f6dc5b7ce None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:24.119554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924fb27-e6b9-4d26-be9b-725f6dc5b7ce None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:24.119879 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924fb27-e6b9-4d26-be9b-725f6dc5b7ce None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:24.121683 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 244/472] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:24.122517 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924fb27-e6b9-4d26-be9b-725f6dc5b7ce None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:24.201268 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d2f77-96da-4e53-91c6-e4f89355c44a None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:24.242265 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cfe6e-18d7-48ba-87a2-9054ab120850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:24.243046 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cfe6e-18d7-48ba-87a2-9054ab120850 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:24.243349 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cfe6e-18d7-48ba-87a2-9054ab120850 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:24.243655 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cfe6e-18d7-48ba-87a2-9054ab120850 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:24.244502 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cfe6e-18d7-48ba-87a2-9054ab120850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:24.244813 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cfe6e-18d7-48ba-87a2-9054ab120850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:24.246236 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cfe6e-18d7-48ba-87a2-9054ab120850 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:24.266911 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 229/473] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:24.268604 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e47a70-337a-42e7-88de-69b0a9949682 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:24.268893 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e47a70-337a-42e7-88de-69b0a9949682 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:24.269171 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e47a70-337a-42e7-88de-69b0a9949682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:24.276628 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924fb27-e6b9-4d26-be9b-725f6dc5b7ce None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:24.291060 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-20e47a70-337a-42e7-88de-69b0a9949682 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:24.292310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-20e47a70-337a-42e7-88de-69b0a9949682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:24.324696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d17cf-5ad3-43a7-a5b7-08d002a39a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:24.325112 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d17cf-5ad3-43a7-a5b7-08d002a39a71 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:24.325554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d17cf-5ad3-43a7-a5b7-08d002a39a71 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:24.325857 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d17cf-5ad3-43a7-a5b7-08d002a39a71 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:24.326945 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d17cf-5ad3-43a7-a5b7-08d002a39a71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:24.327542 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d17cf-5ad3-43a7-a5b7-08d002a39a71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:24.330461 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d17cf-5ad3-43a7-a5b7-08d002a39a71 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:24.346991 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 245/474] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:24.347894 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d17cf-5ad3-43a7-a5b7-08d002a39a71 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:24.375194 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:24.388179 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:24.388475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 230/475] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:24.391900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e47a70-337a-42e7-88de-69b0a9949682 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:24.497471 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d17cf-5ad3-43a7-a5b7-08d002a39a71 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:24.535867 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e47a70-337a-42e7-88de-69b0a9949682 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:24.545837 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a90dc-5f27-4fb7-8d3c-250b51e0793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:24.546840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a90dc-5f27-4fb7-8d3c-250b51e0793a None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:24.547422 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a90dc-5f27-4fb7-8d3c-250b51e0793a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:24.547969 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a90dc-5f27-4fb7-8d3c-250b51e0793a None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:24.548866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a90dc-5f27-4fb7-8d3c-250b51e0793a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:24.550537 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a90dc-5f27-4fb7-8d3c-250b51e0793a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:24.581024 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ad371-cc43-46ec-aa7b-b7c653891be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:24.581726 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ad371-cc43-46ec-aa7b-b7c653891be2 None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:24.581930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ad371-cc43-46ec-aa7b-b7c653891be2 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:24.582225 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ad371-cc43-46ec-aa7b-b7c653891be2 None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:24.582916 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ad371-cc43-46ec-aa7b-b7c653891be2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:24.584543 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ad371-cc43-46ec-aa7b-b7c653891be2 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:24.695555 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 246/476] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 28 03:42:24 2022] POST /identity/v3/users => generated 248 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:42:24.697618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a90dc-5f27-4fb7-8d3c-250b51e0793a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:24.736178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 231/477] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 28 03:42:24 2022] POST /identity/v3/users => generated 249 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:42:24.815469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:24.840803 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a90dc-5f27-4fb7-8d3c-250b51e0793a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:24.903874 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80129ff4-1a71-4ff4-96d7-8d188a0af8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:24.904520 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80129ff4-1a71-4ff4-96d7-8d188a0af8ad None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:24.904800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80129ff4-1a71-4ff4-96d7-8d188a0af8ad None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:24.905361 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80129ff4-1a71-4ff4-96d7-8d188a0af8ad None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:24.906141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80129ff4-1a71-4ff4-96d7-8d188a0af8ad None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:24.907920 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80129ff4-1a71-4ff4-96d7-8d188a0af8ad None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:24.950400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.sql.core [None req-80129ff4-1a71-4ff4-96d7-8d188a0af8ad None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 03:42:24.950400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 03:42:24.950400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [parameters: {'id': '6c2201e49bd74493875c2f190fa49de5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 03:42:24.950400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86894) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 03:42:24.982625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-80129ff4-1a71-4ff4-96d7-8d188a0af8ad None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 03:42:24.982625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:24.982625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 03:42:24.982625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 03:42:24.982625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 03:42:24.982625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 03:42:24.982625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 03:42:24.982625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 03:42:24.982625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 03:42:24.982625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application conn.query(q) Jul 28 03:42:24.982625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 03:42:24.982625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 03:42:24.982625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 03:42:24.982625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application result.read() Jul 28 03:42:24.982625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 03:42:24.983557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 03:42:24.983557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 03:42:24.983557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 03:42:24.983557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 03:42:24.983557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 03:42:24.983557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 03:42:24.983557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 03:42:24.983557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 03:42:24.983557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:24.983557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 03:42:24.983557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:24.983557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:24.983557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 03:42:24.983557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 03:42:24.983557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 28 03:42:24.983557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return ref.to_dict() Jul 28 03:42:24.983557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 03:42:24.983557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application next(self.gen) Jul 28 03:42:24.984449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 03:42:24.984449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application yield resource Jul 28 03:42:24.984449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 03:42:24.984449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application next(self.gen) Jul 28 03:42:24.984449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 03:42:24.984449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 03:42:24.984449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:42:24.984449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 03:42:24.984449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:42:24.984449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise self.value Jul 28 03:42:24.984449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 03:42:24.984449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 03:42:24.984449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 03:42:24.984449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application session.commit() Jul 28 03:42:24.984449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 03:42:24.984449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 03:42:24.984449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 03:42:24.987080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 03:42:24.987080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 03:42:24.987080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self.session.flush() Jul 28 03:42:24.987080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 03:42:24.987080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 03:42:24.987080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 03:42:24.987080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 03:42:24.987080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 03:42:24.987080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application compat.raise_( Jul 28 03:42:24.987080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 03:42:24.987080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception Jul 28 03:42:24.987080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 03:42:24.987080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 03:42:24.987080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 03:42:24.987080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 03:42:24.987080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 03:42:24.987080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 03:42:24.989232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 03:42:24.989232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 03:42:24.989232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 03:42:24.989232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 03:42:24.989232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 03:42:24.989232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 03:42:24.989232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 03:42:24.989232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 03:42:24.989232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 03:42:24.989232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 03:42:24.989232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 03:42:24.989232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 03:42:24.989232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 03:42:24.989232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 03:42:24.989232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 03:42:24.989232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception Jul 28 03:42:24.993992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 03:42:24.993992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 03:42:24.993992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 03:42:24.993992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 03:42:24.993992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 03:42:24.993992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 03:42:24.993992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 03:42:24.993992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application conn.query(q) Jul 28 03:42:24.993992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 03:42:24.993992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 03:42:24.993992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 03:42:24.993992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application result.read() Jul 28 03:42:24.993992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 03:42:24.993992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 03:42:24.993992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 03:42:24.993992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 03:42:24.996082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 03:42:24.996082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 03:42:24.996082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 03:42:24.996082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 03:42:24.996082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 03:42:24.996082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 03:42:24.996082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [parameters: {'id': '6c2201e49bd74493875c2f190fa49de5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 03:42:24.996082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 03:42:24.996082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:24.996082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:42:24.996082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:24.996082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:24.996082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:24.996082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:24.996082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:24.996082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:24.998328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:24.998328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:24.998328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:24.998328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:24.998328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:24.998328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:24.998328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 28 03:42:24.998328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 28 03:42:24.998328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:24.998328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:24.998328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 28 03:42:24.998328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 28 03:42:24.998328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 03:42:24.998328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 03:42:24.998328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 03:42:24.998328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:25.004254 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 247/478] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Jul 28 03:42:24 2022] POST /identity/v3/roles => generated 144 bytes in 289 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:25.004398 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ad371-cc43-46ec-aa7b-b7c653891be2 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:25.061205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:25.118094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ad371-cc43-46ec-aa7b-b7c653891be2 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:25.158371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da72036-dd4d-4fce-91a1-568ea5343b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:25.159233 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da72036-dd4d-4fce-91a1-568ea5343b8d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:25.159777 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da72036-dd4d-4fce-91a1-568ea5343b8d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:25.160156 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da72036-dd4d-4fce-91a1-568ea5343b8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:25.172919 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da72036-dd4d-4fce-91a1-568ea5343b8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:25.178735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-7da72036-dd4d-4fce-91a1-568ea5343b8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:42:25.178735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:25.178735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:25.178735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:25.178735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:25.178735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:25.178735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:25.178735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:25.178735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:25.178735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:25.178735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:25.178735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:25.178735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:25.178735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:25.178735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:25.178735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:25.179934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:25.179934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:25.179934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:25.179934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:25.179934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:25.179934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:25.179934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:25.179934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:25.179934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:25.179934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:25.179934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:25.179934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:25.179934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:25.179934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:25.179934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:25.179934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:25.180894 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:25.180894 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:25.180894 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:25.180894 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:25.180894 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:25.180894 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:25.180894 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:25.180894 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:25.180894 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:25.180894 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:25.180894 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 03:42:25.180894 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:25.183001 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 232/479] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:42:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:25.188516 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80129ff4-1a71-4ff4-96d7-8d188a0af8ad None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:25.307147 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80129ff4-1a71-4ff4-96d7-8d188a0af8ad None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:25.344210 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a560f6a-5f7c-4e35-b961-f17dd816c850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:25.345727 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a560f6a-5f7c-4e35-b961-f17dd816c850 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:25.346206 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a560f6a-5f7c-4e35-b961-f17dd816c850 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:25.346708 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a560f6a-5f7c-4e35-b961-f17dd816c850 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:25.347663 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a560f6a-5f7c-4e35-b961-f17dd816c850 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:25.348183 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a560f6a-5f7c-4e35-b961-f17dd816c850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:25.349773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a560f6a-5f7c-4e35-b961-f17dd816c850 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:25.359266 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 248/480] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:25.921187 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bcd47-28d6-4226-8526-541d3ebc65ae None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:25.922162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bcd47-28d6-4226-8526-541d3ebc65ae None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:25.923452 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bcd47-28d6-4226-8526-541d3ebc65ae None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:25.925373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 233/481] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:25.931310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a1720-07b0-4ff9-83dd-6d5602fe9429 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:25.932203 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a1720-07b0-4ff9-83dd-6d5602fe9429 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:25.932679 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a1720-07b0-4ff9-83dd-6d5602fe9429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:25.952721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-ab3a1720-07b0-4ff9-83dd-6d5602fe9429 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:25.954981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ab3a1720-07b0-4ff9-83dd-6d5602fe9429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:25.957567 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:26.074121 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 249/482] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:26.119155 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bcd47-28d6-4226-8526-541d3ebc65ae None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:26.274533 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bcd47-28d6-4226-8526-541d3ebc65ae None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:26.285727 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:26.315008 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975b7f4-7e58-411f-ad1e-a5b0012c8db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:26.315705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975b7f4-7e58-411f-ad1e-a5b0012c8db3 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:26.315988 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975b7f4-7e58-411f-ad1e-a5b0012c8db3 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:26.316267 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975b7f4-7e58-411f-ad1e-a5b0012c8db3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:26.334552 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975b7f4-7e58-411f-ad1e-a5b0012c8db3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:26.339509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-8975b7f4-7e58-411f-ad1e-a5b0012c8db3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:26.339509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:26.339509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:26.339509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:26.339509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:26.339509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:26.339509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:26.339509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:26.339509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:26.339509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:26.339509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:26.339509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:26.339509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:26.339509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:26.339509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:26.339509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:26.340539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:26.340539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:26.340539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:26.340539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:26.340539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:26.340539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:26.340539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:26.340539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:26.340539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:26.340539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:26.340539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:26.340539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:26.340539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:26.340539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:26.340539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:26.340539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:26.341534 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:26.341534 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:26.341534 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:26.341534 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:26.341534 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:26.341534 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:26.341534 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:26.341534 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:26.341534 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:26.341534 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:26.341534 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:26.341534 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:26.341534 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 234/483] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:42:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:26.348833 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a1720-07b0-4ff9-83dd-6d5602fe9429 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:26.489339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a1720-07b0-4ff9-83dd-6d5602fe9429 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:26.531102 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab886127-b6a0-403c-932e-f6e22e9ed4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:26.532441 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab886127-b6a0-403c-932e-f6e22e9ed4e2 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:26.533374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab886127-b6a0-403c-932e-f6e22e9ed4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:26.533709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab886127-b6a0-403c-932e-f6e22e9ed4e2 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:26.534478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab886127-b6a0-403c-932e-f6e22e9ed4e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:26.534787 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab886127-b6a0-403c-932e-f6e22e9ed4e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:26.536242 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab886127-b6a0-403c-932e-f6e22e9ed4e2 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:26.542484 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:26.552126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 250/484] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:42:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:26.558105 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975b7f4-7e58-411f-ad1e-a5b0012c8db3 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:26.755379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975b7f4-7e58-411f-ad1e-a5b0012c8db3 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:26.810895 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c888d-ba15-4564-a45b-e0264eff7d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:26.811619 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c888d-ba15-4564-a45b-e0264eff7d53 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:26.811905 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c888d-ba15-4564-a45b-e0264eff7d53 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:26.812187 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c888d-ba15-4564-a45b-e0264eff7d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:26.831013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c888d-ba15-4564-a45b-e0264eff7d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:26.832587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c888d-ba15-4564-a45b-e0264eff7d53 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:26.853956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-a53c888d-ba15-4564-a45b-e0264eff7d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:26.853956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:26.853956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:26.853956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:26.853956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:26.853956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:26.853956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:26.853956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:26.853956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:26.853956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:26.853956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:26.853956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:26.853956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:26.853956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:26.853956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:26.854960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:26.854960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:26.854960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:26.854960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:26.854960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:26.854960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:26.854960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:26.854960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:26.854960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:26.854960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:26.854960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:26.854960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:26.854960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:26.854960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:26.854960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:26.854960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:26.854960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:26.855804 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:26.855804 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:26.855804 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:26.855804 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:26.855804 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 235/485] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:26.861971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab886127-b6a0-403c-932e-f6e22e9ed4e2 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:26.892854 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc3300-7dbe-4fc8-8392-cc5ce45a65e4 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:26.893197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc3300-7dbe-4fc8-8392-cc5ce45a65e4 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:26.893410 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc3300-7dbe-4fc8-8392-cc5ce45a65e4 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:26.895146 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 236/486] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:26.900787 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac2a43-96de-4b8b-a8e6-ef3f9a79f4a4 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:26.901080 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac2a43-96de-4b8b-a8e6-ef3f9a79f4a4 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:26.901341 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac2a43-96de-4b8b-a8e6-ef3f9a79f4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:26.938524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-faac2a43-96de-4b8b-a8e6-ef3f9a79f4a4 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:26.941970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-faac2a43-96de-4b8b-a8e6-ef3f9a79f4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:26.983673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:27.046149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 237/487] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:27.068585 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab886127-b6a0-403c-932e-f6e22e9ed4e2 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:27.077485 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac2a43-96de-4b8b-a8e6-ef3f9a79f4a4 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:27.107893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5fd3a-4f45-46bd-936d-0521ce47627d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:27.108523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5fd3a-4f45-46bd-936d-0521ce47627d None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:27.108803 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5fd3a-4f45-46bd-936d-0521ce47627d None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:27.109079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5fd3a-4f45-46bd-936d-0521ce47627d None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:27.109837 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5fd3a-4f45-46bd-936d-0521ce47627d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:27.110774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5fd3a-4f45-46bd-936d-0521ce47627d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:27.112333 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5fd3a-4f45-46bd-936d-0521ce47627d None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:27.125905 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 251/488] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:27.144396 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5fd3a-4f45-46bd-936d-0521ce47627d None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:27.212429 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac2a43-96de-4b8b-a8e6-ef3f9a79f4a4 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:27.253388 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586f136-8458-492f-bec1-5f377c36e888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:27.254380 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586f136-8458-492f-bec1-5f377c36e888 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:27.254670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586f136-8458-492f-bec1-5f377c36e888 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:27.254953 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586f136-8458-492f-bec1-5f377c36e888 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:27.260867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:27.268956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586f136-8458-492f-bec1-5f377c36e888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:27.274379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-0586f136-8458-492f-bec1-5f377c36e888 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:27.274379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:27.274379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:27.274379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:27.274379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:27.274379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:27.274379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:27.274379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:27.274379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:27.274379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:27.274379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:27.274379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:27.274379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:27.274379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:27.274379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:27.274379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:27.275274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:27.275274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:27.275274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:27.275274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:27.275274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:27.275274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:27.275274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:27.275274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:27.275274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:27.275274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:27.275274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:27.275274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:27.275274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:27.275274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:27.275274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:27.275274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:27.276085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:27.276085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:27.276085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:27.276085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:27.276085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:27.276085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:27.276085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:27.276085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:27.276085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:27.276085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:27.276085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:27.276085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:27.278862 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 238/489] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:42:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:42:27.280789 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e5e55-a8f8-45f6-ae6c-b5c96d229faf None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:27.281299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e5e55-a8f8-45f6-ae6c-b5c96d229faf None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:27.281798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e5e55-a8f8-45f6-ae6c-b5c96d229faf None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:27.283714 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 239/490] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:27.284777 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e5e55-a8f8-45f6-ae6c-b5c96d229faf None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:27.301312 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:27.307157 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5fd3a-4f45-46bd-936d-0521ce47627d None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:27.349884 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed73d1-cbad-4600-bab8-d06941bdee28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:27.350528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed73d1-cbad-4600-bab8-d06941bdee28 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:27.350814 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed73d1-cbad-4600-bab8-d06941bdee28 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:27.351250 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed73d1-cbad-4600-bab8-d06941bdee28 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:27.361357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed73d1-cbad-4600-bab8-d06941bdee28 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:27.362820 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed73d1-cbad-4600-bab8-d06941bdee28 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:27.378729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-98ed73d1-cbad-4600-bab8-d06941bdee28 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:42:27.378729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:27.378729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:27.378729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:27.378729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:27.378729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:27.378729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:27.378729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:27.378729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:27.378729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:27.378729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:27.378729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:27.378729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:27.378729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:27.378729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:27.378729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:27.379930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:27.379930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:27.379930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:27.379930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:27.379930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:27.379930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:27.379930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:27.379930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:27.379930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:27.379930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:27.379930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:27.379930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:27.379930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:27.379930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:27.379930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:27.379930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:27.379930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:27.379930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:27.384394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:27.384394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:27.384394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:27.384394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:27.384394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:27.384394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:27.384394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:27.384394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:27.384394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:42:27.384394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:27.384394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 252/491] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 28 03:42:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:27.384394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11161c4-1a50-4177-85f1-9ebd46d50371 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:27.384394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11161c4-1a50-4177-85f1-9ebd46d50371 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:27.385055 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11161c4-1a50-4177-85f1-9ebd46d50371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:27.406369 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-f11161c4-1a50-4177-85f1-9ebd46d50371 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:27.409062 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f11161c4-1a50-4177-85f1-9ebd46d50371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:27.411441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e5e55-a8f8-45f6-ae6c-b5c96d229faf None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:27.449592 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7568d-f543-4cae-b3b1-29c0d51bdf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:27.450408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7568d-f543-4cae-b3b1-29c0d51bdf10 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:27.450762 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7568d-f543-4cae-b3b1-29c0d51bdf10 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:27.451108 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7568d-f543-4cae-b3b1-29c0d51bdf10 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:27.452274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7568d-f543-4cae-b3b1-29c0d51bdf10 None admin] RBAC: Adding query filter params (name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:27.452381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7568d-f543-4cae-b3b1-29c0d51bdf10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:27.453855 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7568d-f543-4cae-b3b1-29c0d51bdf10 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:27.463062 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 240/492] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:42:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:27.464003 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7568d-f543-4cae-b3b1-29c0d51bdf10 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:27.490723 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 253/493] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:27.491967 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11161c4-1a50-4177-85f1-9ebd46d50371 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:27.550832 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:27.553068 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:27.585927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7568d-f543-4cae-b3b1-29c0d51bdf10 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:27.612086 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11161c4-1a50-4177-85f1-9ebd46d50371 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:27.632265 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58448caa-7e7a-4bde-9289-c241d5e252bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:27.633245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58448caa-7e7a-4bde-9289-c241d5e252bf None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:27.633701 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58448caa-7e7a-4bde-9289-c241d5e252bf None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:27.634205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58448caa-7e7a-4bde-9289-c241d5e252bf None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:27.635247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58448caa-7e7a-4bde-9289-c241d5e252bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:27.635804 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58448caa-7e7a-4bde-9289-c241d5e252bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:27.637459 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58448caa-7e7a-4bde-9289-c241d5e252bf None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:27.657981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980914f-8d38-4237-90d0-3132bddcc347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:27.658344 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980914f-8d38-4237-90d0-3132bddcc347 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:27.658687 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980914f-8d38-4237-90d0-3132bddcc347 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:27.658963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980914f-8d38-4237-90d0-3132bddcc347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:27.671579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980914f-8d38-4237-90d0-3132bddcc347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:27.673772 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980914f-8d38-4237-90d0-3132bddcc347 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:27.681842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 241/494] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 28 03:42:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:27.683064 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58448caa-7e7a-4bde-9289-c241d5e252bf None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:27.692931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-2980914f-8d38-4237-90d0-3132bddcc347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:27.692931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:27.692931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:27.692931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:27.692931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:27.692931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:27.692931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:27.692931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:27.692931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:27.692931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:27.692931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:27.692931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:27.692931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:27.692931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:27.692931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:27.693850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:27.693850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:27.693850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:27.693850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:27.693850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:27.693850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:27.693850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:27.693850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:27.693850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:27.693850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:27.693850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:27.693850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:27.693850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:27.693850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:27.693850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:27.693850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:27.693850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:27.694688 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:27.694688 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:27.694688 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:27.694688 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:27.695568 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 254/495] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:27.696878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ac43d-f790-4eac-95ec-7ab4d1385348 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:27.699136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ac43d-f790-4eac-95ec-7ab4d1385348 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:27.699136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ac43d-f790-4eac-95ec-7ab4d1385348 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:27.700596 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 255/496] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:27.700719 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ac43d-f790-4eac-95ec-7ab4d1385348 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:27.809402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58448caa-7e7a-4bde-9289-c241d5e252bf None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:27.827205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ac43d-f790-4eac-95ec-7ab4d1385348 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:27.830075 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:27.844897 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:27.850395 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01b8b0-61d2-4d4a-a35e-3928bb8c7f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:27.851062 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01b8b0-61d2-4d4a-a35e-3928bb8c7f4e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:27.851371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01b8b0-61d2-4d4a-a35e-3928bb8c7f4e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:27.851711 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01b8b0-61d2-4d4a-a35e-3928bb8c7f4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:27.866075 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01b8b0-61d2-4d4a-a35e-3928bb8c7f4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:27.870649 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fab21a-9628-4099-b278-4e624a4c57db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:27.871305 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab21a-9628-4099-b278-4e624a4c57db None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:27.871612 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab21a-9628-4099-b278-4e624a4c57db None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:27.871890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab21a-9628-4099-b278-4e624a4c57db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:27.871997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-cb01b8b0-61d2-4d4a-a35e-3928bb8c7f4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:27.871997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:27.871997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:27.871997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:27.871997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:27.871997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:27.871997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:27.871997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:27.871997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:27.871997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:27.871997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:27.871997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:27.871997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:27.871997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:27.871997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:27.871997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:27.873073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:27.873073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:27.873073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:27.873073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:27.873073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:27.873073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:27.873073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:27.873073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:27.873073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:27.873073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:27.873073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:27.873073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:27.873073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:27.873073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:27.873073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:27.873073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:27.873918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:27.873918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:27.873918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:27.873918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:27.873918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:27.873918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:27.873918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:27.873918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:27.873918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:27.873918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:27.873918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:27.873918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:27.873918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 242/497] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:42:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:27.874746 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01b8b0-61d2-4d4a-a35e-3928bb8c7f4e None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:27.957617 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fab21a-9628-4099-b278-4e624a4c57db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:27.959722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fab21a-9628-4099-b278-4e624a4c57db None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:27.996061 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01b8b0-61d2-4d4a-a35e-3928bb8c7f4e None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:28.033694 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5ad2e-618f-440a-9286-22dc30db050c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:28.034340 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5ad2e-618f-440a-9286-22dc30db050c None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:28.034626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5ad2e-618f-440a-9286-22dc30db050c None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:28.034897 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5ad2e-618f-440a-9286-22dc30db050c None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:28.035640 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5ad2e-618f-440a-9286-22dc30db050c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:28.035947 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5ad2e-618f-440a-9286-22dc30db050c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:28.037366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5ad2e-618f-440a-9286-22dc30db050c None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:28.055704 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 243/498] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:28.055704 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3830a6-c66c-40d3-a908-96d77441be48 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:28.055704 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3830a6-c66c-40d3-a908-96d77441be48 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:28.055704 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3830a6-c66c-40d3-a908-96d77441be48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:28.075854 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-3b3830a6-c66c-40d3-a908-96d77441be48 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:28.077100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-3b3830a6-c66c-40d3-a908-96d77441be48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:28.092442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 256/499] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:28.092442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fab21a-9628-4099-b278-4e624a4c57db None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:28.092442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:28.142863 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:28.167063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 244/500] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:28.168384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3830a6-c66c-40d3-a908-96d77441be48 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:28.211528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fab21a-9628-4099-b278-4e624a4c57db None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:28.246973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6032e-a158-40a4-bd4e-a17fa99691b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:28.247659 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6032e-a158-40a4-bd4e-a17fa99691b1 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:28.247933 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6032e-a158-40a4-bd4e-a17fa99691b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:28.248204 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6032e-a158-40a4-bd4e-a17fa99691b1 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:28.248919 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6032e-a158-40a4-bd4e-a17fa99691b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:28.249215 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6032e-a158-40a4-bd4e-a17fa99691b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:28.251844 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6032e-a158-40a4-bd4e-a17fa99691b1 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:28.259970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 257/501] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:42:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:28.260778 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6032e-a158-40a4-bd4e-a17fa99691b1 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:28.287077 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3830a6-c66c-40d3-a908-96d77441be48 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:28.327075 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca918098-84b9-40f3-a83d-d1d1c4315276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:28.327681 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca918098-84b9-40f3-a83d-d1d1c4315276 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:28.327961 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca918098-84b9-40f3-a83d-d1d1c4315276 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:28.328233 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca918098-84b9-40f3-a83d-d1d1c4315276 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:28.333476 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:28.336418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca918098-84b9-40f3-a83d-d1d1c4315276 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:28.337885 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca918098-84b9-40f3-a83d-d1d1c4315276 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:28.351741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-ca918098-84b9-40f3-a83d-d1d1c4315276 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 03:42:28.351741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:28.351741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:28.351741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:28.351741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:28.351741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:28.351741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:28.351741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:28.351741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:28.351741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:28.351741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:28.351741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:28.351741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:28.351741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:28.351741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:28.351741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:28.352876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:28.352876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:28.352876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:28.352876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:28.352876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:28.352876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:28.352876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:28.352876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:28.352876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:28.352876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:28.352876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:28.352876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:28.352876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:28.352876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:28.352876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:28.352876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:28.352876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:28.352876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:28.353978 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:28.353978 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:28.353978 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:28.353978 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:28.353978 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:28.353978 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:28.353978 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:28.353978 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:28.353978 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 03:42:28.353978 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:28.353978 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 245/502] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:28.354827 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3c1a3-df51-41be-9b30-84a06875df16 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:28.354827 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3c1a3-df51-41be-9b30-84a06875df16 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:28.354827 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3c1a3-df51-41be-9b30-84a06875df16 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:28.356086 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 246/503] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:28.356640 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3c1a3-df51-41be-9b30-84a06875df16 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:28.381741 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6032e-a158-40a4-bd4e-a17fa99691b1 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:28.409563 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:28.416769 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324344d-3103-4f11-869d-049cfbcc702f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:28.417429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324344d-3103-4f11-869d-049cfbcc702f None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:28.417709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324344d-3103-4f11-869d-049cfbcc702f None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:28.417986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324344d-3103-4f11-869d-049cfbcc702f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:28.430203 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324344d-3103-4f11-869d-049cfbcc702f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:28.431794 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324344d-3103-4f11-869d-049cfbcc702f None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:28.448087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-1324344d-3103-4f11-869d-049cfbcc702f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:28.448087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:28.448087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:28.448087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:28.448087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:28.448087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:28.448087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:28.448087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:28.448087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:28.448087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:28.448087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:28.448087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:28.448087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:28.448087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:28.448087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:28.448973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:28.448973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:28.448973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:28.448973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:28.448973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:28.448973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:28.448973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:28.448973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:28.448973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:28.448973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:28.448973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:28.448973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:28.448973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:28.448973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:28.448973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:28.448973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:28.448973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:28.449823 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:28.449823 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:28.449823 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:28.449823 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:28.449823 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 258/504] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:28.450087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324344d-3103-4f11-869d-049cfbcc702f None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:28.477051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3c1a3-df51-41be-9b30-84a06875df16 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:28.512110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834efaa1-4d1b-4c86-a1d8-b60449a56512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:28.512764 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834efaa1-4d1b-4c86-a1d8-b60449a56512 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:28.513045 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834efaa1-4d1b-4c86-a1d8-b60449a56512 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:28.513321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834efaa1-4d1b-4c86-a1d8-b60449a56512 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:28.525335 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834efaa1-4d1b-4c86-a1d8-b60449a56512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:28.530994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-834efaa1-4d1b-4c86-a1d8-b60449a56512 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:28.530994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:28.530994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:28.530994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:28.530994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:28.530994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:28.530994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:28.530994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:28.530994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:28.530994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:28.530994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:28.530994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:28.530994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:28.530994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:28.530994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:28.530994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:28.532525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:28.532525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:28.532525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:28.532525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:28.532525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:28.532525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:28.532525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:28.532525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:28.532525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:28.532525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:28.532525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:28.532525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:28.532525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:28.532525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:28.532525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:28.532525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:28.533313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:28.533313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:28.533313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:28.533313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:28.533313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:28.533313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:28.533313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:28.533313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:28.533313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:28.533313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:28.533313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:28.533313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:28.533950 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 247/505] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:42:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:28.534370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834efaa1-4d1b-4c86-a1d8-b60449a56512 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:28.560972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324344d-3103-4f11-869d-049cfbcc702f None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:28.578556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:28.600735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f6b8d-833d-4272-9863-9d74438a495e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:28.601392 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f6b8d-833d-4272-9863-9d74438a495e None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:28.601680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f6b8d-833d-4272-9863-9d74438a495e None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:28.601959 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f6b8d-833d-4272-9863-9d74438a495e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:28.613440 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f6b8d-833d-4272-9863-9d74438a495e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:28.615030 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f6b8d-833d-4272-9863-9d74438a495e None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:28.630438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-0e6f6b8d-833d-4272-9863-9d74438a495e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:28.630438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:28.630438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:28.630438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:28.630438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:28.630438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:28.630438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:28.630438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:28.630438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:28.630438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:28.630438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:28.630438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:28.630438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:28.630438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:28.630438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:28.631590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:28.631590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:28.631590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:28.631590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:28.631590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:28.631590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:28.631590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:28.631590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:28.631590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:28.631590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:28.631590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:28.631590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:28.631590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:28.631590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:28.631590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:28.631590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:28.631590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:28.632428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:28.632428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:28.632428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:28.632428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:28.632428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 259/506] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:28.632938 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf3647-3bd7-46bc-840a-16e4eb82b6a3 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:28.633078 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf3647-3bd7-46bc-840a-16e4eb82b6a3 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:28.633356 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf3647-3bd7-46bc-840a-16e4eb82b6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:28.644441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834efaa1-4d1b-4c86-a1d8-b60449a56512 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:28.646082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:28.651756 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-9adf3647-3bd7-46bc-840a-16e4eb82b6a3 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:28.652962 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9adf3647-3bd7-46bc-840a-16e4eb82b6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:28.680875 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee578fb-8585-4bf0-bcf4-8311c1f8b833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:28.681323 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee578fb-8585-4bf0-bcf4-8311c1f8b833 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:28.681655 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee578fb-8585-4bf0-bcf4-8311c1f8b833 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:28.681900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee578fb-8585-4bf0-bcf4-8311c1f8b833 None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:28.682663 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee578fb-8585-4bf0-bcf4-8311c1f8b833 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:28.682967 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee578fb-8585-4bf0-bcf4-8311c1f8b833 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:28.684465 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee578fb-8585-4bf0-bcf4-8311c1f8b833 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:28.703743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 248/507] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 28 03:42:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:28.703743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee578fb-8585-4bf0-bcf4-8311c1f8b833 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:28.738533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 260/508] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:28.739690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf3647-3bd7-46bc-840a-16e4eb82b6a3 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:28.820102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee578fb-8585-4bf0-bcf4-8311c1f8b833 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:28.851484 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:28.855203 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf3647-3bd7-46bc-840a-16e4eb82b6a3 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:28.857455 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf456ca-5645-4f70-9b8a-9b7acb1d85ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:28.858104 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf456ca-5645-4f70-9b8a-9b7acb1d85ac None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:28.858385 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf456ca-5645-4f70-9b8a-9b7acb1d85ac None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:28.858664 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf456ca-5645-4f70-9b8a-9b7acb1d85ac None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:28.859452 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf456ca-5645-4f70-9b8a-9b7acb1d85ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:28.863057 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf456ca-5645-4f70-9b8a-9b7acb1d85ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:28.863057 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf456ca-5645-4f70-9b8a-9b7acb1d85ac None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:28.873656 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 249/509] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:28.874571 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf456ca-5645-4f70-9b8a-9b7acb1d85ac None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:28.901515 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:28.904095 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4b610-a66c-4300-87b1-caca78e1e9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:28.904970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4b610-a66c-4300-87b1-caca78e1e9bc None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:28.905280 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4b610-a66c-4300-87b1-caca78e1e9bc None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:28.905621 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4b610-a66c-4300-87b1-caca78e1e9bc None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:28.906347 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4b610-a66c-4300-87b1-caca78e1e9bc None admin] RBAC: Adding query filter params (name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:28.907181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4b610-a66c-4300-87b1-caca78e1e9bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:28.908700 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4b610-a66c-4300-87b1-caca78e1e9bc None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:28.918197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 261/510] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:42:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:28.919030 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4b610-a66c-4300-87b1-caca78e1e9bc None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:29.005110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf456ca-5645-4f70-9b8a-9b7acb1d85ac None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:29.041483 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ca7ea-61a9-4b0a-b884-f04503ff30ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:29.042110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ca7ea-61a9-4b0a-b884-f04503ff30ea None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:29.042400 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ca7ea-61a9-4b0a-b884-f04503ff30ea None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:29.042680 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ca7ea-61a9-4b0a-b884-f04503ff30ea None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:29.043420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ca7ea-61a9-4b0a-b884-f04503ff30ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:29.043730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ca7ea-61a9-4b0a-b884-f04503ff30ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:29.045137 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ca7ea-61a9-4b0a-b884-f04503ff30ea None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:29.045249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4b610-a66c-4300-87b1-caca78e1e9bc None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:29.058483 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 250/511] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:29.059520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ca7ea-61a9-4b0a-b884-f04503ff30ea None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:29.093561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91691956-319d-4c6d-aec0-5b4a82aa8903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:29.094756 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91691956-319d-4c6d-aec0-5b4a82aa8903 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:29.095046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91691956-319d-4c6d-aec0-5b4a82aa8903 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:29.095333 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91691956-319d-4c6d-aec0-5b4a82aa8903 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:29.131765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:29.150062 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:29.174784 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ca7ea-61a9-4b0a-b884-f04503ff30ea None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:29.175350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91691956-319d-4c6d-aec0-5b4a82aa8903 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:29.176843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91691956-319d-4c6d-aec0-5b4a82aa8903 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:29.214873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96f35e-1a5c-4a16-b4eb-32c8afd328a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:29.215651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96f35e-1a5c-4a16-b4eb-32c8afd328a7 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:29.215941 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96f35e-1a5c-4a16-b4eb-32c8afd328a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:29.216315 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96f35e-1a5c-4a16-b4eb-32c8afd328a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:29.230656 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96f35e-1a5c-4a16-b4eb-32c8afd328a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:29.232195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96f35e-1a5c-4a16-b4eb-32c8afd328a7 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:29.247735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-df96f35e-1a5c-4a16-b4eb-32c8afd328a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:29.247735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:29.247735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:29.247735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:29.247735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:29.247735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:29.247735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:29.247735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:29.247735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:29.247735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:29.247735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:29.247735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:29.247735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:29.247735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:29.247735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:29.248687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:29.248687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:29.248687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:29.248687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:29.248687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:29.248687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:29.248687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:29.248687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:29.248687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:29.248687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:29.248687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:29.248687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:29.248687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:29.248687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:29.248687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:29.248687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:29.248687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:29.249530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:29.249530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:29.249530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:29.249530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:29.249530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 251/512] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:29.249807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96f35e-1a5c-4a16-b4eb-32c8afd328a7 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:29.295947 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 262/513] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:29.296837 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91691956-319d-4c6d-aec0-5b4a82aa8903 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:29.361564 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96f35e-1a5c-4a16-b4eb-32c8afd328a7 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:29.363895 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:29.392718 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:29.400005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ee2e9-bb30-41d9-ada4-2bb85c4aa560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:29.400671 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ee2e9-bb30-41d9-ada4-2bb85c4aa560 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:29.400950 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ee2e9-bb30-41d9-ada4-2bb85c4aa560 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:29.412853 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ee2e9-bb30-41d9-ada4-2bb85c4aa560 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:29.413181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91691956-319d-4c6d-aec0-5b4a82aa8903 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:29.413341 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ee2e9-bb30-41d9-ada4-2bb85c4aa560 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:29.413341 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ee2e9-bb30-41d9-ada4-2bb85c4aa560 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:29.425587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-9e2ee2e9-bb30-41d9-ada4-2bb85c4aa560 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:29.425587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:29.425587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:29.425587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:29.425587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:29.425587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:29.425587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:29.425587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:29.425587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:29.425587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:29.425587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:29.425587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:29.425587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:42:29.425587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:42:29.425587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:42:29.426565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:42:29.426565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:29.426565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:29.426565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:29.426565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:29.426565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:29.426565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:29.426565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:29.426565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:29.426565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:29.426565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:29.426565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:29.426565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:29.426565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:29.426565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:29.426565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:29.426565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:29.427436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:42:29.427436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:42:29.427436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:42:29.427436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:42:29.427436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:42:29.427436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:42:29.427436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:29.427436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:29.427436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 252/514] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:29.428191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ee2e9-bb30-41d9-ada4-2bb85c4aa560 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:29.453452 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86d294-862a-4945-b7bf-e2855b7e506f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:29.454455 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86d294-862a-4945-b7bf-e2855b7e506f None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:29.454786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86d294-862a-4945-b7bf-e2855b7e506f None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:29.455068 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86d294-862a-4945-b7bf-e2855b7e506f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:29.468808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86d294-862a-4945-b7bf-e2855b7e506f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:29.470941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86d294-862a-4945-b7bf-e2855b7e506f None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:29.487247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-8a86d294-862a-4945-b7bf-e2855b7e506f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:29.487247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:29.487247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:29.487247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:29.487247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:29.487247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:29.487247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:29.487247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:29.487247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:29.487247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:29.487247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:29.487247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:29.487247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:29.487247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:29.487247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:29.488182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:29.488182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:29.488182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:29.488182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:29.488182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:29.488182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:29.488182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:29.488182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:29.488182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:29.488182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:29.488182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:29.488182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:29.488182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:29.488182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:29.488182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:29.488182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:29.488182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:29.488997 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:29.488997 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:29.488997 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:29.488997 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:29.488997 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 263/515] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:29.489564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86d294-862a-4945-b7bf-e2855b7e506f None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:29.558356 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ee2e9-bb30-41d9-ada4-2bb85c4aa560 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:29.599145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03373a-8644-46c3-8a4e-74c59858b389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:29.600108 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03373a-8644-46c3-8a4e-74c59858b389 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:29.600398 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03373a-8644-46c3-8a4e-74c59858b389 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:29.601047 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03373a-8644-46c3-8a4e-74c59858b389 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:29.604262 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86d294-862a-4945-b7bf-e2855b7e506f None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:29.610423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03373a-8644-46c3-8a4e-74c59858b389 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:29.612090 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03373a-8644-46c3-8a4e-74c59858b389 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:29.619576 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:29.625578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-9c03373a-8644-46c3-8a4e-74c59858b389 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 03:42:29.625578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:29.625578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:29.625578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:29.625578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:29.625578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:29.625578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:29.625578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:29.625578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:29.625578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:29.625578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:29.625578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:29.625578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:29.625578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:29.625578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:29.625578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:29.626768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:29.626768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:29.626768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:29.626768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:29.626768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:29.626768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:29.626768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:29.626768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:29.626768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:29.626768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:29.626768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:29.626768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:29.626768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:29.626768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:29.626768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:29.626768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:29.626768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:29.626768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:29.627733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:29.627733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:29.627733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:29.627733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:29.627733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:29.627733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:29.627733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:29.627733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:29.627733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 03:42:29.627733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:29.627733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 253/516] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:29.628297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03373a-8644-46c3-8a4e-74c59858b389 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:29.646165 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef227b58-c9a9-49e8-8d65-b6bac8621048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:29.646715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef227b58-c9a9-49e8-8d65-b6bac8621048 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:29.647002 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef227b58-c9a9-49e8-8d65-b6bac8621048 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:29.647553 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef227b58-c9a9-49e8-8d65-b6bac8621048 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:29.648372 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef227b58-c9a9-49e8-8d65-b6bac8621048 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:29.648695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef227b58-c9a9-49e8-8d65-b6bac8621048 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:29.650145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef227b58-c9a9-49e8-8d65-b6bac8621048 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:29.665130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 264/517] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:29.666136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef227b58-c9a9-49e8-8d65-b6bac8621048 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:29.695277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:29.767094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03373a-8644-46c3-8a4e-74c59858b389 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:29.794934 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef227b58-c9a9-49e8-8d65-b6bac8621048 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:29.810263 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f893577-9272-4a7a-a052-5abeae32ed92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:29.810925 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f893577-9272-4a7a-a052-5abeae32ed92 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:29.811207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f893577-9272-4a7a-a052-5abeae32ed92 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:29.811515 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f893577-9272-4a7a-a052-5abeae32ed92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:29.823213 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f893577-9272-4a7a-a052-5abeae32ed92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:29.824731 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f893577-9272-4a7a-a052-5abeae32ed92 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:29.841310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-8f893577-9272-4a7a-a052-5abeae32ed92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:29.841310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:29.841310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:29.841310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:29.841310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:29.841310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:29.841310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:29.841310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:29.841310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:29.841310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:29.841310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:29.841310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:29.841310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:29.841310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:29.841310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:29.842242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:29.842242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:29.842242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:29.842242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:29.842242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:29.842242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:29.842242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:29.842242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:29.842242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:29.842242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:29.842242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:29.842242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:29.842242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:29.842242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:29.842242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:29.842242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:29.842242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:29.843072 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:29.843072 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:29.843072 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:29.843072 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:29.843072 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 254/518] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:29.843808 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f893577-9272-4a7a-a052-5abeae32ed92 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:29.870394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6da02-aa83-4ca7-aa9f-a08d0a1f2bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:29.871036 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6da02-aa83-4ca7-aa9f-a08d0a1f2bcc None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:29.871313 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6da02-aa83-4ca7-aa9f-a08d0a1f2bcc None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:29.871604 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6da02-aa83-4ca7-aa9f-a08d0a1f2bcc None admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:29.872376 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6da02-aa83-4ca7-aa9f-a08d0a1f2bcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:29.872682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6da02-aa83-4ca7-aa9f-a08d0a1f2bcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:29.874255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6da02-aa83-4ca7-aa9f-a08d0a1f2bcc None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:29.895234 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 265/519] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:42:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:29.896237 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6da02-aa83-4ca7-aa9f-a08d0a1f2bcc None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:29.930911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:29.985439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f893577-9272-4a7a-a052-5abeae32ed92 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:29.989399 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:30.006560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6da02-aa83-4ca7-aa9f-a08d0a1f2bcc None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:30.023861 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa277a98-2d7f-4e34-b0be-a4df050b2fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:30.024535 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa277a98-2d7f-4e34-b0be-a4df050b2fbd None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:30.025030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa277a98-2d7f-4e34-b0be-a4df050b2fbd None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:30.025662 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa277a98-2d7f-4e34-b0be-a4df050b2fbd None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:30.026432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa277a98-2d7f-4e34-b0be-a4df050b2fbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:30.026801 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa277a98-2d7f-4e34-b0be-a4df050b2fbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:30.028287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa277a98-2d7f-4e34-b0be-a4df050b2fbd None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:30.042046 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 255/520] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:30.042725 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e5e2c-5d2a-44c4-a925-0ff92a91c370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:30.043365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa277a98-2d7f-4e34-b0be-a4df050b2fbd None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:30.043521 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e5e2c-5d2a-44c4-a925-0ff92a91c370 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:30.043735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e5e2c-5d2a-44c4-a925-0ff92a91c370 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:30.043928 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e5e2c-5d2a-44c4-a925-0ff92a91c370 None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:30.044732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e5e2c-5d2a-44c4-a925-0ff92a91c370 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:30.045038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e5e2c-5d2a-44c4-a925-0ff92a91c370 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:30.046483 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e5e2c-5d2a-44c4-a925-0ff92a91c370 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:30.089946 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 266/521] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 28 03:42:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:30.090805 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e5e2c-5d2a-44c4-a925-0ff92a91c370 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:30.162618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa277a98-2d7f-4e34-b0be-a4df050b2fbd None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:30.192029 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:30.201335 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc051b2-a4f2-4b2c-afd0-9639e6df10a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:30.201916 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e5e2c-5d2a-44c4-a925-0ff92a91c370 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:30.202026 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc051b2-a4f2-4b2c-afd0-9639e6df10a7 None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:30.206484 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc051b2-a4f2-4b2c-afd0-9639e6df10a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:30.206484 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc051b2-a4f2-4b2c-afd0-9639e6df10a7 None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:30.206484 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc051b2-a4f2-4b2c-afd0-9639e6df10a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:30.206484 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc051b2-a4f2-4b2c-afd0-9639e6df10a7 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:30.239218 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14808f5-95cf-4b24-a9f3-b2f8ed013dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:30.239938 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14808f5-95cf-4b24-a9f3-b2f8ed013dba None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:30.240224 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14808f5-95cf-4b24-a9f3-b2f8ed013dba None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:30.240502 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14808f5-95cf-4b24-a9f3-b2f8ed013dba None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:30.241218 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14808f5-95cf-4b24-a9f3-b2f8ed013dba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:30.241524 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14808f5-95cf-4b24-a9f3-b2f8ed013dba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:30.242925 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14808f5-95cf-4b24-a9f3-b2f8ed013dba None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:30.255686 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 267/522] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:30.256545 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14808f5-95cf-4b24-a9f3-b2f8ed013dba None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:30.304670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 256/523] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 28 03:42:30 2022] POST /identity/v3/users => generated 247 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:42:30.305600 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc051b2-a4f2-4b2c-afd0-9639e6df10a7 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:30.339284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:30.383156 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14808f5-95cf-4b24-a9f3-b2f8ed013dba None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:30.428109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43005d92-9ee5-4c9e-9128-b6dd83af6cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:30.429029 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43005d92-9ee5-4c9e-9128-b6dd83af6cd1 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:30.429320 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43005d92-9ee5-4c9e-9128-b6dd83af6cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:30.429516 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc051b2-a4f2-4b2c-afd0-9639e6df10a7 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:30.429637 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43005d92-9ee5-4c9e-9128-b6dd83af6cd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:30.430405 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43005d92-9ee5-4c9e-9128-b6dd83af6cd1 None admin] RBAC: Adding query filter params (role.id=183fd05fe14a41828222fd09b6280796, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=5133abf4c32a45b0b2188f71496c572b) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:30.430726 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43005d92-9ee5-4c9e-9128-b6dd83af6cd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:30.432380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43005d92-9ee5-4c9e-9128-b6dd83af6cd1 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:30.438921 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 268/524] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:42:30 2022] GET /identity/v3/role_assignments?user.id=5133abf4c32a45b0b2188f71496c572b&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=183fd05fe14a41828222fd09b6280796 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:30.439846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43005d92-9ee5-4c9e-9128-b6dd83af6cd1 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:30.469023 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:30.487149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b213ce-e427-4b29-9882-529a82bdfd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:30.487866 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b213ce-e427-4b29-9882-529a82bdfd8e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:30.488154 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b213ce-e427-4b29-9882-529a82bdfd8e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:30.488436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b213ce-e427-4b29-9882-529a82bdfd8e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:30.499759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b213ce-e427-4b29-9882-529a82bdfd8e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:30.505166 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b213ce-e427-4b29-9882-529a82bdfd8e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:30.521366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-93b213ce-e427-4b29-9882-529a82bdfd8e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 03:42:30.521366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:30.521366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:30.521366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:30.521366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:30.521366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:30.521366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:30.521366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:30.521366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:30.521366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:30.521366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:30.521366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:30.521366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:30.521366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:30.521366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:30.521366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:30.522520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:30.522520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:30.522520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:30.522520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:30.522520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:30.522520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:30.522520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:30.522520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:30.522520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:30.522520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:30.522520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:30.522520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:30.522520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:30.522520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:30.522520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:30.522520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:30.522520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:30.522520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:30.523661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:30.523661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:30.523661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:30.523661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:30.523661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:30.523661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:30.523661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:30.523661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:30.523661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 03:42:30.523661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:30.523661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 257/525] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:42:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:30.524390 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b213ce-e427-4b29-9882-529a82bdfd8e None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:30.593236 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43005d92-9ee5-4c9e-9128-b6dd83af6cd1 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:30.638732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d41c3-1f0c-4639-b952-27fbe9e1ef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:30.640136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d41c3-1f0c-4639-b952-27fbe9e1ef6e None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:30.641583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d41c3-1f0c-4639-b952-27fbe9e1ef6e None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:30.642492 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d41c3-1f0c-4639-b952-27fbe9e1ef6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:30.644321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:30.670751 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b213ce-e427-4b29-9882-529a82bdfd8e None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:30.709965 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfc86e-c692-4cbf-af02-b7c139a78173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:30.711007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfc86e-c692-4cbf-af02-b7c139a78173 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:30.711482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfc86e-c692-4cbf-af02-b7c139a78173 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:30.711901 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfc86e-c692-4cbf-af02-b7c139a78173 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:30.720656 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfc86e-c692-4cbf-af02-b7c139a78173 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:30.722336 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfc86e-c692-4cbf-af02-b7c139a78173 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:30.730205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d41c3-1f0c-4639-b952-27fbe9e1ef6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:30.732273 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d41c3-1f0c-4639-b952-27fbe9e1ef6e None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:30.745565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-4adfc86e-c692-4cbf-af02-b7c139a78173 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:30.745565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:30.745565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:30.745565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:30.745565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:30.745565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:30.745565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:30.745565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:30.745565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:30.745565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:30.745565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:30.745565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:30.745565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:42:30.745565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:42:30.745565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:42:30.759249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:42:30.759249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:30.759249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:30.759249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:30.759249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:30.759249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:30.759249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:30.759249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:30.759249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:30.759249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:30.759249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:30.759249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:30.759249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:30.759249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:30.759249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:30.759249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:30.759249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:30.760175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:42:30.760175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:42:30.760175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:42:30.760175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:42:30.760175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:42:30.760175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:42:30.760175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:30.760175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:30.760175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 258/526] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:30.760175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfc86e-c692-4cbf-af02-b7c139a78173 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:30.760696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:30.850807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 269/527] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:30.850807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d41c3-1f0c-4639-b952-27fbe9e1ef6e None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:30.907926 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfc86e-c692-4cbf-af02-b7c139a78173 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:30.958463 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707af64f-2b2e-4011-a382-f3616a6a2e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:30.959872 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707af64f-2b2e-4011-a382-f3616a6a2e20 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:30.960226 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707af64f-2b2e-4011-a382-f3616a6a2e20 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:30.961064 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707af64f-2b2e-4011-a382-f3616a6a2e20 None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:30.961905 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707af64f-2b2e-4011-a382-f3616a6a2e20 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:30.962210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707af64f-2b2e-4011-a382-f3616a6a2e20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:30.963736 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707af64f-2b2e-4011-a382-f3616a6a2e20 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:30.967761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d41c3-1f0c-4639-b952-27fbe9e1ef6e None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:30.974681 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:30.987608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 259/528] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Jul 28 03:42:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:30.993259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707af64f-2b2e-4011-a382-f3616a6a2e20 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:30.993476 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:31.014933 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3f388-24a9-4078-93e9-337c52ab99e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:31.016579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3f388-24a9-4078-93e9-337c52ab99e1 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:31.017851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3f388-24a9-4078-93e9-337c52ab99e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:31.018663 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3f388-24a9-4078-93e9-337c52ab99e1 None admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:31.020385 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3f388-24a9-4078-93e9-337c52ab99e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:31.021071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3f388-24a9-4078-93e9-337c52ab99e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:31.023273 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3f388-24a9-4078-93e9-337c52ab99e1 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:31.044626 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 270/529] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:42:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:31.046121 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3f388-24a9-4078-93e9-337c52ab99e1 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:31.100048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707af64f-2b2e-4011-a382-f3616a6a2e20 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:31.147664 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff9284-b941-4631-9fd3-ade2e4108279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:31.148479 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff9284-b941-4631-9fd3-ade2e4108279 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:31.149412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff9284-b941-4631-9fd3-ade2e4108279 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:31.149798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff9284-b941-4631-9fd3-ade2e4108279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:31.163644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3f388-24a9-4078-93e9-337c52ab99e1 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:31.165775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff9284-b941-4631-9fd3-ade2e4108279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:31.168329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff9284-b941-4631-9fd3-ade2e4108279 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:31.188256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-21ff9284-b941-4631-9fd3-ade2e4108279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:31.188256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:31.188256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:31.188256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:31.188256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:31.188256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:31.188256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:31.188256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:31.188256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:31.188256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:31.188256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:31.188256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:31.188256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:31.188256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:31.188256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:31.189384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:31.189384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:31.189384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:31.189384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:31.189384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:31.189384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:31.189384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:31.189384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:31.189384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:31.189384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:31.189384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:31.189384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:31.189384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:31.189384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:31.189384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:31.189384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:31.189384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:31.190413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:31.190413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:31.190413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:31.190413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:31.195794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 260/530] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:31.196851 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff9284-b941-4631-9fd3-ade2e4108279 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:31.204698 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ecce2-6e5d-4a91-a595-948165af57b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:31.206033 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ecce2-6e5d-4a91-a595-948165af57b8 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:31.206499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ecce2-6e5d-4a91-a595-948165af57b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:31.206915 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ecce2-6e5d-4a91-a595-948165af57b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:31.254433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:31.255299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:31.282657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ecce2-6e5d-4a91-a595-948165af57b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:31.284727 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ecce2-6e5d-4a91-a595-948165af57b8 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:31.313602 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff9284-b941-4631-9fd3-ade2e4108279 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:31.352513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98fe9f-e3f1-4464-8fd7-786957b8a9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:31.353526 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98fe9f-e3f1-4464-8fd7-786957b8a9e0 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:31.354004 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98fe9f-e3f1-4464-8fd7-786957b8a9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:31.354582 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98fe9f-e3f1-4464-8fd7-786957b8a9e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:31.355715 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98fe9f-e3f1-4464-8fd7-786957b8a9e0 None admin] RBAC: Adding query filter params (role.id=183fd05fe14a41828222fd09b6280796, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=9bfc1fe981424313aecce5af443c8a9b) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:31.356228 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98fe9f-e3f1-4464-8fd7-786957b8a9e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:31.357864 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98fe9f-e3f1-4464-8fd7-786957b8a9e0 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:31.371941 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 261/531] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:42:31 2022] GET /identity/v3/role_assignments?user.id=9bfc1fe981424313aecce5af443c8a9b&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=183fd05fe14a41828222fd09b6280796 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:31.373321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98fe9f-e3f1-4464-8fd7-786957b8a9e0 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:31.394050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 271/532] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:31.399523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ecce2-6e5d-4a91-a595-948165af57b8 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:31.485750 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:31.511612 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ecce2-6e5d-4a91-a595-948165af57b8 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:31.551051 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a934b4-0ca4-469c-a738-713af676fb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:31.551792 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a934b4-0ca4-469c-a738-713af676fb57 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:31.552076 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a934b4-0ca4-469c-a738-713af676fb57 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:31.552349 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a934b4-0ca4-469c-a738-713af676fb57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:31.564718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a934b4-0ca4-469c-a738-713af676fb57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:31.566461 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a934b4-0ca4-469c-a738-713af676fb57 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:31.582432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-32a934b4-0ca4-469c-a738-713af676fb57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:31.582432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:31.582432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:31.582432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:31.582432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:31.582432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:31.582432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:31.582432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:31.582432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:31.582432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:31.582432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:31.582432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:31.582432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:31.582432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:31.582432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:31.584107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:31.584107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:31.584107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:31.584107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:31.584107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:31.584107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:31.584107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:31.584107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:31.584107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:31.584107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:31.584107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:31.584107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:31.584107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:31.584107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:31.584107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:31.584107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:31.584107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:31.585789 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:31.585789 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:31.585789 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:31.585789 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:31.585789 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 272/533] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:42:31.589544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a934b4-0ca4-469c-a738-713af676fb57 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:31.605466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98fe9f-e3f1-4464-8fd7-786957b8a9e0 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:31.644766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:31.679881 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624989a-3cd7-4968-91dc-28352a07c38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:31.680997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624989a-3cd7-4968-91dc-28352a07c38d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:31.681500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624989a-3cd7-4968-91dc-28352a07c38d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:31.681996 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624989a-3cd7-4968-91dc-28352a07c38d None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:31.683491 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624989a-3cd7-4968-91dc-28352a07c38d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:31.684264 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624989a-3cd7-4968-91dc-28352a07c38d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:31.685966 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624989a-3cd7-4968-91dc-28352a07c38d None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:31.709699 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 262/534] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:31.715879 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624989a-3cd7-4968-91dc-28352a07c38d None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:31.727353 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a934b4-0ca4-469c-a738-713af676fb57 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:31.751904 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:31.760742 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f9eb0-5d48-4f50-835c-31fb971c0490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:31.761373 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f9eb0-5d48-4f50-835c-31fb971c0490 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:31.761716 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f9eb0-5d48-4f50-835c-31fb971c0490 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:31.761940 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f9eb0-5d48-4f50-835c-31fb971c0490 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:31.762646 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f9eb0-5d48-4f50-835c-31fb971c0490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:31.762951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f9eb0-5d48-4f50-835c-31fb971c0490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:31.764474 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f9eb0-5d48-4f50-835c-31fb971c0490 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:31.788189 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 273/535] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:31.793624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f9eb0-5d48-4f50-835c-31fb971c0490 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:31.910242 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f9eb0-5d48-4f50-835c-31fb971c0490 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:31.936275 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624989a-3cd7-4968-91dc-28352a07c38d None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:31.975314 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3272e7-e99e-4d1c-b55b-5b1bff968d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:31.975999 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3272e7-e99e-4d1c-b55b-5b1bff968d80 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:31.976281 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3272e7-e99e-4d1c-b55b-5b1bff968d80 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:31.976557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3272e7-e99e-4d1c-b55b-5b1bff968d80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:31.985527 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3272e7-e99e-4d1c-b55b-5b1bff968d80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:31.986991 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3272e7-e99e-4d1c-b55b-5b1bff968d80 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:31.988233 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73ca33-e7e6-49fc-a441-42b84b922ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:31.989217 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73ca33-e7e6-49fc-a441-42b84b922ded None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:31.989805 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73ca33-e7e6-49fc-a441-42b84b922ded None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:31.990294 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73ca33-e7e6-49fc-a441-42b84b922ded None admin] PATH_INFO: `/v3/projects/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:31.999261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-ba3272e7-e99e-4d1c-b55b-5b1bff968d80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:31.999261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:31.999261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:31.999261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:31.999261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:31.999261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:31.999261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:31.999261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:31.999261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:31.999261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:31.999261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:31.999261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:31.999261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:42:31.999261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:42:31.999261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:42:32.000845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:42:32.000845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:32.000845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:32.000845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:32.000845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:32.000845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:32.000845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:32.000845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:32.000845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:32.000845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:32.000845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:32.000845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:32.000845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:32.000845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:32.000845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:32.000845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:32.000845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:32.001682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:42:32.001682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:42:32.001682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:42:32.001682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:42:32.001682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:42:32.001682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:42:32.001682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:32.001682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:32.001682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 263/536] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:42:32.007371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3272e7-e99e-4d1c-b55b-5b1bff968d80 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:32.014380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73ca33-e7e6-49fc-a441-42b84b922ded None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:32.016728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73ca33-e7e6-49fc-a441-42b84b922ded None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:32.038130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-0e73ca33-e7e6-49fc-a441-42b84b922ded None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:32.038130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:32.038130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:32.038130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:32.038130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:32.038130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:32.038130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:32.038130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:32.038130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:32.038130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:32.038130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:32.038130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:32.038130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:42:32.038130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:42:32.038130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:42:32.039015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:42:32.039015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:32.039015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:32.039015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:32.039015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:32.039015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:32.039015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:32.039015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:32.039015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:32.039015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:32.039015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:32.039015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:32.039015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:32.039015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:32.039015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:32.039015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:32.039015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:32.039958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:42:32.039958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:42:32.039958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:42:32.039958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:42:32.039958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:42:32.039958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:42:32.039958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:32.039958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:32.042388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 274/537] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:42:32.049302 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73ca33-e7e6-49fc-a441-42b84b922ded None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:32.055845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:32.153013 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:32.176827 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3272e7-e99e-4d1c-b55b-5b1bff968d80 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:32.243703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff299fe5-d5f8-4b34-b688-f462212f0908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:32.244352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff299fe5-d5f8-4b34-b688-f462212f0908 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:32.244631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff299fe5-d5f8-4b34-b688-f462212f0908 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:32.244906 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff299fe5-d5f8-4b34-b688-f462212f0908 None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:32.245675 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff299fe5-d5f8-4b34-b688-f462212f0908 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:32.245985 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff299fe5-d5f8-4b34-b688-f462212f0908 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:32.247493 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff299fe5-d5f8-4b34-b688-f462212f0908 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:32.272236 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73ca33-e7e6-49fc-a441-42b84b922ded None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:32.298536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 264/538] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:42:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:32.317842 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307ed40-f70f-46fe-acf0-d12043da9348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:32.318479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307ed40-f70f-46fe-acf0-d12043da9348 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:32.318762 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307ed40-f70f-46fe-acf0-d12043da9348 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:32.319015 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff299fe5-d5f8-4b34-b688-f462212f0908 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:32.319120 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307ed40-f70f-46fe-acf0-d12043da9348 None admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:32.319971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307ed40-f70f-46fe-acf0-d12043da9348 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:32.320295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307ed40-f70f-46fe-acf0-d12043da9348 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:32.321845 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307ed40-f70f-46fe-acf0-d12043da9348 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:32.339709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 275/539] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:42:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:32.341581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307ed40-f70f-46fe-acf0-d12043da9348 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:32.522015 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:32.528671 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307ed40-f70f-46fe-acf0-d12043da9348 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:32.537546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff299fe5-d5f8-4b34-b688-f462212f0908 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:32.552272 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:32.596335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab06a9-038b-4416-b6fd-ff9c196f6f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:32.596963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab06a9-038b-4416-b6fd-ff9c196f6f14 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:32.597251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab06a9-038b-4416-b6fd-ff9c196f6f14 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:32.597524 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab06a9-038b-4416-b6fd-ff9c196f6f14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:32.598330 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab06a9-038b-4416-b6fd-ff9c196f6f14 None admin] RBAC: Adding query filter params (role.id=183fd05fe14a41828222fd09b6280796, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=03742c23cae849d9bf4ce0b432edd1cc) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:32.598640 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab06a9-038b-4416-b6fd-ff9c196f6f14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:32.600176 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab06a9-038b-4416-b6fd-ff9c196f6f14 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:32.602637 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcda660-d6d4-4a3d-8f3d-c53f0da60d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:32.603275 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcda660-d6d4-4a3d-8f3d-c53f0da60d50 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:32.603572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcda660-d6d4-4a3d-8f3d-c53f0da60d50 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:32.603912 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcda660-d6d4-4a3d-8f3d-c53f0da60d50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:32.604710 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcda660-d6d4-4a3d-8f3d-c53f0da60d50 None admin] RBAC: Adding query filter params (role.id=183fd05fe14a41828222fd09b6280796, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=dd31134e1f8545b0bbbe3c223b165df1) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:32.605026 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcda660-d6d4-4a3d-8f3d-c53f0da60d50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:32.606591 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcda660-d6d4-4a3d-8f3d-c53f0da60d50 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:32.616547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 276/540] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:42:32 2022] GET /identity/v3/role_assignments?user.id=03742c23cae849d9bf4ce0b432edd1cc&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=183fd05fe14a41828222fd09b6280796 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:32.616794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 265/541] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:42:32 2022] GET /identity/v3/role_assignments?user.id=dd31134e1f8545b0bbbe3c223b165df1&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=183fd05fe14a41828222fd09b6280796 => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:32.686429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baaf0d-5906-4ee8-8391-45975ce0f544 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:32.686763 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baaf0d-5906-4ee8-8391-45975ce0f544 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:32.687008 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8baaf0d-5906-4ee8-8391-45975ce0f544 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:32.689765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 277/542] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:32.695985 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb8775-b315-4b69-984f-2010461bda35 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:32.696432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb8775-b315-4b69-984f-2010461bda35 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:32.696874 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb8775-b315-4b69-984f-2010461bda35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:32.728748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-d9bb8775-b315-4b69-984f-2010461bda35 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:32.730028 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d9bb8775-b315-4b69-984f-2010461bda35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:32.806098 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cda8f0-13e1-4529-88f0-0d3f0de48400 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:32.806720 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cda8f0-13e1-4529-88f0-0d3f0de48400 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:32.807218 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cda8f0-13e1-4529-88f0-0d3f0de48400 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:32.811436 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 278/543] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:42:32.818720 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c2342-807a-45b2-87e7-b4f01eb1bb1c None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:32.819393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c2342-807a-45b2-87e7-b4f01eb1bb1c None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:32.820062 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c2342-807a-45b2-87e7-b4f01eb1bb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:32.848374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 266/544] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:32.850018 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-826c2342-807a-45b2-87e7-b4f01eb1bb1c None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:32.851645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-826c2342-807a-45b2-87e7-b4f01eb1bb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:32.874768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb8775-b315-4b69-984f-2010461bda35 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:33.002018 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 279/545] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:42:33.026561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c2342-807a-45b2-87e7-b4f01eb1bb1c None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:33.067734 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:33.115697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb8775-b315-4b69-984f-2010461bda35 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:33.139561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:33.144064 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c2342-807a-45b2-87e7-b4f01eb1bb1c None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:33.180911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b33fc-9022-4477-8f9e-b625eff2b7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:33.181575 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b33fc-9022-4477-8f9e-b625eff2b7f1 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:33.181866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b33fc-9022-4477-8f9e-b625eff2b7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:33.182150 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b33fc-9022-4477-8f9e-b625eff2b7f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:33.193418 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b33fc-9022-4477-8f9e-b625eff2b7f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:33.198478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-5e9b33fc-9022-4477-8f9e-b625eff2b7f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:33.198478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:33.198478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:33.198478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:33.198478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:33.198478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:33.198478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:33.198478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:33.198478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:33.198478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:33.198478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:33.198478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:33.198478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:33.198478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:33.198478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:33.198478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:33.199434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:33.199434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:33.199434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:33.199434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:33.199434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:33.199434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:33.199434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:33.199434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:33.199434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:33.199434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:33.199434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:33.199434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:33.199434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:33.199434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:33.199434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:33.199434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:33.200619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:33.200619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:33.200619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:33.200619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:33.200619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:33.200619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:33.200619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:33.200619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:33.200619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:33.200619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:33.200619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:33.200619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:33.200619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 280/546] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:42:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:42:33.208657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b33fc-9022-4477-8f9e-b625eff2b7f1 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:33.218030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb96ead-74f2-4eca-8282-4c6fe663bf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:33.220298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb96ead-74f2-4eca-8282-4c6fe663bf74 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:33.220802 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb96ead-74f2-4eca-8282-4c6fe663bf74 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:33.221296 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb96ead-74f2-4eca-8282-4c6fe663bf74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:33.247381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb96ead-74f2-4eca-8282-4c6fe663bf74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:33.254145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-afb96ead-74f2-4eca-8282-4c6fe663bf74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:33.254145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:33.254145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:33.254145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:33.254145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:33.254145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:33.254145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:33.254145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:33.254145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:33.254145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:33.254145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:33.254145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:33.254145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:33.254145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:33.254145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:33.254145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:33.255134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:33.255134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:33.255134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:33.255134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:33.255134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:33.255134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:33.255134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:33.255134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:33.255134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:33.255134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:33.255134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:33.255134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:33.255134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:33.255134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:33.255134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:33.255134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:33.255938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:33.255938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:33.255938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:33.255938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:33.255938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:33.255938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:33.255938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:33.255938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:33.255938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:33.255938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:33.255938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:33.255938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:33.265557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 267/547] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:42:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:42:33.273146 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb96ead-74f2-4eca-8282-4c6fe663bf74 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:33.345100 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b33fc-9022-4477-8f9e-b625eff2b7f1 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:33.393000 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb96ead-74f2-4eca-8282-4c6fe663bf74 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:33.407958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a410d8-563c-49da-a7c1-40dbe66a08a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:33.408652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a410d8-563c-49da-a7c1-40dbe66a08a1 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:33.408937 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a410d8-563c-49da-a7c1-40dbe66a08a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:33.409215 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a410d8-563c-49da-a7c1-40dbe66a08a1 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:33.409950 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a410d8-563c-49da-a7c1-40dbe66a08a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:33.410257 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a410d8-563c-49da-a7c1-40dbe66a08a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:33.412066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a410d8-563c-49da-a7c1-40dbe66a08a1 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:33.425948 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 281/548] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:42:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:33.438011 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a410d8-563c-49da-a7c1-40dbe66a08a1 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:33.443159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1925b57-f2fd-4f8f-af19-d44954f7339e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:33.444140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1925b57-f2fd-4f8f-af19-d44954f7339e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:33.444792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1925b57-f2fd-4f8f-af19-d44954f7339e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:33.445358 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1925b57-f2fd-4f8f-af19-d44954f7339e None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:33.446993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1925b57-f2fd-4f8f-af19-d44954f7339e None admin] RBAC: Adding query filter params (name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:33.447744 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1925b57-f2fd-4f8f-af19-d44954f7339e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:33.449365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1925b57-f2fd-4f8f-af19-d44954f7339e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:33.465127 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 268/549] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:42:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:33.476401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1925b57-f2fd-4f8f-af19-d44954f7339e None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:33.493374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:33.502476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:33.605207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1925b57-f2fd-4f8f-af19-d44954f7339e None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:33.653421 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e4b1b-8978-4dd2-b7f3-28b5452888d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:33.654471 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e4b1b-8978-4dd2-b7f3-28b5452888d4 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:33.655209 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e4b1b-8978-4dd2-b7f3-28b5452888d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:33.655697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e4b1b-8978-4dd2-b7f3-28b5452888d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:33.655957 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a410d8-563c-49da-a7c1-40dbe66a08a1 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:33.668079 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e4b1b-8978-4dd2-b7f3-28b5452888d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:33.669996 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e4b1b-8978-4dd2-b7f3-28b5452888d4 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:33.686834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-363e4b1b-8978-4dd2-b7f3-28b5452888d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:33.686834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:33.686834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:33.686834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:33.686834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:33.686834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:33.686834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:33.686834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:33.686834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:33.686834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:33.686834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:33.686834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:33.686834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:33.686834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:33.686834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:33.688868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:33.688868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:33.688868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:33.688868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:33.688868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:33.688868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:33.688868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:33.688868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:33.688868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:33.688868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:33.688868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:33.688868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:33.688868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:33.688868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:33.688868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:33.688868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:33.688868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:33.689833 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:33.689833 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:33.689833 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:33.689833 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:33.692217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 269/550] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:42:33.697694 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e4b1b-8978-4dd2-b7f3-28b5452888d4 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:33.745571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a12325-5c4e-4e6d-9bb5-9834538a8a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:33.746266 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a12325-5c4e-4e6d-9bb5-9834538a8a00 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:33.747027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a12325-5c4e-4e6d-9bb5-9834538a8a00 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:33.747027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a12325-5c4e-4e6d-9bb5-9834538a8a00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:33.764066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a12325-5c4e-4e6d-9bb5-9834538a8a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:33.767879 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a12325-5c4e-4e6d-9bb5-9834538a8a00 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:33.794862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-18a12325-5c4e-4e6d-9bb5-9834538a8a00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:33.794862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:33.794862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:33.794862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:33.794862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:33.794862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:33.794862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:33.794862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:33.794862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:33.794862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:33.794862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:33.794862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:33.794862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:33.794862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:33.794862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:33.795765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:33.795765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:33.795765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:33.795765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:33.795765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:33.795765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:33.795765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:33.795765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:33.795765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:33.795765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:33.795765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:33.795765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:33.795765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:33.795765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:33.795765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:33.795765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:33.795765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:33.796601 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:33.796601 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:33.796601 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:33.796601 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:33.798451 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 282/551] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:33.806394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a12325-5c4e-4e6d-9bb5-9834538a8a00 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:33.831676 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:33.897943 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e4b1b-8978-4dd2-b7f3-28b5452888d4 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:33.939555 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ff81d-831a-4b15-9282-8c9022b6dca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:33.940202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ff81d-831a-4b15-9282-8c9022b6dca5 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:33.940492 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ff81d-831a-4b15-9282-8c9022b6dca5 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:33.940770 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ff81d-831a-4b15-9282-8c9022b6dca5 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:33.941475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ff81d-831a-4b15-9282-8c9022b6dca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:33.941784 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ff81d-831a-4b15-9282-8c9022b6dca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:33.943573 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ff81d-831a-4b15-9282-8c9022b6dca5 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:33.958958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 270/552] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:33.965103 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ff81d-831a-4b15-9282-8c9022b6dca5 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:33.971628 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:34.024527 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a12325-5c4e-4e6d-9bb5-9834538a8a00 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:34.080026 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70117f9c-ed49-4045-950a-09bc22bac027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:34.080659 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70117f9c-ed49-4045-950a-09bc22bac027 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:34.080941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70117f9c-ed49-4045-950a-09bc22bac027 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:34.081216 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70117f9c-ed49-4045-950a-09bc22bac027 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:34.081923 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70117f9c-ed49-4045-950a-09bc22bac027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:34.082226 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70117f9c-ed49-4045-950a-09bc22bac027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:34.084260 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70117f9c-ed49-4045-950a-09bc22bac027 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:34.099855 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 283/553] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:34.101416 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ddeb2-4691-4161-95f6-ad86904398e8 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:34.101702 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ddeb2-4691-4161-95f6-ad86904398e8 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:34.101973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ddeb2-4691-4161-95f6-ad86904398e8 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:34.103725 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 284/554] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:34.112992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b1c9c-b4c1-4b9c-b942-1c280dca137f None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:34.113190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b1c9c-b4c1-4b9c-b942-1c280dca137f None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:34.113424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b1c9c-b4c1-4b9c-b942-1c280dca137f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:34.127829 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ff81d-831a-4b15-9282-8c9022b6dca5 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:34.137385 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-cc7b1c9c-b4c1-4b9c-b942-1c280dca137f None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:34.139059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-cc7b1c9c-b4c1-4b9c-b942-1c280dca137f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:34.156291 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:34.169464 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f0060-f503-4fa3-bde6-7e14cb491db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:34.172025 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f0060-f503-4fa3-bde6-7e14cb491db7 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:34.172025 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f0060-f503-4fa3-bde6-7e14cb491db7 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:34.172025 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f0060-f503-4fa3-bde6-7e14cb491db7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:34.179507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f0060-f503-4fa3-bde6-7e14cb491db7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:34.181345 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f0060-f503-4fa3-bde6-7e14cb491db7 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:34.196998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-c32f0060-f503-4fa3-bde6-7e14cb491db7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:42:34.196998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:34.196998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:34.196998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:34.196998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:34.196998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:34.196998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:34.196998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:34.196998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:34.196998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:34.196998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:34.196998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:34.196998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:34.196998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:34.196998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:34.196998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:34.197976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:34.197976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:34.197976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:34.197976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:34.197976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:34.197976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:34.197976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:34.197976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:34.197976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:34.197976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:34.197976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:34.197976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:34.197976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:34.197976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:34.197976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:34.197976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:34.197976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:34.197976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:34.199022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:34.199022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:34.199022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:34.199022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:34.199022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:34.199022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:34.199022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:34.199022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:34.199022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:42:34.199022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:34.201682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 271/555] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 28 03:42:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:34.202726 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f0060-f503-4fa3-bde6-7e14cb491db7 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:34.235347 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 285/556] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:34.235347 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b1c9c-b4c1-4b9c-b942-1c280dca137f None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:34.315763 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:34.338651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f0060-f503-4fa3-bde6-7e14cb491db7 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:34.363052 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b1c9c-b4c1-4b9c-b942-1c280dca137f None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:34.380305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87123c09-4c31-46df-9681-63783121376c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:34.381300 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87123c09-4c31-46df-9681-63783121376c None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:34.381813 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87123c09-4c31-46df-9681-63783121376c None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:34.382308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87123c09-4c31-46df-9681-63783121376c None admin] PATH_INFO: `/v3/users/swift` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:34.391307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87123c09-4c31-46df-9681-63783121376c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:34.393157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87123c09-4c31-46df-9681-63783121376c None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:34.407601 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783ac96-0bd0-48c2-845e-5882bea1fd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:34.408277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-87123c09-4c31-46df-9681-63783121376c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 03:42:34.408277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:34.408277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:34.408277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:34.408277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:34.408277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:34.408277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:34.408277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:34.408277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:34.408277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:34.408277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:34.408277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:34.408277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:34.408277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:34.408277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:34.408277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:34.409216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:34.409216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:34.409216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:34.409216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:34.409216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:34.409216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:34.409216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:34.409216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:34.409216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:34.409216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:34.409216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:34.409216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:34.409216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:34.409216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:34.409216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:34.409216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:34.409216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:34.409216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:34.410605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:34.410605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:34.410605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:34.410605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:34.410605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:34.410605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:34.410605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:34.410605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:34.410605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 03:42:34.410605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:34.411146 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783ac96-0bd0-48c2-845e-5882bea1fd66 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:34.411146 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783ac96-0bd0-48c2-845e-5882bea1fd66 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:34.411146 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783ac96-0bd0-48c2-845e-5882bea1fd66 None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:34.411146 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783ac96-0bd0-48c2-845e-5882bea1fd66 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:34.411146 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783ac96-0bd0-48c2-845e-5882bea1fd66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:34.411994 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783ac96-0bd0-48c2-845e-5882bea1fd66 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:34.413717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 272/557] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:42:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:34.414729 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87123c09-4c31-46df-9681-63783121376c None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:34.439420 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 286/558] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 28 03:42:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:34.440880 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783ac96-0bd0-48c2-845e-5882bea1fd66 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:34.471944 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:34.537243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87123c09-4c31-46df-9681-63783121376c None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:34.576735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46849ffd-b0ac-4375-9c80-65a99cff085f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:34.577527 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46849ffd-b0ac-4375-9c80-65a99cff085f None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:34.577817 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46849ffd-b0ac-4375-9c80-65a99cff085f None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:34.578087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46849ffd-b0ac-4375-9c80-65a99cff085f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:34.580504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783ac96-0bd0-48c2-845e-5882bea1fd66 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:34.590214 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46849ffd-b0ac-4375-9c80-65a99cff085f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:34.596370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-46849ffd-b0ac-4375-9c80-65a99cff085f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:34.596370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:34.596370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:34.596370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:34.596370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:34.596370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:34.596370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:34.596370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:34.596370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:34.596370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:34.596370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:34.596370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:34.596370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:34.596370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:34.596370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:34.596370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:34.597402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:34.597402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:34.597402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:34.597402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:34.597402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:34.597402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:34.597402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:34.597402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:34.597402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:34.597402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:34.597402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:34.597402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:34.597402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:34.597402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:34.597402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:34.597402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:34.598217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:34.598217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:34.598217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:34.598217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:34.598217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:34.598217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:34.598217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:34.598217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:34.598217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:34.598217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:34.598217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:34.598217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:34.602719 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 273/559] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:42:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:34.603664 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46849ffd-b0ac-4375-9c80-65a99cff085f None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:34.614086 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:34.631371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ab6c0-13dd-49b7-a5e9-c4c00bd42a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:34.632642 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ab6c0-13dd-49b7-a5e9-c4c00bd42a8d None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:34.633169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ab6c0-13dd-49b7-a5e9-c4c00bd42a8d None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:34.633860 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ab6c0-13dd-49b7-a5e9-c4c00bd42a8d None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:34.635624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ab6c0-13dd-49b7-a5e9-c4c00bd42a8d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:34.636143 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ab6c0-13dd-49b7-a5e9-c4c00bd42a8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:34.638726 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ab6c0-13dd-49b7-a5e9-c4c00bd42a8d None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:34.664553 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 287/560] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 28 03:42:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:34.666297 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ab6c0-13dd-49b7-a5e9-c4c00bd42a8d None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:34.727198 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46849ffd-b0ac-4375-9c80-65a99cff085f None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:34.728992 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:34.766606 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffafdbc-632c-46ab-9d22-68edeeda9bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:34.767274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffafdbc-632c-46ab-9d22-68edeeda9bbc None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:34.767577 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffafdbc-632c-46ab-9d22-68edeeda9bbc None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:34.767861 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffafdbc-632c-46ab-9d22-68edeeda9bbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:34.788778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffafdbc-632c-46ab-9d22-68edeeda9bbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:34.791575 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffafdbc-632c-46ab-9d22-68edeeda9bbc None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:34.813754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-4ffafdbc-632c-46ab-9d22-68edeeda9bbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:34.813754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:34.813754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:34.813754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:34.813754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:34.813754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:34.813754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:34.813754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:34.813754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:34.813754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:34.813754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:34.813754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:34.813754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:34.813754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:34.813754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:34.814794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:34.814794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:34.814794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:34.814794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:34.814794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:34.814794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:34.814794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:34.814794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:34.814794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:34.814794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:34.814794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:34.814794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:34.814794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:34.814794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:34.814794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:34.814794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:34.814794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:34.815674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:34.815674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:34.815674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:34.815674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:34.815888 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ab6c0-13dd-49b7-a5e9-c4c00bd42a8d None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:34.818567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 274/561] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:34.819580 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffafdbc-632c-46ab-9d22-68edeeda9bbc None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:34.865280 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922554a-4cd2-42a0-af94-c785b6075c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:34.866268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922554a-4cd2-42a0-af94-c785b6075c28 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:34.866767 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922554a-4cd2-42a0-af94-c785b6075c28 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:34.867236 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922554a-4cd2-42a0-af94-c785b6075c28 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:34.868162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922554a-4cd2-42a0-af94-c785b6075c28 None admin] RBAC: Adding query filter params (name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:34.868661 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922554a-4cd2-42a0-af94-c785b6075c28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:34.870285 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922554a-4cd2-42a0-af94-c785b6075c28 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:34.880412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 288/562] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:42:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:34.881529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922554a-4cd2-42a0-af94-c785b6075c28 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:34.929938 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:34.943229 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffafdbc-632c-46ab-9d22-68edeeda9bbc None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:34.979664 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77526ada-e034-41f2-8e37-bd37802267c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:34.980294 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77526ada-e034-41f2-8e37-bd37802267c7 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:34.980576 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77526ada-e034-41f2-8e37-bd37802267c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:34.980850 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77526ada-e034-41f2-8e37-bd37802267c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:34.993937 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922554a-4cd2-42a0-af94-c785b6075c28 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:35.009657 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:35.035032 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf16d9-a26e-4a91-80c1-f7044d077d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:35.035691 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf16d9-a26e-4a91-80c1-f7044d077d8a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:35.036282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf16d9-a26e-4a91-80c1-f7044d077d8a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:35.036282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf16d9-a26e-4a91-80c1-f7044d077d8a None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:35.037006 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf16d9-a26e-4a91-80c1-f7044d077d8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:35.037309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf16d9-a26e-4a91-80c1-f7044d077d8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:35.038685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf16d9-a26e-4a91-80c1-f7044d077d8a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:35.051980 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 289/563] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:35.053175 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf16d9-a26e-4a91-80c1-f7044d077d8a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:35.071241 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77526ada-e034-41f2-8e37-bd37802267c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:35.073165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77526ada-e034-41f2-8e37-bd37802267c7 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:35.160737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf16d9-a26e-4a91-80c1-f7044d077d8a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:35.162732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:35.178459 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 275/564] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:35.180151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b35ac-8e9a-49e8-b324-92c4b8ac61b3 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:35.180393 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b35ac-8e9a-49e8-b324-92c4b8ac61b3 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:35.180681 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b35ac-8e9a-49e8-b324-92c4b8ac61b3 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:35.181967 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 276/565] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:35.182751 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b35ac-8e9a-49e8-b324-92c4b8ac61b3 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:35.201729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823fefbb-68cf-46ce-83b9-73e6578133f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:35.202496 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fefbb-68cf-46ce-83b9-73e6578133f7 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:35.203085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fefbb-68cf-46ce-83b9-73e6578133f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:35.203085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fefbb-68cf-46ce-83b9-73e6578133f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:35.214359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fefbb-68cf-46ce-83b9-73e6578133f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:35.215877 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fefbb-68cf-46ce-83b9-73e6578133f7 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:35.231397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-823fefbb-68cf-46ce-83b9-73e6578133f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:35.231397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:35.231397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:35.231397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:35.231397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:35.231397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:35.231397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:35.231397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:35.231397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:35.231397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:35.231397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:35.231397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:35.231397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:35.231397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:35.231397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:35.232478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:35.232478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:35.232478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:35.232478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:35.232478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:35.232478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:35.232478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:35.232478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:35.232478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:35.232478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:35.232478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:35.232478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:35.232478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:35.232478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:35.232478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:35.232478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:35.232478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:35.233351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:35.233351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:35.233351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:35.233351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:35.233351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 290/566] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:35.234038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba29a-0eee-477b-b8dd-cc8e550bd184 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:35.234327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba29a-0eee-477b-b8dd-cc8e550bd184 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:35.234657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba29a-0eee-477b-b8dd-cc8e550bd184 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:35.236220 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 291/567] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:35.240385 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bba29a-0eee-477b-b8dd-cc8e550bd184 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:35.247078 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:35.292850 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b35ac-8e9a-49e8-b324-92c4b8ac61b3 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:35.333134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d789c4-03ce-4465-a6e5-7029ef986c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:35.333809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d789c4-03ce-4465-a6e5-7029ef986c74 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:35.334092 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d789c4-03ce-4465-a6e5-7029ef986c74 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:35.334467 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d789c4-03ce-4465-a6e5-7029ef986c74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:35.341604 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d789c4-03ce-4465-a6e5-7029ef986c74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:35.343055 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d789c4-03ce-4465-a6e5-7029ef986c74 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:35.350191 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bba29a-0eee-477b-b8dd-cc8e550bd184 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:35.354557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-b4d789c4-03ce-4465-a6e5-7029ef986c74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:35.354557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:35.354557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:35.354557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:35.354557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:35.354557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:35.354557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:35.354557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:35.354557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:35.354557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:35.354557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:35.354557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:35.354557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:42:35.354557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:42:35.354557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:42:35.356998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:42:35.356998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:35.356998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:35.356998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:35.356998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:35.356998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:35.356998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:35.356998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:35.356998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:35.356998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:35.356998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:35.356998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:35.356998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:35.356998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:35.356998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:35.356998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:35.356998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:35.357847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:42:35.357847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:42:35.357847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:42:35.357847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:42:35.357847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:42:35.357847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:42:35.357847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:35.357847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:35.357847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 277/568] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:35.357847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5796f-6d9c-4e06-9966-81f2c9941162 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:35.357847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5796f-6d9c-4e06-9966-81f2c9941162 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:35.358430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5796f-6d9c-4e06-9966-81f2c9941162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:35.376496 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-8be5796f-6d9c-4e06-9966-81f2c9941162 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:35.377551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-8be5796f-6d9c-4e06-9966-81f2c9941162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:35.394889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cbdad-8cf9-46ac-91e5-11e119bef658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:35.395594 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cbdad-8cf9-46ac-91e5-11e119bef658 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:35.395875 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cbdad-8cf9-46ac-91e5-11e119bef658 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:35.396149 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cbdad-8cf9-46ac-91e5-11e119bef658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:35.407953 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18cbdad-8cf9-46ac-91e5-11e119bef658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:35.409547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18cbdad-8cf9-46ac-91e5-11e119bef658 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:35.425152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-d18cbdad-8cf9-46ac-91e5-11e119bef658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:35.425152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:35.425152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:35.425152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:35.425152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:35.425152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:35.425152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:35.425152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:35.425152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:35.425152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:35.425152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:35.425152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:35.425152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:35.425152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:35.425152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:35.426080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:35.426080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:35.426080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:35.426080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:35.426080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:35.426080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:35.426080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:35.426080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:35.426080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:35.426080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:35.426080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:35.426080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:35.426080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:35.426080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:35.426080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:35.426080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:35.426080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:35.426958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:35.426958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:35.426958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:35.426958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:35.431241 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 292/569] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:35.432090 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cbdad-8cf9-46ac-91e5-11e119bef658 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:35.444268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:35.466842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 278/570] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:35.468515 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94ca5d-e324-4eaa-b1ad-0d3ca7e5ffa0 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:35.469018 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94ca5d-e324-4eaa-b1ad-0d3ca7e5ffa0 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:35.469462 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94ca5d-e324-4eaa-b1ad-0d3ca7e5ffa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:35.508421 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-fb94ca5d-e324-4eaa-b1ad-0d3ca7e5ffa0 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:35.509767 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-fb94ca5d-e324-4eaa-b1ad-0d3ca7e5ffa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:35.556248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:35.565520 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cbdad-8cf9-46ac-91e5-11e119bef658 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:35.588070 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 279/571] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:35.588964 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94ca5d-e324-4eaa-b1ad-0d3ca7e5ffa0 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:35.611445 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03012f48-bff9-4006-a853-9cfa8b8d8d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:35.611445 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03012f48-bff9-4006-a853-9cfa8b8d8d3d None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:35.612633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03012f48-bff9-4006-a853-9cfa8b8d8d3d None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:35.612935 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03012f48-bff9-4006-a853-9cfa8b8d8d3d None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:35.613804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03012f48-bff9-4006-a853-9cfa8b8d8d3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:35.614129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03012f48-bff9-4006-a853-9cfa8b8d8d3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:35.616299 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03012f48-bff9-4006-a853-9cfa8b8d8d3d None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:35.639497 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 293/572] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:35.639497 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03012f48-bff9-4006-a853-9cfa8b8d8d3d None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:35.719236 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:35.722612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94ca5d-e324-4eaa-b1ad-0d3ca7e5ffa0 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:35.754663 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03012f48-bff9-4006-a853-9cfa8b8d8d3d None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:35.757526 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53332580-e4a0-4efa-93d2-7fe56dceff9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:35.758161 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53332580-e4a0-4efa-93d2-7fe56dceff9d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:35.758440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53332580-e4a0-4efa-93d2-7fe56dceff9d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:35.758716 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53332580-e4a0-4efa-93d2-7fe56dceff9d None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:35.759509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53332580-e4a0-4efa-93d2-7fe56dceff9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:35.759868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53332580-e4a0-4efa-93d2-7fe56dceff9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:35.761321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53332580-e4a0-4efa-93d2-7fe56dceff9d None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:35.774193 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 280/573] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:42:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:35.775395 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53332580-e4a0-4efa-93d2-7fe56dceff9d None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:35.800327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32e293-88ea-4cf9-858a-59e613cfff70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:35.800964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32e293-88ea-4cf9-858a-59e613cfff70 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:35.801250 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32e293-88ea-4cf9-858a-59e613cfff70 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:35.801529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32e293-88ea-4cf9-858a-59e613cfff70 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:35.802233 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32e293-88ea-4cf9-858a-59e613cfff70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:35.802540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32e293-88ea-4cf9-858a-59e613cfff70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:35.804010 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32e293-88ea-4cf9-858a-59e613cfff70 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:35.815588 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:35.816342 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 294/574] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:35.817330 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32e293-88ea-4cf9-858a-59e613cfff70 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:35.890951 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53332580-e4a0-4efa-93d2-7fe56dceff9d None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:35.924343 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32e293-88ea-4cf9-858a-59e613cfff70 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:35.925631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbae6e7-ae45-48f2-a854-ebb0e0328340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:35.926280 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbae6e7-ae45-48f2-a854-ebb0e0328340 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:35.926558 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbae6e7-ae45-48f2-a854-ebb0e0328340 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:35.926837 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbae6e7-ae45-48f2-a854-ebb0e0328340 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:35.937270 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbae6e7-ae45-48f2-a854-ebb0e0328340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:35.944374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-5bbae6e7-ae45-48f2-a854-ebb0e0328340 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:35.944374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:35.944374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:35.944374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:35.944374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:35.944374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:35.944374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:35.944374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:35.944374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:35.944374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:35.944374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:35.944374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:35.944374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:35.944374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:35.944374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:35.944374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:35.945546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:35.945546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:35.945546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:35.945546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:35.945546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:35.945546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:35.945546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:35.945546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:35.945546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:35.945546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:35.945546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:35.945546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:35.945546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:35.945546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:35.945546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:35.945546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:35.951572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:35.951572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:35.951572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:35.951572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:35.951572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:35.951572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:35.951572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:35.951572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:35.951572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:35.951572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:35.951572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:35.951572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:35.951572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 281/575] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:42:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:35.951572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbae6e7-ae45-48f2-a854-ebb0e0328340 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:35.957109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:35.965425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ee6ab-0aee-4caa-b38d-3f522d8bc3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:35.966073 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ee6ab-0aee-4caa-b38d-3f522d8bc3bb None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:35.968581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ee6ab-0aee-4caa-b38d-3f522d8bc3bb None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:35.968581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ee6ab-0aee-4caa-b38d-3f522d8bc3bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:35.977829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ee6ab-0aee-4caa-b38d-3f522d8bc3bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:35.982766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-6f3ee6ab-0aee-4caa-b38d-3f522d8bc3bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:35.982766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:35.982766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:35.982766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:35.982766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:35.982766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:35.982766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:35.982766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:35.982766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:35.982766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:35.982766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:35.982766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:35.982766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:35.982766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:35.982766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:35.982766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:35.984174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:35.984174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:35.984174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:35.984174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:35.984174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:35.984174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:35.984174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:35.984174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:35.984174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:35.984174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:35.984174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:35.984174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:35.984174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:35.984174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:35.984174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:35.984174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:35.985624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:35.985624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:35.985624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:35.985624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:35.985624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:35.985624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:35.985624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:35.985624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:35.985624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:35.985624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:35.985624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:35.985624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:35.985624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 295/576] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:42:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:35.986380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ee6ab-0aee-4caa-b38d-3f522d8bc3bb None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:36.047627 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:36.054538 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbae6e7-ae45-48f2-a854-ebb0e0328340 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:36.093603 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a8bbd-b80c-431b-adcf-579c6f36ff11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:36.094753 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a8bbd-b80c-431b-adcf-579c6f36ff11 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:36.095220 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a8bbd-b80c-431b-adcf-579c6f36ff11 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:36.095545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a8bbd-b80c-431b-adcf-579c6f36ff11 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:36.096917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ee6ab-0aee-4caa-b38d-3f522d8bc3bb None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:36.103285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a8bbd-b80c-431b-adcf-579c6f36ff11 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:36.105050 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a8bbd-b80c-431b-adcf-579c6f36ff11 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:36.117448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-9e2a8bbd-b80c-431b-adcf-579c6f36ff11 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 03:42:36.117448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:36.117448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:36.117448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:36.117448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:36.117448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:36.117448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:36.117448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:36.117448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:36.117448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:36.117448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:36.117448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:36.117448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:36.117448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:36.117448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:36.117448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:36.118506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:36.118506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:36.118506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:36.118506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:36.118506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:36.118506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:36.118506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:36.118506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:36.118506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:36.118506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:36.118506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:36.118506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:36.118506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:36.118506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:36.118506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:36.118506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:36.118506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:36.118506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:36.119524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:36.119524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:36.119524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:36.119524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:36.119524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:36.119524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:36.119524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:36.119524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:36.119524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 03:42:36.119524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:36.119524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 282/577] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:36.119524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a8bbd-b80c-431b-adcf-579c6f36ff11 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:36.137028 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55635eb-3df1-4d0e-a60e-44cb2ed8ed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:36.137700 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55635eb-3df1-4d0e-a60e-44cb2ed8ed7c None admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:36.137980 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55635eb-3df1-4d0e-a60e-44cb2ed8ed7c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:36.138254 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55635eb-3df1-4d0e-a60e-44cb2ed8ed7c None admin] PATH_INFO: `/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/5133abf4c32a45b0b2188f71496c572b/roles/183fd05fe14a41828222fd09b6280796` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:36.154077 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55635eb-3df1-4d0e-a60e-44cb2ed8ed7c None admin] RBAC: Authorizing `identity:create_grant(project_id=28b7995e83524b9293d1c6fc319e5a85, user_id=5133abf4c32a45b0b2188f71496c572b, role_id=183fd05fe14a41828222fd09b6280796)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:36.156009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55635eb-3df1-4d0e-a60e-44cb2ed8ed7c None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:36.224414 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a8bbd-b80c-431b-adcf-579c6f36ff11 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:36.232410 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 296/578] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:42:35 2022] PUT /identity/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/5133abf4c32a45b0b2188f71496c572b/roles/183fd05fe14a41828222fd09b6280796 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:42:36.233182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55635eb-3df1-4d0e-a60e-44cb2ed8ed7c None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:36.265599 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc849d9-3a0a-4a9a-865d-e7de3820d486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:36.266847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc849d9-3a0a-4a9a-865d-e7de3820d486 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:36.267136 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc849d9-3a0a-4a9a-865d-e7de3820d486 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:36.267451 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc849d9-3a0a-4a9a-865d-e7de3820d486 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:36.275128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc849d9-3a0a-4a9a-865d-e7de3820d486 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:36.276632 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc849d9-3a0a-4a9a-865d-e7de3820d486 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:36.285449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:36.291338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-2cc849d9-3a0a-4a9a-865d-e7de3820d486 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:36.291338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:36.291338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:36.291338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:36.291338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:36.291338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:36.291338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:36.291338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:36.291338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:36.291338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:36.291338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:36.291338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:36.291338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:42:36.291338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:42:36.291338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:42:36.292511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:42:36.292511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:36.292511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:36.292511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:36.292511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:36.292511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:36.292511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:36.292511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:36.292511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:36.292511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:36.292511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:36.292511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:36.292511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:36.292511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:36.292511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:36.292511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:36.292511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:36.293423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:42:36.293423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:42:36.293423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:42:36.293423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:42:36.293423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:42:36.293423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:42:36.293423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:36.293423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:36.293423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 283/579] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:36.293926 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc849d9-3a0a-4a9a-865d-e7de3820d486 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:36.319299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:36.363779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55635eb-3df1-4d0e-a60e-44cb2ed8ed7c None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:36.409364 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbce8cb-d819-4e8a-9f60-98dbf9eb7f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:36.410235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbce8cb-d819-4e8a-9f60-98dbf9eb7f65 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:36.410341 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbce8cb-d819-4e8a-9f60-98dbf9eb7f65 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:36.410536 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbce8cb-d819-4e8a-9f60-98dbf9eb7f65 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:36.411271 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbce8cb-d819-4e8a-9f60-98dbf9eb7f65 None admin] RBAC: Adding query filter params (name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:36.411605 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbce8cb-d819-4e8a-9f60-98dbf9eb7f65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:36.413011 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbce8cb-d819-4e8a-9f60-98dbf9eb7f65 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:36.423451 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc849d9-3a0a-4a9a-865d-e7de3820d486 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:36.424664 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 297/580] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:42:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:36.425745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbce8cb-d819-4e8a-9f60-98dbf9eb7f65 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:36.464549 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5930b0c-5f49-44a1-b43d-5f99ebc6360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:36.465184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5930b0c-5f49-44a1-b43d-5f99ebc6360c None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:36.465459 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5930b0c-5f49-44a1-b43d-5f99ebc6360c None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:36.465740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5930b0c-5f49-44a1-b43d-5f99ebc6360c None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:36.466461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5930b0c-5f49-44a1-b43d-5f99ebc6360c None admin] RBAC: Adding query filter params (name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:36.466768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5930b0c-5f49-44a1-b43d-5f99ebc6360c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:36.468216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5930b0c-5f49-44a1-b43d-5f99ebc6360c None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:36.478382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 284/581] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:42:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:36.480083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5930b0c-5f49-44a1-b43d-5f99ebc6360c None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:36.540669 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:36.545586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbce8cb-d819-4e8a-9f60-98dbf9eb7f65 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:36.568553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:36.586042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e37005-e0f7-4c4d-aca0-d02f7816a05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:36.586781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e37005-e0f7-4c4d-aca0-d02f7816a05c None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:36.587161 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e37005-e0f7-4c4d-aca0-d02f7816a05c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:36.587531 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e37005-e0f7-4c4d-aca0-d02f7816a05c None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:36.588387 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e37005-e0f7-4c4d-aca0-d02f7816a05c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:36.588710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e37005-e0f7-4c4d-aca0-d02f7816a05c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:36.590207 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e37005-e0f7-4c4d-aca0-d02f7816a05c None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:36.597869 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5930b0c-5f49-44a1-b43d-5f99ebc6360c None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:36.609886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 298/582] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 28 03:42:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:36.610744 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e37005-e0f7-4c4d-aca0-d02f7816a05c None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:36.643222 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af72a0-6fb4-4cc3-accb-463cfe3a237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:36.643886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af72a0-6fb4-4cc3-accb-463cfe3a237c None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:36.644172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af72a0-6fb4-4cc3-accb-463cfe3a237c None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:36.644449 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af72a0-6fb4-4cc3-accb-463cfe3a237c None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:36.645206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af72a0-6fb4-4cc3-accb-463cfe3a237c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:36.645602 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af72a0-6fb4-4cc3-accb-463cfe3a237c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:36.646958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5af72a0-6fb4-4cc3-accb-463cfe3a237c None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:36.662174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 285/583] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:42:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:36.662950 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af72a0-6fb4-4cc3-accb-463cfe3a237c None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:36.726250 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e37005-e0f7-4c4d-aca0-d02f7816a05c None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:36.764572 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3d476-c57b-46bf-b99d-6800958433d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:36.765218 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3d476-c57b-46bf-b99d-6800958433d5 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:36.765677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3d476-c57b-46bf-b99d-6800958433d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:36.765917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3d476-c57b-46bf-b99d-6800958433d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:36.776799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af72a0-6fb4-4cc3-accb-463cfe3a237c None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:36.783041 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3d476-c57b-46bf-b99d-6800958433d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:36.785024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3d476-c57b-46bf-b99d-6800958433d5 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:36.801571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-d5b3d476-c57b-46bf-b99d-6800958433d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:36.801571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:36.801571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:36.801571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:36.801571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:36.801571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:36.801571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:36.801571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:36.801571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:36.801571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:36.801571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:36.801571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:36.801571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:36.801571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:36.801571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:36.802737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:36.802737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:36.802737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:36.802737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:36.802737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:36.802737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:36.802737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:36.802737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:36.802737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:36.802737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:36.802737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:36.802737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:36.802737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:36.802737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:36.802737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:36.802737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:36.802737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:36.808368 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:36.808368 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:36.808368 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:36.808368 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:36.808368 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 299/584] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:36.808368 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3d476-c57b-46bf-b99d-6800958433d5 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:36.817510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:36.828384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edaa95-9ee4-4902-ae69-571fc58d7a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:36.832239 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edaa95-9ee4-4902-ae69-571fc58d7a42 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:36.832239 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edaa95-9ee4-4902-ae69-571fc58d7a42 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:36.832239 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edaa95-9ee4-4902-ae69-571fc58d7a42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:36.832982 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:36.840551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edaa95-9ee4-4902-ae69-571fc58d7a42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:36.842000 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edaa95-9ee4-4902-ae69-571fc58d7a42 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:36.857567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-53edaa95-9ee4-4902-ae69-571fc58d7a42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:36.857567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:36.857567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:36.857567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:36.857567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:36.857567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:36.857567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:36.857567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:36.857567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:36.857567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:36.857567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:36.857567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:36.857567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:36.857567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:36.857567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:36.858633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:36.858633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:36.858633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:36.858633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:36.858633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:36.858633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:36.858633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:36.858633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:36.858633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:36.858633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:36.858633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:36.858633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:36.858633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:36.858633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:36.858633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:36.858633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:36.858633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:36.860528 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:36.860528 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:36.860528 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:36.860528 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:36.860528 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 286/585] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:36.864666 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edaa95-9ee4-4902-ae69-571fc58d7a42 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:36.918114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3d476-c57b-46bf-b99d-6800958433d5 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:36.960201 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19d568-38be-4ecf-ac0b-3f258702c153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:36.961135 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19d568-38be-4ecf-ac0b-3f258702c153 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:36.961581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19d568-38be-4ecf-ac0b-3f258702c153 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:36.962081 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19d568-38be-4ecf-ac0b-3f258702c153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:36.975663 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edaa95-9ee4-4902-ae69-571fc58d7a42 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:36.979515 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19d568-38be-4ecf-ac0b-3f258702c153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:36.981153 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19d568-38be-4ecf-ac0b-3f258702c153 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:37.001421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-bb19d568-38be-4ecf-ac0b-3f258702c153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:37.001421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:37.001421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:37.001421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:37.001421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:37.001421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:37.001421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:37.001421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:37.001421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:37.001421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:37.001421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:37.001421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:37.001421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:37.001421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:37.001421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:37.002690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:37.002690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:37.002690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:37.002690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:37.002690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:37.002690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:37.002690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:37.002690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:37.002690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:37.002690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:37.002690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:37.002690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:37.002690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:37.002690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:37.002690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:37.002690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:37.002690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:37.003820 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:37.003820 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:37.003820 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:37.003820 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:37.009122 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 300/586] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:37.009122 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19d568-38be-4ecf-ac0b-3f258702c153 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:37.018471 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6e0d0-cd0c-47cc-ba7b-24b57830be5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:37.019211 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6e0d0-cd0c-47cc-ba7b-24b57830be5c None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:37.019584 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6e0d0-cd0c-47cc-ba7b-24b57830be5c None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:37.019926 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6e0d0-cd0c-47cc-ba7b-24b57830be5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:37.020797 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6e0d0-cd0c-47cc-ba7b-24b57830be5c None admin] RBAC: Adding query filter params (role.id=183fd05fe14a41828222fd09b6280796, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=382ff6087bf4486d8651162880825eb2) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:37.021175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6e0d0-cd0c-47cc-ba7b-24b57830be5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:37.022687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6e0d0-cd0c-47cc-ba7b-24b57830be5c None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:37.028749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 287/587] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:42:36 2022] GET /identity/v3/role_assignments?user.id=382ff6087bf4486d8651162880825eb2&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=183fd05fe14a41828222fd09b6280796 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:37.040441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6e0d0-cd0c-47cc-ba7b-24b57830be5c None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:37.089677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:37.128780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:37.150094 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19d568-38be-4ecf-ac0b-3f258702c153 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:37.192005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6e0d0-cd0c-47cc-ba7b-24b57830be5c None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:37.194385 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b5d7a-6b08-40b4-9f2e-cf1f85089b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:37.195107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b5d7a-6b08-40b4-9f2e-cf1f85089b5e None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:37.196196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b5d7a-6b08-40b4-9f2e-cf1f85089b5e None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:37.196607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b5d7a-6b08-40b4-9f2e-cf1f85089b5e None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:37.197385 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b5d7a-6b08-40b4-9f2e-cf1f85089b5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:37.197756 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b5d7a-6b08-40b4-9f2e-cf1f85089b5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:37.199212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b5d7a-6b08-40b4-9f2e-cf1f85089b5e None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:37.215122 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 301/588] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:37.216233 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b5d7a-6b08-40b4-9f2e-cf1f85089b5e None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:37.232840 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f093bd-8252-44dd-b0c7-6e4ce5c9b029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:37.233718 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f093bd-8252-44dd-b0c7-6e4ce5c9b029 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:37.234172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f093bd-8252-44dd-b0c7-6e4ce5c9b029 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:37.235174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f093bd-8252-44dd-b0c7-6e4ce5c9b029 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:37.236138 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f093bd-8252-44dd-b0c7-6e4ce5c9b029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:37.236668 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f093bd-8252-44dd-b0c7-6e4ce5c9b029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:37.238319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f093bd-8252-44dd-b0c7-6e4ce5c9b029 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:37.254347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 288/589] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:37.256128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f093bd-8252-44dd-b0c7-6e4ce5c9b029 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:37.346516 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b5d7a-6b08-40b4-9f2e-cf1f85089b5e None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:37.371472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f093bd-8252-44dd-b0c7-6e4ce5c9b029 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:37.379297 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:37.389798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:37.399728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8767e-70b5-4e45-8072-5c5fe5732e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:37.400915 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8767e-70b5-4e45-8072-5c5fe5732e22 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:37.401367 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8767e-70b5-4e45-8072-5c5fe5732e22 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:37.401969 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8767e-70b5-4e45-8072-5c5fe5732e22 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:37.403185 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8767e-70b5-4e45-8072-5c5fe5732e22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:37.403981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8767e-70b5-4e45-8072-5c5fe5732e22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:37.406977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8767e-70b5-4e45-8072-5c5fe5732e22 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:37.416005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b085ed-55a5-4e24-919a-2107e890a418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:37.421327 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b085ed-55a5-4e24-919a-2107e890a418 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:37.421327 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b085ed-55a5-4e24-919a-2107e890a418 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:37.421327 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b085ed-55a5-4e24-919a-2107e890a418 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:37.425271 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 302/590] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:37.426646 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8767e-70b5-4e45-8072-5c5fe5732e22 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:37.431342 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b085ed-55a5-4e24-919a-2107e890a418 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:37.433003 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b085ed-55a5-4e24-919a-2107e890a418 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:37.447354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-d0b085ed-55a5-4e24-919a-2107e890a418 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 03:42:37.447354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:37.447354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:37.447354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:37.447354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:37.447354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:37.447354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:37.447354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:37.447354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:37.447354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:37.447354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:37.447354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:37.447354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:37.447354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:37.447354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:37.447354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:37.448609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:37.448609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:37.448609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:37.448609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:37.448609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:37.448609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:37.448609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:37.448609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:37.448609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:37.448609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:37.448609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:37.448609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:37.448609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:37.448609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:37.448609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:37.448609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:37.448609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:37.448609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:37.449791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:37.449791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:37.449791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:37.449791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:37.449791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:37.449791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:37.449791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:37.449791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:37.449791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 03:42:37.449791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:37.450603 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 289/591] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:37.451520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b085ed-55a5-4e24-919a-2107e890a418 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:37.551361 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8767e-70b5-4e45-8072-5c5fe5732e22 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:37.567952 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b085ed-55a5-4e24-919a-2107e890a418 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:37.590528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172c3b2-09b6-4cd3-8a5a-7d2cf458f12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:37.591196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172c3b2-09b6-4cd3-8a5a-7d2cf458f12a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:37.591511 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172c3b2-09b6-4cd3-8a5a-7d2cf458f12a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:37.591790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172c3b2-09b6-4cd3-8a5a-7d2cf458f12a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:37.601092 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172c3b2-09b6-4cd3-8a5a-7d2cf458f12a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:37.602694 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172c3b2-09b6-4cd3-8a5a-7d2cf458f12a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:37.607728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c73e9-cc4f-4cbb-82c6-1de89b13774c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:37.608737 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c73e9-cc4f-4cbb-82c6-1de89b13774c None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:37.609113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c73e9-cc4f-4cbb-82c6-1de89b13774c None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:37.610365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c73e9-cc4f-4cbb-82c6-1de89b13774c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:37.615680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-0172c3b2-09b6-4cd3-8a5a-7d2cf458f12a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 03:42:37.615680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:37.615680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:37.615680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:37.615680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:37.615680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:37.615680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:37.615680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:37.615680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:37.615680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:37.615680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:37.615680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:37.615680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:37.615680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:37.615680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:37.615680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:37.616776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:37.616776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:37.616776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:37.616776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:37.616776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:37.616776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:37.616776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:37.616776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:37.616776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:37.616776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:37.616776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:37.616776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:37.616776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:37.616776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:37.616776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:37.616776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:37.616776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:37.616776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:37.617942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:37.617942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:37.617942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:37.617942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:37.617942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:37.617942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:37.617942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:37.617942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:37.617942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 03:42:37.617942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:37.621615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 303/592] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:42:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:37.622501 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172c3b2-09b6-4cd3-8a5a-7d2cf458f12a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:37.623019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c73e9-cc4f-4cbb-82c6-1de89b13774c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:37.624618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c73e9-cc4f-4cbb-82c6-1de89b13774c None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:37.637873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-859c73e9-cc4f-4cbb-82c6-1de89b13774c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:37.637873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:37.637873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:37.637873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:37.637873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:37.637873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:37.637873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:37.637873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:37.637873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:37.637873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:37.637873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:37.637873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:37.637873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:42:37.637873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:42:37.637873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:42:37.638946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:42:37.638946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:37.638946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:37.638946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:37.638946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:37.638946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:37.638946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:37.638946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:37.638946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:37.638946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:37.638946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:37.638946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:37.638946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:37.638946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:37.638946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:37.638946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:37.638946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:37.640087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:42:37.640087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:42:37.640087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:42:37.640087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:42:37.640087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:42:37.640087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:42:37.640087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:37.640087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:37.642392 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 290/593] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:37.648153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c73e9-cc4f-4cbb-82c6-1de89b13774c None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:37.675696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:37.685168 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:37.734120 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172c3b2-09b6-4cd3-8a5a-7d2cf458f12a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:37.766682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c73e9-cc4f-4cbb-82c6-1de89b13774c None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:37.772838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972379f-300a-46f5-abe7-d193ea3bc649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:37.773716 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972379f-300a-46f5-abe7-d193ea3bc649 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:37.774161 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972379f-300a-46f5-abe7-d193ea3bc649 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:37.774620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972379f-300a-46f5-abe7-d193ea3bc649 None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:37.776247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972379f-300a-46f5-abe7-d193ea3bc649 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:37.776737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972379f-300a-46f5-abe7-d193ea3bc649 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:37.778330 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972379f-300a-46f5-abe7-d193ea3bc649 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:37.803219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 304/594] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 28 03:42:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:37.804327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972379f-300a-46f5-abe7-d193ea3bc649 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:37.824328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a34214-baf6-4872-b772-90677577d6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:37.825194 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a34214-baf6-4872-b772-90677577d6ba None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:37.825645 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a34214-baf6-4872-b772-90677577d6ba None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:37.826016 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a34214-baf6-4872-b772-90677577d6ba None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:37.826991 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a34214-baf6-4872-b772-90677577d6ba None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:37.827440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a34214-baf6-4872-b772-90677577d6ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:37.829739 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a34214-baf6-4872-b772-90677577d6ba None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:37.855021 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 291/595] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Jul 28 03:42:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:37.856168 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a34214-baf6-4872-b772-90677577d6ba None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:37.930027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:37.936037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972379f-300a-46f5-abe7-d193ea3bc649 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:37.974119 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:37.979163 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444157eb-2996-462c-8f7b-bf3e49097557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:37.979952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444157eb-2996-462c-8f7b-bf3e49097557 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:37.980337 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444157eb-2996-462c-8f7b-bf3e49097557 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:37.980720 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444157eb-2996-462c-8f7b-bf3e49097557 None admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:37.981759 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444157eb-2996-462c-8f7b-bf3e49097557 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:37.982134 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444157eb-2996-462c-8f7b-bf3e49097557 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:37.983843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444157eb-2996-462c-8f7b-bf3e49097557 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:37.986737 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a34214-baf6-4872-b772-90677577d6ba None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:38.003678 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 305/596] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:42:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:38.004777 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444157eb-2996-462c-8f7b-bf3e49097557 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:38.032779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6db3e-aea2-47c4-827b-a1b03a7fae2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:38.033745 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6db3e-aea2-47c4-827b-a1b03a7fae2c None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:38.034173 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6db3e-aea2-47c4-827b-a1b03a7fae2c None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:38.034593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6db3e-aea2-47c4-827b-a1b03a7fae2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:38.049226 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6db3e-aea2-47c4-827b-a1b03a7fae2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:38.051464 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6db3e-aea2-47c4-827b-a1b03a7fae2c None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:38.073702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-a0f6db3e-aea2-47c4-827b-a1b03a7fae2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:38.073702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:38.073702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:38.073702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:38.073702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:38.073702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:38.073702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:38.073702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:38.073702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:38.073702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:38.073702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:38.073702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:38.073702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:38.073702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:38.073702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:38.074809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:38.074809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:38.074809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:38.074809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:38.074809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:38.074809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:38.074809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:38.074809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:38.074809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:38.074809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:38.074809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:38.074809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:38.074809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:38.074809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:38.074809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:38.074809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:38.074809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:38.075836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:38.075836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:38.075836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:38.075836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:38.077783 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 292/597] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:38.078873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6db3e-aea2-47c4-827b-a1b03a7fae2c None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:38.178980 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444157eb-2996-462c-8f7b-bf3e49097557 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:38.206603 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6db3e-aea2-47c4-827b-a1b03a7fae2c None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:38.228494 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70291b-13bb-40f4-be10-ded09eddf38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:38.229926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70291b-13bb-40f4-be10-ded09eddf38c None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:38.230371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70291b-13bb-40f4-be10-ded09eddf38c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:38.230796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70291b-13bb-40f4-be10-ded09eddf38c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:38.246322 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70291b-13bb-40f4-be10-ded09eddf38c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:38.247802 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cca4a-7b21-42a8-8dd7-2ba8fec886fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:38.248404 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70291b-13bb-40f4-be10-ded09eddf38c None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:38.248967 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cca4a-7b21-42a8-8dd7-2ba8fec886fc None admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:38.249353 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cca4a-7b21-42a8-8dd7-2ba8fec886fc None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:38.249738 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cca4a-7b21-42a8-8dd7-2ba8fec886fc None admin] PATH_INFO: `/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/9bfc1fe981424313aecce5af443c8a9b/roles/183fd05fe14a41828222fd09b6280796` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:38.269303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-bc70291b-13bb-40f4-be10-ded09eddf38c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:38.269303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:38.269303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:38.269303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:38.269303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:38.269303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:38.269303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:38.269303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:38.269303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:38.269303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:38.269303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:38.269303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:38.269303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:38.269303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:38.269303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:38.270424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:38.270424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:38.270424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:38.270424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:38.270424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:38.270424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:38.270424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:38.270424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:38.270424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:38.270424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:38.270424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:38.270424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:38.270424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:38.270424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:38.270424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:38.270424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:38.270424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:38.271520 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:38.271520 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:38.271520 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:38.271520 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:38.271787 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:38.273384 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 306/598] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:38.274409 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70291b-13bb-40f4-be10-ded09eddf38c None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:38.275387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cca4a-7b21-42a8-8dd7-2ba8fec886fc None admin] RBAC: Authorizing `identity:create_grant(project_id=28b7995e83524b9293d1c6fc319e5a85, user_id=9bfc1fe981424313aecce5af443c8a9b, role_id=183fd05fe14a41828222fd09b6280796)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:38.277967 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cca4a-7b21-42a8-8dd7-2ba8fec886fc None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:38.292004 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:38.369682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 293/599] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:42:38 2022] PUT /identity/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/9bfc1fe981424313aecce5af443c8a9b/roles/183fd05fe14a41828222fd09b6280796 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:42:38.370760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cca4a-7b21-42a8-8dd7-2ba8fec886fc None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:38.402077 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70291b-13bb-40f4-be10-ded09eddf38c None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:38.452051 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771a9ab-4316-4e91-aa08-a56cf8181933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:38.454265 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771a9ab-4316-4e91-aa08-a56cf8181933 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:38.454899 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771a9ab-4316-4e91-aa08-a56cf8181933 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:38.456050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771a9ab-4316-4e91-aa08-a56cf8181933 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:38.457459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771a9ab-4316-4e91-aa08-a56cf8181933 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:38.457944 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771a9ab-4316-4e91-aa08-a56cf8181933 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:38.460459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771a9ab-4316-4e91-aa08-a56cf8181933 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:38.480635 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 307/600] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:38.483092 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa48ce-100f-4904-9bab-ada7be2cf60a None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:38.483633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa48ce-100f-4904-9bab-ada7be2cf60a None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:38.484121 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa48ce-100f-4904-9bab-ada7be2cf60a None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:38.491591 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 308/601] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:38.491591 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa48ce-100f-4904-9bab-ada7be2cf60a None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:38.528832 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cca4a-7b21-42a8-8dd7-2ba8fec886fc None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:38.581218 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:38.585814 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e2d07-ff99-4cef-82ea-8ba5347e3b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:38.585814 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e2d07-ff99-4cef-82ea-8ba5347e3b12 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:38.585814 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e2d07-ff99-4cef-82ea-8ba5347e3b12 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:38.585814 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e2d07-ff99-4cef-82ea-8ba5347e3b12 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:38.586194 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e2d07-ff99-4cef-82ea-8ba5347e3b12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:38.586194 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e2d07-ff99-4cef-82ea-8ba5347e3b12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:38.587198 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e2d07-ff99-4cef-82ea-8ba5347e3b12 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:38.604540 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 294/602] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:38.606465 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbb046-9256-44a8-afbb-e3b8a619481b None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:38.606816 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbb046-9256-44a8-afbb-e3b8a619481b None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:38.607424 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbb046-9256-44a8-afbb-e3b8a619481b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:38.624479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa48ce-100f-4904-9bab-ada7be2cf60a None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:38.630970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-a6bbb046-9256-44a8-afbb-e3b8a619481b None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:38.631419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a6bbb046-9256-44a8-afbb-e3b8a619481b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:38.674415 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e92c7-d22d-4cee-8327-c8a7a0a30b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:38.676111 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e92c7-d22d-4cee-8327-c8a7a0a30b0b None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:38.676396 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e92c7-d22d-4cee-8327-c8a7a0a30b0b None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:38.676671 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e92c7-d22d-4cee-8327-c8a7a0a30b0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:38.688400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e92c7-d22d-4cee-8327-c8a7a0a30b0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:38.690616 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:38.692607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e92c7-d22d-4cee-8327-c8a7a0a30b0b None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:38.709882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-343e92c7-d22d-4cee-8327-c8a7a0a30b0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:38.709882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:38.709882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:38.709882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:38.709882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:38.709882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:38.709882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:38.709882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:38.709882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:38.709882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:38.709882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:38.709882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:38.709882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:42:38.709882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:42:38.709882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:42:38.710834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:42:38.710834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:38.710834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:38.710834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:38.710834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:38.710834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:38.710834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:38.710834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:38.710834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:38.710834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:38.710834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:38.710834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:38.710834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:38.710834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:38.710834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:38.710834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:38.710834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:38.711753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:42:38.711753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:42:38.711753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:42:38.711753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:42:38.711753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:42:38.711753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:42:38.711753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:38.711753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:38.716643 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 309/603] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:38.716643 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e92c7-d22d-4cee-8327-c8a7a0a30b0b None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:38.719927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 295/604] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:38.720887 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbb046-9256-44a8-afbb-e3b8a619481b None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:38.842624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e92c7-d22d-4cee-8327-c8a7a0a30b0b None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:38.877988 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:38.884331 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a2723-dea7-44de-a588-698681ed1a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:38.885299 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a2723-dea7-44de-a588-698681ed1a38 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:38.891017 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a2723-dea7-44de-a588-698681ed1a38 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:38.891017 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a2723-dea7-44de-a588-698681ed1a38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:38.891609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbb046-9256-44a8-afbb-e3b8a619481b None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:38.895022 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a2723-dea7-44de-a588-698681ed1a38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:38.896822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a2723-dea7-44de-a588-698681ed1a38 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:38.910883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-0d1a2723-dea7-44de-a588-698681ed1a38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:38.910883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:38.910883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:38.910883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:38.910883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:38.910883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:38.910883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:38.910883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:38.910883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:38.910883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:38.910883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:38.910883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:38.910883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:42:38.910883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:42:38.910883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:42:38.912046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:42:38.912046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:38.912046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:38.912046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:38.912046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:38.912046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:38.912046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:38.912046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:38.912046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:38.912046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:38.912046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:38.912046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:38.912046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:38.912046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:38.912046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:38.912046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:38.912046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:38.912909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:42:38.912909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:42:38.912909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:42:38.912909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:42:38.912909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:42:38.912909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:42:38.912909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:38.912909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:38.919809 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 310/605] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:38.920982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a2723-dea7-44de-a588-698681ed1a38 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:38.926901 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214aebf2-c077-48ac-b7fe-6d36a27e1984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:38.927586 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214aebf2-c077-48ac-b7fe-6d36a27e1984 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:38.927871 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214aebf2-c077-48ac-b7fe-6d36a27e1984 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:38.928149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214aebf2-c077-48ac-b7fe-6d36a27e1984 None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:38.928918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214aebf2-c077-48ac-b7fe-6d36a27e1984 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:38.929227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214aebf2-c077-48ac-b7fe-6d36a27e1984 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:38.930747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214aebf2-c077-48ac-b7fe-6d36a27e1984 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:38.949900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 296/606] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:42:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:38.950970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214aebf2-c077-48ac-b7fe-6d36a27e1984 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:39.002128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:39.033638 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a2723-dea7-44de-a588-698681ed1a38 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:39.068400 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214aebf2-c077-48ac-b7fe-6d36a27e1984 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:39.079761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e814609-1136-425b-afd7-d2bd1f66beb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:39.080414 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e814609-1136-425b-afd7-d2bd1f66beb1 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:39.080696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e814609-1136-425b-afd7-d2bd1f66beb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:39.080970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e814609-1136-425b-afd7-d2bd1f66beb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:39.092526 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e814609-1136-425b-afd7-d2bd1f66beb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:39.098976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-9e814609-1136-425b-afd7-d2bd1f66beb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:39.098976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:39.098976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:39.098976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:39.098976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:39.098976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:39.098976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:39.098976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:39.098976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:39.098976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:39.098976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:39.098976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:39.098976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:39.098976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:39.098976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:39.098976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:39.100212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:39.100212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:39.100212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:39.100212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:39.100212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:39.100212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:39.100212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:39.100212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:39.100212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:39.100212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:39.100212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:39.100212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:39.100212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:39.100212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:39.100212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:39.100212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:39.101261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:39.101261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:39.101261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:39.101261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:39.101261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:39.101261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:39.101261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:39.101261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:39.101261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:39.101261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:39.101261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:39.101261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:39.101261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 311/607] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:42:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:39.102016 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e814609-1136-425b-afd7-d2bd1f66beb1 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:39.114270 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9cbd3-36c4-4e38-a081-502ab7f66a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:39.115344 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9cbd3-36c4-4e38-a081-502ab7f66a59 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:39.115791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9cbd3-36c4-4e38-a081-502ab7f66a59 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:39.116222 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9cbd3-36c4-4e38-a081-502ab7f66a59 None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:39.117280 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9cbd3-36c4-4e38-a081-502ab7f66a59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:39.117758 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9cbd3-36c4-4e38-a081-502ab7f66a59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:39.119426 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9cbd3-36c4-4e38-a081-502ab7f66a59 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:39.135172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 297/608] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:42:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:39.136495 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9cbd3-36c4-4e38-a081-502ab7f66a59 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:39.157831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:39.229893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e814609-1136-425b-afd7-d2bd1f66beb1 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:39.252601 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9cbd3-36c4-4e38-a081-502ab7f66a59 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:39.254254 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:39.286863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7dcc3-9869-4a77-a33c-51e4f4c29aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:39.287562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7dcc3-9869-4a77-a33c-51e4f4c29aca None admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:39.287846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7dcc3-9869-4a77-a33c-51e4f4c29aca None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:39.288120 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7dcc3-9869-4a77-a33c-51e4f4c29aca None admin] PATH_INFO: `/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/dd31134e1f8545b0bbbe3c223b165df1/roles/183fd05fe14a41828222fd09b6280796` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:39.293301 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3ffbb-f3ba-43c5-bf68-5844056269e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:39.293933 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3ffbb-f3ba-43c5-bf68-5844056269e5 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:39.294214 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3ffbb-f3ba-43c5-bf68-5844056269e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:39.294488 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3ffbb-f3ba-43c5-bf68-5844056269e5 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:39.295217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3ffbb-f3ba-43c5-bf68-5844056269e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:39.295640 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3ffbb-f3ba-43c5-bf68-5844056269e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:39.297144 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3ffbb-f3ba-43c5-bf68-5844056269e5 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:39.311073 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7dcc3-9869-4a77-a33c-51e4f4c29aca None admin] RBAC: Authorizing `identity:create_grant(project_id=28b7995e83524b9293d1c6fc319e5a85, user_id=dd31134e1f8545b0bbbe3c223b165df1, role_id=183fd05fe14a41828222fd09b6280796)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:39.311371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7dcc3-9869-4a77-a33c-51e4f4c29aca None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:39.311989 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 298/609] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:42:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:39.313808 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3ffbb-f3ba-43c5-bf68-5844056269e5 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:39.424757 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3ffbb-f3ba-43c5-bf68-5844056269e5 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:39.447355 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 312/610] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:42:39 2022] PUT /identity/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/dd31134e1f8545b0bbbe3c223b165df1/roles/183fd05fe14a41828222fd09b6280796 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:42:39.447355 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64383802-e39c-42df-8524-22686c61363a None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:39.447355 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64383802-e39c-42df-8524-22686c61363a None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:39.447355 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64383802-e39c-42df-8524-22686c61363a None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:39.447355 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 313/611] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:39.447355 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64383802-e39c-42df-8524-22686c61363a None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:39.477937 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec3a65-5a6d-46d6-927c-75b4a5b5fa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:39.478739 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec3a65-5a6d-46d6-927c-75b4a5b5fa31 None admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:39.479095 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec3a65-5a6d-46d6-927c-75b4a5b5fa31 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:39.479503 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec3a65-5a6d-46d6-927c-75b4a5b5fa31 None admin] PATH_INFO: `/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/03742c23cae849d9bf4ce0b432edd1cc/roles/183fd05fe14a41828222fd09b6280796` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:39.497819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec3a65-5a6d-46d6-927c-75b4a5b5fa31 None admin] RBAC: Authorizing `identity:create_grant(project_id=28b7995e83524b9293d1c6fc319e5a85, user_id=03742c23cae849d9bf4ce0b432edd1cc, role_id=183fd05fe14a41828222fd09b6280796)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:39.501454 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec3a65-5a6d-46d6-927c-75b4a5b5fa31 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:39.574510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:39.581088 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64383802-e39c-42df-8524-22686c61363a None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:39.593484 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 299/612] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:42:39 2022] PUT /identity/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/03742c23cae849d9bf4ce0b432edd1cc/roles/183fd05fe14a41828222fd09b6280796 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:42:39.596588 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e848a4-4a25-4494-acf5-ec148e8c033a None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:39.597123 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e848a4-4a25-4494-acf5-ec148e8c033a None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:39.597546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e848a4-4a25-4494-acf5-ec148e8c033a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:39.626941 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-29e848a4-4a25-4494-acf5-ec148e8c033a None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:39.628985 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-29e848a4-4a25-4494-acf5-ec148e8c033a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:39.646987 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8c195-c5f8-4f56-89e7-0cee47f9eb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:39.648078 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8c195-c5f8-4f56-89e7-0cee47f9eb18 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:39.648502 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8c195-c5f8-4f56-89e7-0cee47f9eb18 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:39.648953 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8c195-c5f8-4f56-89e7-0cee47f9eb18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:39.649091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:39.665455 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8c195-c5f8-4f56-89e7-0cee47f9eb18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:39.667624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8c195-c5f8-4f56-89e7-0cee47f9eb18 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:39.685752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-7ab8c195-c5f8-4f56-89e7-0cee47f9eb18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:39.685752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:39.685752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:39.685752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:39.685752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:39.685752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:39.685752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:39.685752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:39.685752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:39.685752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:39.685752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:39.685752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:39.685752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:39.685752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:39.685752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:39.687027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:39.687027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:39.687027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:39.687027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:39.687027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:39.687027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:39.687027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:39.687027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:39.687027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:39.687027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:39.687027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:39.687027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:39.687027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:39.687027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:39.687027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:39.687027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:39.687027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:39.688246 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:39.688246 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:39.688246 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:39.688246 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:39.688246 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 314/613] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:39.693299 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8c195-c5f8-4f56-89e7-0cee47f9eb18 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:39.739539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 300/614] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:39.768007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e848a4-4a25-4494-acf5-ec148e8c033a None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:39.849700 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8c195-c5f8-4f56-89e7-0cee47f9eb18 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:39.897114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f890bef-dc00-4fb2-8e24-df91c10ece0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:39.897741 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f890bef-dc00-4fb2-8e24-df91c10ece0d None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:39.898021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f890bef-dc00-4fb2-8e24-df91c10ece0d None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:39.898291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f890bef-dc00-4fb2-8e24-df91c10ece0d None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:39.898984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f890bef-dc00-4fb2-8e24-df91c10ece0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:39.899284 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f890bef-dc00-4fb2-8e24-df91c10ece0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:39.900682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f890bef-dc00-4fb2-8e24-df91c10ece0d None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:39.919691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e848a4-4a25-4494-acf5-ec148e8c033a None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:39.930907 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 315/615] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:39.938120 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f890bef-dc00-4fb2-8e24-df91c10ece0d None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:39.958173 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d11be-3ca2-43ce-a5fa-8dfd0a7983f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:39.958860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d11be-3ca2-43ce-a5fa-8dfd0a7983f5 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:39.959149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d11be-3ca2-43ce-a5fa-8dfd0a7983f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:39.959452 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d11be-3ca2-43ce-a5fa-8dfd0a7983f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:39.971581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:39.979643 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d11be-3ca2-43ce-a5fa-8dfd0a7983f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:39.990259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-330d11be-3ca2-43ce-a5fa-8dfd0a7983f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:39.990259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:39.990259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:39.990259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:39.990259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:39.990259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:39.990259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:39.990259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:39.990259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:39.990259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:39.990259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:39.990259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:39.990259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:39.990259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:39.990259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:39.990259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:39.991416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:39.991416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:39.991416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:39.991416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:39.991416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:39.991416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:39.991416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:39.991416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:39.991416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:39.991416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:39.991416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:39.991416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:39.991416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:39.991416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:39.991416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:39.991416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:39.992417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:39.992417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:39.992417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:39.992417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:39.992417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:39.992417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:39.992417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:39.992417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:39.992417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:39.992417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:39.992417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:39.992417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:39.998605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 301/616] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:42:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:42:40.000027 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d11be-3ca2-43ce-a5fa-8dfd0a7983f5 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:40.011361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:40.129063 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f890bef-dc00-4fb2-8e24-df91c10ece0d None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:40.167207 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bd48f-2810-4939-91fc-68766b99c35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:40.167890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bd48f-2810-4939-91fc-68766b99c35a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:40.168169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bd48f-2810-4939-91fc-68766b99c35a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:40.168442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bd48f-2810-4939-91fc-68766b99c35a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:40.176367 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bd48f-2810-4939-91fc-68766b99c35a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:40.177955 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bd48f-2810-4939-91fc-68766b99c35a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:40.192021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-e65bd48f-2810-4939-91fc-68766b99c35a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:42:40.192021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:40.192021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:40.192021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:40.192021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:40.192021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:40.192021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:40.192021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:40.192021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:40.192021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:40.192021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:40.192021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:40.192021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:40.192021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:40.192021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:40.192021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:40.193186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:40.193186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:40.193186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:40.193186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:40.193186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:40.193186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:40.193186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:40.193186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:40.193186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:40.193186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:40.193186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:40.193186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:40.193186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:40.193186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:40.193186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:40.193186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:40.193186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:40.193186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:40.194248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:40.194248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:40.194248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:40.194248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:40.194248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:40.194248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:40.194248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:40.194248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:40.194248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:42:40.194248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:40.194248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 316/617] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 28 03:42:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:42:40.199057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bd48f-2810-4939-91fc-68766b99c35a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:40.207863 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d11be-3ca2-43ce-a5fa-8dfd0a7983f5 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:40.269120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c68516-d11d-464e-b512-425838933575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:40.270159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c68516-d11d-464e-b512-425838933575 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:40.270624 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c68516-d11d-464e-b512-425838933575 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:40.271122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c68516-d11d-464e-b512-425838933575 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:40.272153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c68516-d11d-464e-b512-425838933575 None admin] RBAC: Adding query filter params (name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:40.272709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c68516-d11d-464e-b512-425838933575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:40.274273 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c68516-d11d-464e-b512-425838933575 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:40.288070 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 302/618] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:42:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:40.293516 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:40.304384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c68516-d11d-464e-b512-425838933575 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:40.322065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bd48f-2810-4939-91fc-68766b99c35a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:40.362560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808a3d3-2c8e-44fa-9785-bfbc0a222b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:40.363192 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808a3d3-2c8e-44fa-9785-bfbc0a222b6d None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:40.363507 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808a3d3-2c8e-44fa-9785-bfbc0a222b6d None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:40.363784 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808a3d3-2c8e-44fa-9785-bfbc0a222b6d None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:40.364724 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808a3d3-2c8e-44fa-9785-bfbc0a222b6d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:40.365031 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808a3d3-2c8e-44fa-9785-bfbc0a222b6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:40.366583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808a3d3-2c8e-44fa-9785-bfbc0a222b6d None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:40.391677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 317/619] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 28 03:42:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:40.393079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808a3d3-2c8e-44fa-9785-bfbc0a222b6d None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:40.501936 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808a3d3-2c8e-44fa-9785-bfbc0a222b6d None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:40.526276 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:40.542070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6566b6-a53f-457a-ac73-b8ac1d455777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:40.543607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6566b6-a53f-457a-ac73-b8ac1d455777 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:40.544251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6566b6-a53f-457a-ac73-b8ac1d455777 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:40.544873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6566b6-a53f-457a-ac73-b8ac1d455777 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:40.551577 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:40.630136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6566b6-a53f-457a-ac73-b8ac1d455777 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:40.632315 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6566b6-a53f-457a-ac73-b8ac1d455777 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:40.633502 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c68516-d11d-464e-b512-425838933575 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:40.710383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9c4e0-b522-4cec-b17c-b25cce636958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:40.711773 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9c4e0-b522-4cec-b17c-b25cce636958 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:40.712201 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9c4e0-b522-4cec-b17c-b25cce636958 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:40.712615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9c4e0-b522-4cec-b17c-b25cce636958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:40.731116 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9c4e0-b522-4cec-b17c-b25cce636958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:40.733041 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9c4e0-b522-4cec-b17c-b25cce636958 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:40.752040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-68d9c4e0-b522-4cec-b17c-b25cce636958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:40.752040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:40.752040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:40.752040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:40.752040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:40.752040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:40.752040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:40.752040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:40.752040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:40.752040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:40.752040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:40.752040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:40.752040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:40.752040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:40.752040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:40.753033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:40.753033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:40.753033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:40.753033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:40.753033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:40.753033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:40.753033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:40.753033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:40.753033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:40.753033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:40.753033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:40.753033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:40.753033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:40.753033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:40.753033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:40.753033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:40.753033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:40.753893 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:40.753893 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:40.753893 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:40.753893 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:40.761080 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 303/620] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 452 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:40.762827 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f45cad-1221-464e-8150-11ea521a14cb None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:40.763298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f45cad-1221-464e-8150-11ea521a14cb None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:40.763771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f45cad-1221-464e-8150-11ea521a14cb None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:40.766698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 304/621] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:40.767695 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f45cad-1221-464e-8150-11ea521a14cb None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:40.818184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 318/622] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:40.819896 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f6e2a-440e-4222-971c-1a64092d1546 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:40.820366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f6e2a-440e-4222-971c-1a64092d1546 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:40.820843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f6e2a-440e-4222-971c-1a64092d1546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:40.840880 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-b69f6e2a-440e-4222-971c-1a64092d1546 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:40.842383 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b69f6e2a-440e-4222-971c-1a64092d1546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:40.878186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:40.924882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f45cad-1221-464e-8150-11ea521a14cb None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:40.931592 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 319/623] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:40.932522 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f6e2a-440e-4222-971c-1a64092d1546 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:40.951812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:40.973940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fbb7f-d500-40a1-9f30-3c1fa4da45d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:40.974559 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fbb7f-d500-40a1-9f30-3c1fa4da45d8 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:40.974846 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fbb7f-d500-40a1-9f30-3c1fa4da45d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:40.975125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fbb7f-d500-40a1-9f30-3c1fa4da45d8 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:40.975868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fbb7f-d500-40a1-9f30-3c1fa4da45d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:40.976185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fbb7f-d500-40a1-9f30-3c1fa4da45d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:40.977734 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fbb7f-d500-40a1-9f30-3c1fa4da45d8 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:40.991465 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 305/624] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:40.992335 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fbb7f-d500-40a1-9f30-3c1fa4da45d8 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:41.091334 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f6e2a-440e-4222-971c-1a64092d1546 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:41.137814 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4cd5c-a7ca-4176-88a9-9b699eaa9a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:41.138470 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4cd5c-a7ca-4176-88a9-9b699eaa9a81 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:41.138754 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4cd5c-a7ca-4176-88a9-9b699eaa9a81 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:41.139029 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4cd5c-a7ca-4176-88a9-9b699eaa9a81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:41.140118 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fbb7f-d500-40a1-9f30-3c1fa4da45d8 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:41.152901 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4cd5c-a7ca-4176-88a9-9b699eaa9a81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:41.154741 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4cd5c-a7ca-4176-88a9-9b699eaa9a81 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:41.179849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-0fe4cd5c-a7ca-4176-88a9-9b699eaa9a81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:41.179849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:41.179849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:41.179849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:41.179849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:41.179849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:41.179849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:41.179849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:41.179849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:41.179849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:41.179849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:41.179849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:41.179849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:41.179849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:41.179849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:41.180793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:41.180793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:41.180793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:41.180793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:41.180793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:41.180793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:41.180793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:41.180793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:41.180793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:41.180793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:41.180793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:41.180793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:41.180793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:41.180793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:41.180793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:41.180793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:41.180793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:41.181662 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:41.181662 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:41.181662 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:41.181662 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:41.181662 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 320/625] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:41.182419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4cd5c-a7ca-4176-88a9-9b699eaa9a81 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:41.189985 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade2ca5-02a4-4f3d-a28e-e7465010ee1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:41.190667 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade2ca5-02a4-4f3d-a28e-e7465010ee1b None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:41.190950 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade2ca5-02a4-4f3d-a28e-e7465010ee1b None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:41.191226 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade2ca5-02a4-4f3d-a28e-e7465010ee1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:41.202670 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:41.207860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade2ca5-02a4-4f3d-a28e-e7465010ee1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:41.215159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-eade2ca5-02a4-4f3d-a28e-e7465010ee1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:41.215159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:41.215159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:41.215159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:41.215159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:41.215159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:41.215159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:41.215159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:41.215159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:41.215159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:41.215159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:41.215159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:41.215159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:41.215159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:41.215159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:41.215159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:41.219287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:41.219287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:41.219287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:41.219287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:41.219287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:41.219287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:41.219287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:41.219287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:41.219287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:41.219287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:41.219287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:41.219287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:41.219287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:41.219287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:41.219287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:41.219287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:41.220179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:41.220179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:41.220179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:41.220179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:41.220179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:41.220179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:41.220179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:41.220179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:41.220179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:41.220179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:41.220179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:41.220179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:41.220179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 306/626] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:42:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:41.220179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade2ca5-02a4-4f3d-a28e-e7465010ee1b None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:41.277452 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:41.304382 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4cd5c-a7ca-4176-88a9-9b699eaa9a81 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:41.342493 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156b650-6fd6-4a4f-a4a4-52c3f855e1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:41.342925 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade2ca5-02a4-4f3d-a28e-e7465010ee1b None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:41.344385 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156b650-6fd6-4a4f-a4a4-52c3f855e1d9 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:41.344915 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156b650-6fd6-4a4f-a4a4-52c3f855e1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:41.345629 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156b650-6fd6-4a4f-a4a4-52c3f855e1d9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:41.356624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156b650-6fd6-4a4f-a4a4-52c3f855e1d9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:41.358907 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156b650-6fd6-4a4f-a4a4-52c3f855e1d9 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:41.376323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-9156b650-6fd6-4a4f-a4a4-52c3f855e1d9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 03:42:41.376323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:41.376323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:41.376323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:41.376323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:41.376323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:41.376323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:41.376323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:41.376323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:41.376323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:41.376323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:41.376323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:41.376323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:41.376323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:41.376323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:41.376323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:41.377366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:41.377366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:41.377366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:41.377366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:41.377366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:41.377366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:41.377366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:41.377366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:41.377366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:41.377366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:41.377366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:41.377366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:41.377366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:41.377366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:41.377366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:41.377366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:41.377366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:41.377366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:41.378321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:41.378321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:41.378321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:41.378321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:41.378321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:41.378321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:41.378321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:41.378321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:41.378321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 03:42:41.378321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:41.381199 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 321/627] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:42:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:41.382227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156b650-6fd6-4a4f-a4a4-52c3f855e1d9 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:41.390226 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffe172-6390-4e8f-a8b3-7fb50498905a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:41.391128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffe172-6390-4e8f-a8b3-7fb50498905a None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:41.391581 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffe172-6390-4e8f-a8b3-7fb50498905a None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:41.392050 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffe172-6390-4e8f-a8b3-7fb50498905a None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:41.393210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffe172-6390-4e8f-a8b3-7fb50498905a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:41.393210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffe172-6390-4e8f-a8b3-7fb50498905a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:41.394947 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffe172-6390-4e8f-a8b3-7fb50498905a None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:41.414675 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 307/628] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:41.414675 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffe172-6390-4e8f-a8b3-7fb50498905a None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:41.499751 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:41.535754 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156b650-6fd6-4a4f-a4a4-52c3f855e1d9 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:41.552192 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:41.558443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffe172-6390-4e8f-a8b3-7fb50498905a None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:41.576101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d752064-ccf4-4c32-9428-9a38d019ff7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:41.576873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d752064-ccf4-4c32-9428-9a38d019ff7d None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:41.577440 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d752064-ccf4-4c32-9428-9a38d019ff7d None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:41.577853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d752064-ccf4-4c32-9428-9a38d019ff7d None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:41.579978 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d752064-ccf4-4c32-9428-9a38d019ff7d None admin] RBAC: Adding query filter params (name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:41.580402 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d752064-ccf4-4c32-9428-9a38d019ff7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:41.582372 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d752064-ccf4-4c32-9428-9a38d019ff7d None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:41.597642 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 322/629] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:42:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:41.599721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d752064-ccf4-4c32-9428-9a38d019ff7d None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:41.617704 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becb667-e04a-41ea-9365-cd5618f4e304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:41.618503 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becb667-e04a-41ea-9365-cd5618f4e304 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:41.618888 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becb667-e04a-41ea-9365-cd5618f4e304 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:41.619259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becb667-e04a-41ea-9365-cd5618f4e304 None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:41.620314 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becb667-e04a-41ea-9365-cd5618f4e304 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:41.620726 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becb667-e04a-41ea-9365-cd5618f4e304 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:41.622281 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becb667-e04a-41ea-9365-cd5618f4e304 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:41.648433 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 308/630] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 28 03:42:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:41.649392 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becb667-e04a-41ea-9365-cd5618f4e304 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:41.722851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d752064-ccf4-4c32-9428-9a38d019ff7d None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:41.759183 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becb667-e04a-41ea-9365-cd5618f4e304 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:41.760991 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0fc9a-8f2d-4e8f-860b-df61a67ea79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:41.761908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0fc9a-8f2d-4e8f-860b-df61a67ea79d None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:41.762450 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0fc9a-8f2d-4e8f-860b-df61a67ea79d None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:41.763000 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0fc9a-8f2d-4e8f-860b-df61a67ea79d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:41.765383 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:41.772636 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0fc9a-8f2d-4e8f-860b-df61a67ea79d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:41.775083 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0fc9a-8f2d-4e8f-860b-df61a67ea79d None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:41.794504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-57c0fc9a-8f2d-4e8f-860b-df61a67ea79d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:41.794504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:41.794504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:41.794504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:41.794504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:41.794504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:41.794504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:41.794504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:41.794504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:41.794504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:41.794504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:41.794504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:41.794504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:42:41.794504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:42:41.794504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:42:41.795529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:42:41.795529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:41.795529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:41.795529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:41.795529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:41.795529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:41.795529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:41.795529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:41.795529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:41.795529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:41.795529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:41.795529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:41.795529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:41.795529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:41.795529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:41.795529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:41.795529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:41.796429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:42:41.796429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:42:41.796429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:42:41.796429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:42:41.796429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:42:41.796429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:42:41.796429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:41.796429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:41.797943 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0af80-d85f-4aba-a40c-d9de6f1d3f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:41.798616 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0af80-d85f-4aba-a40c-d9de6f1d3f2d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:41.798898 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0af80-d85f-4aba-a40c-d9de6f1d3f2d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:41.799173 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0af80-d85f-4aba-a40c-d9de6f1d3f2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:41.800008 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 323/631] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:41.801005 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0fc9a-8f2d-4e8f-860b-df61a67ea79d None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:41.816327 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0af80-d85f-4aba-a40c-d9de6f1d3f2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:41.817973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0af80-d85f-4aba-a40c-d9de6f1d3f2d None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:41.835691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-89e0af80-d85f-4aba-a40c-d9de6f1d3f2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:41.835691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:41.835691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:41.835691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:41.835691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:41.835691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:41.835691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:41.835691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:41.835691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:41.835691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:41.835691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:41.835691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:41.835691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:41.835691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:41.835691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:41.836778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:41.836778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:41.836778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:41.836778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:41.836778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:41.836778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:41.836778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:41.836778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:41.836778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:41.836778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:41.836778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:41.836778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:41.836778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:41.836778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:41.836778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:41.836778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:41.836778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:41.837680 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:41.837680 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:41.837680 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:41.837680 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:41.841444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 309/632] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:41.842626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0af80-d85f-4aba-a40c-d9de6f1d3f2d None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:41.855421 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:41.919137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0fc9a-8f2d-4e8f-860b-df61a67ea79d None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:41.952368 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0af80-d85f-4aba-a40c-d9de6f1d3f2d None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:41.958779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8e6e6-f190-4478-882f-867b4d3cbbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:41.959458 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8e6e6-f190-4478-882f-867b4d3cbbec None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:41.959745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8e6e6-f190-4478-882f-867b4d3cbbec None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:41.960059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8e6e6-f190-4478-882f-867b4d3cbbec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:41.971682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8e6e6-f190-4478-882f-867b4d3cbbec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:41.973139 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8e6e6-f190-4478-882f-867b4d3cbbec None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:41.987673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-ccb8e6e6-f190-4478-882f-867b4d3cbbec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:41.987673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:41.987673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:41.987673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:41.987673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:41.987673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:41.987673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:41.987673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:41.987673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:41.987673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:41.987673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:41.987673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:41.987673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:41.987673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:41.987673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:41.988588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:41.988588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:41.988588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:41.988588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:41.988588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:41.988588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:41.988588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:41.988588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:41.988588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:41.988588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:41.988588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:41.988588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:41.988588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:41.988588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:41.988588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:41.988588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:41.988588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:41.989449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:41.989449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:41.989449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:41.989449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:41.989663 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5958402-6b13-46e8-a8f8-c12cf9dda70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:41.989663 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5958402-6b13-46e8-a8f8-c12cf9dda70e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:41.989663 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5958402-6b13-46e8-a8f8-c12cf9dda70e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:41.989875 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 324/633] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:41.989943 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5958402-6b13-46e8-a8f8-c12cf9dda70e None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:41.990025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8e6e6-f190-4478-882f-867b4d3cbbec None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:41.990094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5958402-6b13-46e8-a8f8-c12cf9dda70e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:41.990094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5958402-6b13-46e8-a8f8-c12cf9dda70e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:41.991659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5958402-6b13-46e8-a8f8-c12cf9dda70e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:42.006297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 310/634] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:42:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:42.007558 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcc58b-b739-4e9f-bf9d-035c01635faf None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:42.007898 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcc58b-b739-4e9f-bf9d-035c01635faf None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:42.008178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcc58b-b739-4e9f-bf9d-035c01635faf None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:42.011620 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 311/635] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:42.011620 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f052c9b-d50e-4b62-8fd4-b48ca02c496e None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:42.011620 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f052c9b-d50e-4b62-8fd4-b48ca02c496e None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:42.011620 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f052c9b-d50e-4b62-8fd4-b48ca02c496e None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:42.012431 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 312/636] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:42.013131 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f052c9b-d50e-4b62-8fd4-b48ca02c496e None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:42.041178 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:42.083566 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:42.095481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8e6e6-f190-4478-882f-867b4d3cbbec None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:42.120656 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f052c9b-d50e-4b62-8fd4-b48ca02c496e None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:42.129095 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5b8eb-e655-4006-814a-2b94293e27fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:42.129717 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5b8eb-e655-4006-814a-2b94293e27fd None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:42.130004 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5b8eb-e655-4006-814a-2b94293e27fd None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:42.130279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5b8eb-e655-4006-814a-2b94293e27fd None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:42.130967 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5b8eb-e655-4006-814a-2b94293e27fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:42.131265 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5b8eb-e655-4006-814a-2b94293e27fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:42.132653 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5b8eb-e655-4006-814a-2b94293e27fd None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:42.144380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 325/637] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:42.145185 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5b8eb-e655-4006-814a-2b94293e27fd None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:42.155434 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3b47e-74a5-4873-97ef-0f601af29c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:42.156771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3b47e-74a5-4873-97ef-0f601af29c8e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:42.157075 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3b47e-74a5-4873-97ef-0f601af29c8e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:42.157357 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3b47e-74a5-4873-97ef-0f601af29c8e None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:42.158050 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3b47e-74a5-4873-97ef-0f601af29c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:42.158353 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3b47e-74a5-4873-97ef-0f601af29c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:42.159750 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3b47e-74a5-4873-97ef-0f601af29c8e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:42.170838 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 313/638] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:42.172636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087265d-823b-4d22-adc3-f161651506dc None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:42.173096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087265d-823b-4d22-adc3-f161651506dc None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:42.173371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087265d-823b-4d22-adc3-f161651506dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:42.192007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-6087265d-823b-4d22-adc3-f161651506dc None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:42.193216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-6087265d-823b-4d22-adc3-f161651506dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:42.246015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5b8eb-e655-4006-814a-2b94293e27fd None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:42.253223 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:42.258912 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 314/639] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:42.260186 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d5f59-3a83-466b-8f15-2b7e9ce5b35a None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:42.264880 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d5f59-3a83-466b-8f15-2b7e9ce5b35a None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:42.264880 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d5f59-3a83-466b-8f15-2b7e9ce5b35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:42.278988 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-131d5f59-3a83-466b-8f15-2b7e9ce5b35a None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:42.280661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-131d5f59-3a83-466b-8f15-2b7e9ce5b35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:42.285180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429496b-0f47-40f1-b939-8872e71c0ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:42.285978 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429496b-0f47-40f1-b939-8872e71c0ddc None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:42.286420 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429496b-0f47-40f1-b939-8872e71c0ddc None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:42.287024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429496b-0f47-40f1-b939-8872e71c0ddc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:42.287853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429496b-0f47-40f1-b939-8872e71c0ddc None admin] RBAC: Adding query filter params (role.id=183fd05fe14a41828222fd09b6280796, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=5133abf4c32a45b0b2188f71496c572b) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:42.288167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429496b-0f47-40f1-b939-8872e71c0ddc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:42.289602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429496b-0f47-40f1-b939-8872e71c0ddc None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:42.295487 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 326/640] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:42:42 2022] GET /identity/v3/role_assignments?user.id=5133abf4c32a45b0b2188f71496c572b&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=183fd05fe14a41828222fd09b6280796 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:42.296220 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429496b-0f47-40f1-b939-8872e71c0ddc None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:42.354517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:42.370596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 315/641] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:42.373142 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d5f59-3a83-466b-8f15-2b7e9ce5b35a None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:42.425853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429496b-0f47-40f1-b939-8872e71c0ddc None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:42.471031 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a8128-4562-435a-bd1e-0f00763006a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:42.471735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a8128-4562-435a-bd1e-0f00763006a5 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:42.472337 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a8128-4562-435a-bd1e-0f00763006a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:42.472337 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a8128-4562-435a-bd1e-0f00763006a5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:42.480504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a8128-4562-435a-bd1e-0f00763006a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:42.482162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a8128-4562-435a-bd1e-0f00763006a5 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:42.491246 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d5f59-3a83-466b-8f15-2b7e9ce5b35a None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:42.495362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-8f2a8128-4562-435a-bd1e-0f00763006a5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 03:42:42.495362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:42.495362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:42.495362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:42.495362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:42.495362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:42.495362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:42.495362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:42.495362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:42.495362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:42.495362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:42.495362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:42.495362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:42.495362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:42.495362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:42.495362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:42.496282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:42.496282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:42.496282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:42.496282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:42.496282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:42.496282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:42.496282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:42.496282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:42.496282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:42.496282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:42.496282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:42.496282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:42.496282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:42.496282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:42.496282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:42.496282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:42.496282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:42.496282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:42.497248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:42.497248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:42.497248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:42.497248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:42.497248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:42.497248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:42.497248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:42.497248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:42.497248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 03:42:42.497248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:42.497248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 327/642] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:42.497833 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a8128-4562-435a-bd1e-0f00763006a5 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:42.534622 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:42.537301 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d5c50-8e78-46de-8561-cdb1eba1ccc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:42.537968 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d5c50-8e78-46de-8561-cdb1eba1ccc1 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:42.538257 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d5c50-8e78-46de-8561-cdb1eba1ccc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:42.538527 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d5c50-8e78-46de-8561-cdb1eba1ccc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:42.545855 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d5c50-8e78-46de-8561-cdb1eba1ccc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:42.547913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d5c50-8e78-46de-8561-cdb1eba1ccc1 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:42.559819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-c47d5c50-8e78-46de-8561-cdb1eba1ccc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:42.559819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:42.559819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:42.559819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:42.559819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:42.559819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:42.559819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:42.559819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:42.559819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:42.559819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:42.559819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:42.559819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:42.559819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:42:42.559819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:42:42.559819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:42:42.560800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:42:42.560800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:42.560800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:42.560800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:42.560800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:42.560800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:42.560800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:42.560800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:42.560800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:42.560800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:42.560800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:42.560800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:42.560800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:42.560800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:42.560800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:42.560800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:42.560800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:42.561930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:42:42.561930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:42:42.561930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:42:42.561930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:42:42.561930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:42:42.561930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:42:42.561930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:42.561930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:42.561930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 316/643] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:42.561930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d5c50-8e78-46de-8561-cdb1eba1ccc1 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:42.615083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:42.619748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a8128-4562-435a-bd1e-0f00763006a5 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:42.657473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cecc43-f981-4df3-be95-5457d2fde427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:42.658122 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cecc43-f981-4df3-be95-5457d2fde427 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:42.658496 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cecc43-f981-4df3-be95-5457d2fde427 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:42.658686 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cecc43-f981-4df3-be95-5457d2fde427 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:42.668616 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d5c50-8e78-46de-8561-cdb1eba1ccc1 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:42.669085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cecc43-f981-4df3-be95-5457d2fde427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:42.673598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-79cecc43-f981-4df3-be95-5457d2fde427 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:42.673598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:42.673598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:42.673598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:42.673598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:42.673598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:42.673598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:42.673598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:42.673598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:42.673598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:42.673598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:42.673598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:42.673598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:42.673598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:42.673598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:42.673598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:42.674506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:42.674506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:42.674506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:42.674506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:42.674506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:42.674506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:42.674506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:42.674506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:42.674506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:42.674506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:42.674506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:42.674506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:42.674506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:42.674506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:42.674506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:42.674506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:42.675821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:42.675821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:42.675821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:42.675821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:42.675821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:42.675821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:42.675821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:42.675821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:42.675821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:42.675821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:42.675821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:42.675821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:42.675821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 328/644] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:42:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:42.676633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cecc43-f981-4df3-be95-5457d2fde427 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:42.707167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41102426-1f4b-466d-8a43-0171562045e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:42.707868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41102426-1f4b-466d-8a43-0171562045e7 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:42.708387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41102426-1f4b-466d-8a43-0171562045e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:42.708495 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41102426-1f4b-466d-8a43-0171562045e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:42.722346 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41102426-1f4b-466d-8a43-0171562045e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:42.727537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-41102426-1f4b-466d-8a43-0171562045e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:42.727537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:42.727537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:42.727537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:42.727537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:42.727537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:42.727537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:42.727537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:42.727537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:42.727537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:42.727537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:42.727537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:42.727537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:42.727537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:42.727537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:42.727537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:42.728705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:42.728705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:42.728705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:42.728705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:42.728705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:42.728705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:42.728705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:42.728705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:42.728705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:42.728705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:42.728705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:42.728705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:42.728705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:42.728705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:42.728705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:42.728705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:42.729617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:42.729617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:42.729617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:42.729617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:42.729617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:42.729617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:42.729617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:42.729617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:42.729617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:42.729617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:42.729617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:42.729617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:42.729617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 317/645] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:42:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:42.730291 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41102426-1f4b-466d-8a43-0171562045e7 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:42.788528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:42.802909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cecc43-f981-4df3-be95-5457d2fde427 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:42.839452 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226b5ee-540f-4ddb-afa5-53531cef0053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:42.840079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226b5ee-540f-4ddb-afa5-53531cef0053 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:42.840364 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226b5ee-540f-4ddb-afa5-53531cef0053 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:42.840643 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226b5ee-540f-4ddb-afa5-53531cef0053 None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:42.840739 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41102426-1f4b-466d-8a43-0171562045e7 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:42.841442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226b5ee-540f-4ddb-afa5-53531cef0053 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:42.841750 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226b5ee-540f-4ddb-afa5-53531cef0053 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:42.844052 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226b5ee-540f-4ddb-afa5-53531cef0053 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:42.861625 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:42.861945 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 329/646] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 28 03:42:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:42.862824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226b5ee-540f-4ddb-afa5-53531cef0053 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:42.880824 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264a829-4776-4f9b-84da-734223912321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:42.881703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264a829-4776-4f9b-84da-734223912321 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:42.881993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264a829-4776-4f9b-84da-734223912321 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:42.882389 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264a829-4776-4f9b-84da-734223912321 None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:42.883176 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264a829-4776-4f9b-84da-734223912321 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:42.883492 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264a829-4776-4f9b-84da-734223912321 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:42.884942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264a829-4776-4f9b-84da-734223912321 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:42.898696 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 318/647] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:42:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:42.899797 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264a829-4776-4f9b-84da-734223912321 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:42.977970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226b5ee-540f-4ddb-afa5-53531cef0053 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:43.014125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264a829-4776-4f9b-84da-734223912321 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:43.015092 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfea085-09d8-4f28-b45c-e1c9b7741987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:43.016141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfea085-09d8-4f28-b45c-e1c9b7741987 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:43.016141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfea085-09d8-4f28-b45c-e1c9b7741987 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:43.016424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfea085-09d8-4f28-b45c-e1c9b7741987 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:43.017159 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfea085-09d8-4f28-b45c-e1c9b7741987 None admin] RBAC: Adding query filter params (name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:43.018114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfea085-09d8-4f28-b45c-e1c9b7741987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:43.018830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfea085-09d8-4f28-b45c-e1c9b7741987 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:43.034022 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 330/648] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:42:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:43.035172 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfea085-09d8-4f28-b45c-e1c9b7741987 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:43.049539 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:43.052155 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c10c8b-2a3e-4403-a97e-b4389b5d8de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:43.053009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c10c8b-2a3e-4403-a97e-b4389b5d8de0 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:43.053627 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c10c8b-2a3e-4403-a97e-b4389b5d8de0 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:43.053908 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c10c8b-2a3e-4403-a97e-b4389b5d8de0 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:43.054631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c10c8b-2a3e-4403-a97e-b4389b5d8de0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:43.054936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c10c8b-2a3e-4403-a97e-b4389b5d8de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:43.056347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c10c8b-2a3e-4403-a97e-b4389b5d8de0 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:43.070130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 319/649] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:42:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:43.070923 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c10c8b-2a3e-4403-a97e-b4389b5d8de0 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:43.105651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:43.147187 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfea085-09d8-4f28-b45c-e1c9b7741987 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:43.186265 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c10c8b-2a3e-4403-a97e-b4389b5d8de0 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:43.188784 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16831c3e-a8d1-416b-a4a0-70002cfe5d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:43.189462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16831c3e-a8d1-416b-a4a0-70002cfe5d93 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:43.189744 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16831c3e-a8d1-416b-a4a0-70002cfe5d93 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:43.190024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16831c3e-a8d1-416b-a4a0-70002cfe5d93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:43.222710 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603617d2-a154-47bd-8299-937a97d422df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:43.223735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603617d2-a154-47bd-8299-937a97d422df None admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:43.224205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603617d2-a154-47bd-8299-937a97d422df None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:43.224482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603617d2-a154-47bd-8299-937a97d422df None admin] PATH_INFO: `/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/382ff6087bf4486d8651162880825eb2/roles/183fd05fe14a41828222fd09b6280796` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:43.239234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603617d2-a154-47bd-8299-937a97d422df None admin] RBAC: Authorizing `identity:create_grant(project_id=28b7995e83524b9293d1c6fc319e5a85, user_id=382ff6087bf4486d8651162880825eb2, role_id=183fd05fe14a41828222fd09b6280796)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:43.240713 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603617d2-a154-47bd-8299-937a97d422df None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:43.263539 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16831c3e-a8d1-416b-a4a0-70002cfe5d93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:43.265114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16831c3e-a8d1-416b-a4a0-70002cfe5d93 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:43.276510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:43.316139 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 320/650] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:42:43 2022] PUT /identity/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/382ff6087bf4486d8651162880825eb2/roles/183fd05fe14a41828222fd09b6280796 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:42:43.317184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603617d2-a154-47bd-8299-937a97d422df None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:43.386615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 331/651] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:43.387783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16831c3e-a8d1-416b-a4a0-70002cfe5d93 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:43.444288 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:43.457569 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603617d2-a154-47bd-8299-937a97d422df None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:43.500945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b11e2-6902-4aa4-b702-4c84c04ad287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:43.501708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b11e2-6902-4aa4-b702-4c84c04ad287 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:43.501985 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b11e2-6902-4aa4-b702-4c84c04ad287 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:43.502254 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b11e2-6902-4aa4-b702-4c84c04ad287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:43.511229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16831c3e-a8d1-416b-a4a0-70002cfe5d93 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:43.517669 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b11e2-6902-4aa4-b702-4c84c04ad287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:43.517866 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b11e2-6902-4aa4-b702-4c84c04ad287 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:43.525160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:43.543634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-fd2b11e2-6902-4aa4-b702-4c84c04ad287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:43.543634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:43.543634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:43.543634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:43.543634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:43.543634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:43.543634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:43.543634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:43.543634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:43.543634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:43.543634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:43.543634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:43.543634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:43.543634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:43.543634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:43.544561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:43.544561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:43.544561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:43.544561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:43.544561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:43.544561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:43.544561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:43.544561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:43.544561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:43.544561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:43.544561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:43.544561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:43.544561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:43.544561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:43.544561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:43.544561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:43.544561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:43.545456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:43.545456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:43.545456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:43.545456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:43.545456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 321/652] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:43.545721 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b11e2-6902-4aa4-b702-4c84c04ad287 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:43.568876 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3b91d-ef93-4107-892d-b7750de7fd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:43.569451 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3b91d-ef93-4107-892d-b7750de7fd01 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:43.569730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3b91d-ef93-4107-892d-b7750de7fd01 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:43.570005 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3b91d-ef93-4107-892d-b7750de7fd01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:43.587776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3b91d-ef93-4107-892d-b7750de7fd01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:43.589241 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3b91d-ef93-4107-892d-b7750de7fd01 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:43.609912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-cff3b91d-ef93-4107-892d-b7750de7fd01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:43.609912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:43.609912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:43.609912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:43.609912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:43.609912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:43.609912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:43.609912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:43.609912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:43.609912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:43.609912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:43.609912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:43.609912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:43.609912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:43.609912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:43.610910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:43.610910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:43.610910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:43.610910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:43.610910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:43.610910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:43.610910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:43.610910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:43.610910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:43.610910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:43.610910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:43.610910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:43.610910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:43.610910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:43.610910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:43.610910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:43.610910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:43.611831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:43.611831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:43.611831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:43.611831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:43.611831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 332/653] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:43.612636 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3b91d-ef93-4107-892d-b7750de7fd01 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:43.672169 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b11e2-6902-4aa4-b702-4c84c04ad287 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:43.704832 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:43.710255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b607a1-6b2e-45fe-a31e-2ab6ca477dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:43.711085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b607a1-6b2e-45fe-a31e-2ab6ca477dae None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:43.711399 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b607a1-6b2e-45fe-a31e-2ab6ca477dae None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:43.711674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b607a1-6b2e-45fe-a31e-2ab6ca477dae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:43.720551 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3b91d-ef93-4107-892d-b7750de7fd01 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:43.724176 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b607a1-6b2e-45fe-a31e-2ab6ca477dae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:43.725629 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b607a1-6b2e-45fe-a31e-2ab6ca477dae None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:43.741532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-79b607a1-6b2e-45fe-a31e-2ab6ca477dae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:43.741532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:43.741532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:43.741532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:43.741532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:43.741532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:43.741532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:43.741532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:43.741532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:43.741532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:43.741532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:43.741532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:43.741532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:43.741532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:43.741532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:43.743622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:43.743622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:43.743622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:43.743622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:43.743622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:43.743622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:43.743622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:43.743622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:43.743622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:43.743622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:43.743622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:43.743622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:43.743622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:43.743622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:43.743622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:43.743622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:43.743622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:43.745582 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:43.745582 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:43.745582 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:43.745582 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:43.745582 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 322/654] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:43.745582 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b607a1-6b2e-45fe-a31e-2ab6ca477dae None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:43.757297 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9dd5b-8aec-4e1c-a8b5-2dabc97e46f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:43.757924 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9dd5b-8aec-4e1c-a8b5-2dabc97e46f2 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:43.758211 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9dd5b-8aec-4e1c-a8b5-2dabc97e46f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:43.758491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9dd5b-8aec-4e1c-a8b5-2dabc97e46f2 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:43.759198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9dd5b-8aec-4e1c-a8b5-2dabc97e46f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:43.759538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9dd5b-8aec-4e1c-a8b5-2dabc97e46f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:43.760926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9dd5b-8aec-4e1c-a8b5-2dabc97e46f2 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:43.774147 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 333/655] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:43.774979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9dd5b-8aec-4e1c-a8b5-2dabc97e46f2 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:43.800490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:43.880231 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b607a1-6b2e-45fe-a31e-2ab6ca477dae None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:43.881722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9dd5b-8aec-4e1c-a8b5-2dabc97e46f2 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:43.919895 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197a787-79b4-4d7f-80da-ae9c7878ce90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:43.920812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197a787-79b4-4d7f-80da-ae9c7878ce90 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:43.921258 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197a787-79b4-4d7f-80da-ae9c7878ce90 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:43.921713 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197a787-79b4-4d7f-80da-ae9c7878ce90 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:43.922885 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197a787-79b4-4d7f-80da-ae9c7878ce90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:43.923364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197a787-79b4-4d7f-80da-ae9c7878ce90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:43.924884 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197a787-79b4-4d7f-80da-ae9c7878ce90 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:43.938816 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 323/656] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:43.940238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197a787-79b4-4d7f-80da-ae9c7878ce90 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:43.945730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829fc42-20e7-4bc9-85a2-decb23c1d945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:43.946636 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829fc42-20e7-4bc9-85a2-decb23c1d945 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:43.947138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829fc42-20e7-4bc9-85a2-decb23c1d945 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:43.947671 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829fc42-20e7-4bc9-85a2-decb23c1d945 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:43.948946 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829fc42-20e7-4bc9-85a2-decb23c1d945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:43.949497 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829fc42-20e7-4bc9-85a2-decb23c1d945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:43.952067 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829fc42-20e7-4bc9-85a2-decb23c1d945 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:43.974522 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 334/657] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:43.975968 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829fc42-20e7-4bc9-85a2-decb23c1d945 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:43.994141 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:44.054260 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197a787-79b4-4d7f-80da-ae9c7878ce90 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:44.093218 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cb68a-5ae4-4360-82f8-791960767727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:44.095197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cb68a-5ae4-4360-82f8-791960767727 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:44.095746 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cb68a-5ae4-4360-82f8-791960767727 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:44.096230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cb68a-5ae4-4360-82f8-791960767727 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:44.104467 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634cb68a-5ae4-4360-82f8-791960767727 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:44.106345 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634cb68a-5ae4-4360-82f8-791960767727 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:44.120247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-634cb68a-5ae4-4360-82f8-791960767727 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 03:42:44.120247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:44.120247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:44.120247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:44.120247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:44.120247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:44.120247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:44.120247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:44.120247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:44.120247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:44.120247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:44.120247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:44.120247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:44.120247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:44.120247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:44.120247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:44.121250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:44.121250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:44.121250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:44.121250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:44.121250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:44.121250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:44.121250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:44.121250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:44.121250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:44.121250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:44.121250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:44.121250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:44.121250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:44.121250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:44.121250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:44.121250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:44.121250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:44.121250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:44.122162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:44.122162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:44.122162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:44.122162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:44.122162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:44.122162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:44.122162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:44.122162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:44.122162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 03:42:44.122162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:44.129602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:44.129822 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 324/658] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:44.131213 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cb68a-5ae4-4360-82f8-791960767727 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:44.164243 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829fc42-20e7-4bc9-85a2-decb23c1d945 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:44.226082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663d0ca-a18a-4613-aafb-bbab080114d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:44.227563 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663d0ca-a18a-4613-aafb-bbab080114d6 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:44.228243 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663d0ca-a18a-4613-aafb-bbab080114d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:44.228929 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663d0ca-a18a-4613-aafb-bbab080114d6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:44.243905 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663d0ca-a18a-4613-aafb-bbab080114d6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:44.244180 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cb68a-5ae4-4360-82f8-791960767727 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:44.246675 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:44.247294 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663d0ca-a18a-4613-aafb-bbab080114d6 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:44.271340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-a663d0ca-a18a-4613-aafb-bbab080114d6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 03:42:44.271340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:44.271340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:44.271340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:44.271340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:44.271340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:44.271340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:44.271340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:44.271340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:44.271340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:44.271340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:44.271340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:44.271340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:44.271340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:44.271340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:44.271340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:44.273291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:44.273291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:44.273291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:44.273291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:44.273291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:44.273291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:44.273291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:44.273291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:44.273291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:44.273291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:44.273291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:44.273291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:44.273291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:44.273291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:44.273291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:44.273291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:44.273291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:44.273291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:44.275160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:44.275160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:44.275160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:44.275160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:44.275160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:44.275160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:44.275160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:44.275160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:44.275160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 03:42:44.275160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:44.279773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 335/659] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:42:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:44.281443 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663d0ca-a18a-4613-aafb-bbab080114d6 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:44.285392 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4da29-da63-4fb7-b325-885326c8b352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:44.286153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4da29-da63-4fb7-b325-885326c8b352 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:44.286418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4da29-da63-4fb7-b325-885326c8b352 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:44.286809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4da29-da63-4fb7-b325-885326c8b352 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:44.294450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4da29-da63-4fb7-b325-885326c8b352 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:44.296053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4da29-da63-4fb7-b325-885326c8b352 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:44.309023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-b9a4da29-da63-4fb7-b325-885326c8b352 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:44.309023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:44.309023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:44.309023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:44.309023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:44.309023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:44.309023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:44.309023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:44.309023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:44.309023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:44.309023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:44.309023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:44.309023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:42:44.309023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:42:44.309023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:42:44.310735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:42:44.310735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:44.310735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:44.310735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:44.310735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:44.310735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:44.310735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:44.310735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:44.310735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:44.310735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:44.310735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:44.310735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:44.310735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:44.310735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:44.310735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:44.310735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:44.310735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:44.313409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:42:44.313409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:42:44.313409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:42:44.313409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:42:44.313409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:42:44.313409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:42:44.313409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:44.313409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:44.313409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 325/660] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:44.313409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4da29-da63-4fb7-b325-885326c8b352 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:44.421271 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4da29-da63-4fb7-b325-885326c8b352 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:44.459558 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6f852-fc4f-4194-97d7-9ab5cf374f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:44.459819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663d0ca-a18a-4613-aafb-bbab080114d6 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:44.460208 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6f852-fc4f-4194-97d7-9ab5cf374f73 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:44.460660 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6f852-fc4f-4194-97d7-9ab5cf374f73 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:44.460988 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6f852-fc4f-4194-97d7-9ab5cf374f73 None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:44.461958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6f852-fc4f-4194-97d7-9ab5cf374f73 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:44.463053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6f852-fc4f-4194-97d7-9ab5cf374f73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:44.464700 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6f852-fc4f-4194-97d7-9ab5cf374f73 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:44.489041 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 326/661] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Jul 28 03:42:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:44.489880 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6f852-fc4f-4194-97d7-9ab5cf374f73 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:44.509152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9397e3c-5866-4862-b3f9-e99a1c079084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:44.510248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9397e3c-5866-4862-b3f9-e99a1c079084 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:44.510534 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9397e3c-5866-4862-b3f9-e99a1c079084 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:44.511102 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9397e3c-5866-4862-b3f9-e99a1c079084 None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:44.511943 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9397e3c-5866-4862-b3f9-e99a1c079084 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:44.512530 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9397e3c-5866-4862-b3f9-e99a1c079084 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:44.514387 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9397e3c-5866-4862-b3f9-e99a1c079084 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:44.520669 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:44.534839 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:44.539745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 336/662] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 28 03:42:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:44.540772 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9397e3c-5866-4862-b3f9-e99a1c079084 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:44.608938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6f852-fc4f-4194-97d7-9ab5cf374f73 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:44.648801 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5d4e1-c8be-4c28-a178-0f15671d390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:44.649594 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5d4e1-c8be-4c28-a178-0f15671d390f None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:44.650030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5d4e1-c8be-4c28-a178-0f15671d390f None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:44.650383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5d4e1-c8be-4c28-a178-0f15671d390f None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:44.651179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5d4e1-c8be-4c28-a178-0f15671d390f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:44.651606 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5d4e1-c8be-4c28-a178-0f15671d390f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:44.653352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5d4e1-c8be-4c28-a178-0f15671d390f None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:44.671230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 327/663] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:42:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:44.671230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5d4e1-c8be-4c28-a178-0f15671d390f None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:44.677404 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9397e3c-5866-4862-b3f9-e99a1c079084 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:44.726813 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d183e-f2bc-4537-874e-96741d032f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:44.727990 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d183e-f2bc-4537-874e-96741d032f29 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:44.728795 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d183e-f2bc-4537-874e-96741d032f29 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:44.729212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d183e-f2bc-4537-874e-96741d032f29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:44.764413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:44.795273 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5d4e1-c8be-4c28-a178-0f15671d390f None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:44.823683 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:44.827468 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d183e-f2bc-4537-874e-96741d032f29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:44.829479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d183e-f2bc-4537-874e-96741d032f29 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:44.834169 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee0fb8-da9e-4b29-9078-13693308f715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:44.834795 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee0fb8-da9e-4b29-9078-13693308f715 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:44.837826 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee0fb8-da9e-4b29-9078-13693308f715 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:44.837826 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee0fb8-da9e-4b29-9078-13693308f715 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:44.914025 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee0fb8-da9e-4b29-9078-13693308f715 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:44.915557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee0fb8-da9e-4b29-9078-13693308f715 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:44.944016 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 337/664] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:44.944016 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d183e-f2bc-4537-874e-96741d032f29 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:45.006925 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:45.026244 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 328/665] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:45.027632 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ee45e-b6e1-408f-9a7d-1343ae45f735 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:45.027989 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ee45e-b6e1-408f-9a7d-1343ae45f735 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:45.028337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ee45e-b6e1-408f-9a7d-1343ae45f735 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:45.030045 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 329/666] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:45.035124 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ee45e-b6e1-408f-9a7d-1343ae45f735 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:45.055988 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:45.059659 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d183e-f2bc-4537-874e-96741d032f29 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:45.098509 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f7bd7-9e28-491c-83da-493515470ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:45.099254 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f7bd7-9e28-491c-83da-493515470ea9 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:45.099574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f7bd7-9e28-491c-83da-493515470ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:45.099853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f7bd7-9e28-491c-83da-493515470ea9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:45.100651 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f7bd7-9e28-491c-83da-493515470ea9 None admin] RBAC: Adding query filter params (role.id=183fd05fe14a41828222fd09b6280796, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=9bfc1fe981424313aecce5af443c8a9b) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:45.100955 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f7bd7-9e28-491c-83da-493515470ea9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:45.102397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f7bd7-9e28-491c-83da-493515470ea9 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:45.108883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 338/667] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:42:44 2022] GET /identity/v3/role_assignments?user.id=9bfc1fe981424313aecce5af443c8a9b&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=183fd05fe14a41828222fd09b6280796 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:45.110073 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f7bd7-9e28-491c-83da-493515470ea9 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:45.166402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ee45e-b6e1-408f-9a7d-1343ae45f735 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:45.211077 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a0c60-db96-4356-9789-47e834db9b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:45.212956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a0c60-db96-4356-9789-47e834db9b59 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:45.213463 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a0c60-db96-4356-9789-47e834db9b59 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:45.213944 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a0c60-db96-4356-9789-47e834db9b59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:45.230423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a0c60-db96-4356-9789-47e834db9b59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:45.233220 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a0c60-db96-4356-9789-47e834db9b59 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:45.247692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f7bd7-9e28-491c-83da-493515470ea9 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:45.256096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-dd2a0c60-db96-4356-9789-47e834db9b59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:45.256096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:45.256096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:45.256096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:45.256096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:45.256096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:45.256096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:45.256096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:45.256096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:45.256096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:45.256096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:45.256096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:45.256096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:45.256096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:45.256096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:45.257030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:45.257030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:45.257030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:45.257030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:45.257030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:45.257030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:45.257030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:45.257030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:45.257030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:45.257030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:45.257030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:45.257030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:45.257030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:45.257030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:45.257030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:45.257030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:45.257030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:45.257902 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:45.257902 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:45.257902 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:45.257902 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:45.260700 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 330/668] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:45.262234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb420f1-49b7-4e60-8dbf-95631c6cfdc3 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:45.262672 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb420f1-49b7-4e60-8dbf-95631c6cfdc3 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:45.263079 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb420f1-49b7-4e60-8dbf-95631c6cfdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:45.287671 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-2bb420f1-49b7-4e60-8dbf-95631c6cfdc3 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:45.289691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-2bb420f1-49b7-4e60-8dbf-95631c6cfdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:45.306104 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3425da0-7cf1-470d-9b22-e775956d6d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:45.307366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3425da0-7cf1-470d-9b22-e775956d6d6a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:45.309131 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3425da0-7cf1-470d-9b22-e775956d6d6a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:45.309131 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3425da0-7cf1-470d-9b22-e775956d6d6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:45.323078 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3425da0-7cf1-470d-9b22-e775956d6d6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:45.324554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3425da0-7cf1-470d-9b22-e775956d6d6a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:45.326702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:45.347689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-f3425da0-7cf1-470d-9b22-e775956d6d6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:45.347689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:45.347689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:45.347689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:45.347689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:45.347689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:45.347689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:45.347689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:45.347689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:45.347689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:45.347689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:45.347689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:45.347689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:45.347689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:45.347689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:45.348703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:45.348703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:45.348703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:45.348703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:45.348703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:45.348703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:45.348703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:45.348703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:45.348703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:45.348703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:45.348703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:45.348703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:45.348703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:45.348703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:45.348703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:45.348703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:45.348703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:45.349562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:45.349562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:45.349562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:45.349562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:45.349562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 339/669] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:45.350184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3425da0-7cf1-470d-9b22-e775956d6d6a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:45.369432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:45.388802 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 331/670] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:45.396043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb420f1-49b7-4e60-8dbf-95631c6cfdc3 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:45.472910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3425da0-7cf1-470d-9b22-e775956d6d6a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:45.523093 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb420f1-49b7-4e60-8dbf-95631c6cfdc3 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:45.533640 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f829650-14a8-44ca-95ed-c98c91a677b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:45.534593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f829650-14a8-44ca-95ed-c98c91a677b0 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:45.535564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f829650-14a8-44ca-95ed-c98c91a677b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:45.536056 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f829650-14a8-44ca-95ed-c98c91a677b0 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:45.537582 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f829650-14a8-44ca-95ed-c98c91a677b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:45.538181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f829650-14a8-44ca-95ed-c98c91a677b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:45.540138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f829650-14a8-44ca-95ed-c98c91a677b0 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:45.559630 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 340/671] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:45.560567 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f829650-14a8-44ca-95ed-c98c91a677b0 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:45.568071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d2baf-7ac2-4def-8503-093b5aa5d5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:45.568716 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d2baf-7ac2-4def-8503-093b5aa5d5c7 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:45.569006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d2baf-7ac2-4def-8503-093b5aa5d5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:45.569284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d2baf-7ac2-4def-8503-093b5aa5d5c7 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:45.569992 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d2baf-7ac2-4def-8503-093b5aa5d5c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:45.570300 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d2baf-7ac2-4def-8503-093b5aa5d5c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:45.571785 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d2baf-7ac2-4def-8503-093b5aa5d5c7 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:45.589074 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 332/672] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:45.589740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d2baf-7ac2-4def-8503-093b5aa5d5c7 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:45.626585 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:45.650689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:45.680417 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f829650-14a8-44ca-95ed-c98c91a677b0 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:45.711565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d2baf-7ac2-4def-8503-093b5aa5d5c7 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:45.720615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8c53c-4c1b-4a29-893f-9a55adfed1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:45.721284 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8c53c-4c1b-4a29-893f-9a55adfed1e4 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:45.721574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8c53c-4c1b-4a29-893f-9a55adfed1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:45.722072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8c53c-4c1b-4a29-893f-9a55adfed1e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:45.733873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8c53c-4c1b-4a29-893f-9a55adfed1e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:45.739479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-afb8c53c-4c1b-4a29-893f-9a55adfed1e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:42:45.739479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:45.739479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:45.739479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:45.739479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:45.739479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:45.739479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:45.739479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:45.739479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:45.739479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:45.739479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:45.739479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:45.739479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:45.739479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:45.739479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:45.739479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:45.741999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:45.741999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:45.741999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:45.741999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:45.741999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:45.741999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:45.741999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:45.741999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:45.741999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:45.741999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:45.741999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:45.741999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:45.741999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:45.741999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:45.741999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:45.741999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:45.743061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:45.743061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:45.743061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:45.743061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:45.743061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:45.743061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:45.743061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:45.743061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:45.743061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:45.743061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:45.743061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:42:45.743061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:45.743061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 341/673] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:42:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:45.743061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8c53c-4c1b-4a29-893f-9a55adfed1e4 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:45.755819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e204e2-1b45-4843-8cfb-d2d19b777e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:45.756915 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e204e2-1b45-4843-8cfb-d2d19b777e47 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:45.757196 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e204e2-1b45-4843-8cfb-d2d19b777e47 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:45.757466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e204e2-1b45-4843-8cfb-d2d19b777e47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:45.764876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e204e2-1b45-4843-8cfb-d2d19b777e47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:45.767192 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e204e2-1b45-4843-8cfb-d2d19b777e47 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:45.786352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-d5e204e2-1b45-4843-8cfb-d2d19b777e47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:45.786352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:45.786352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:45.786352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:45.786352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:45.786352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:45.786352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:45.786352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:45.786352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:45.786352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:45.786352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:45.786352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:45.786352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:42:45.786352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:42:45.786352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:42:45.787230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:42:45.787230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:45.787230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:45.787230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:45.787230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:45.787230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:45.787230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:45.787230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:45.787230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:45.787230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:45.787230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:45.787230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:45.787230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:45.787230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:45.787230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:45.787230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:45.787230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:45.788242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:42:45.788242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:42:45.788242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:42:45.788242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:42:45.788242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:42:45.788242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:42:45.788242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:45.788242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:45.788242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 333/674] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:45.789702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b6d96-4f65-4569-8fab-266df39db4ac None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:45.789702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b6d96-4f65-4569-8fab-266df39db4ac None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:45.789890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b6d96-4f65-4569-8fab-266df39db4ac None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:45.791126 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 334/675] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:45.791764 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b6d96-4f65-4569-8fab-266df39db4ac None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:45.861190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8c53c-4c1b-4a29-893f-9a55adfed1e4 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:45.881796 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:45.898256 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74ee78-5643-47f4-a421-1e563482aac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:45.898989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74ee78-5643-47f4-a421-1e563482aac2 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:45.899175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b6d96-4f65-4569-8fab-266df39db4ac None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:45.900310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74ee78-5643-47f4-a421-1e563482aac2 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:45.900310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74ee78-5643-47f4-a421-1e563482aac2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:45.903860 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:45.911135 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74ee78-5643-47f4-a421-1e563482aac2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:45.912610 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74ee78-5643-47f4-a421-1e563482aac2 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:45.925180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-8d74ee78-5643-47f4-a421-1e563482aac2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:45.925180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:45.925180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:45.925180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:45.925180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:45.925180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:45.925180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:45.925180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:45.925180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:45.925180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:45.925180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:45.925180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:45.925180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:42:45.925180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:42:45.925180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:42:45.926119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:42:45.926119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:45.926119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:45.926119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:45.926119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:45.926119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:45.926119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:45.926119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:45.926119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:45.926119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:45.926119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:45.926119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:45.926119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:45.926119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:45.926119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:45.926119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:45.926119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:45.927038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:42:45.927038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:42:45.927038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:42:45.927038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:42:45.927038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:42:45.927038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:42:45.927038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:45.927038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:45.931027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 342/676] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:45.931876 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74ee78-5643-47f4-a421-1e563482aac2 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:45.944336 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0b4a3-e60b-40ab-b457-e55ef4d4bd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:45.945250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0b4a3-e60b-40ab-b457-e55ef4d4bd65 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:45.945747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0b4a3-e60b-40ab-b457-e55ef4d4bd65 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:45.946213 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0b4a3-e60b-40ab-b457-e55ef4d4bd65 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:45.946947 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0b4a3-e60b-40ab-b457-e55ef4d4bd65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:45.947253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0b4a3-e60b-40ab-b457-e55ef4d4bd65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:45.948700 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0b4a3-e60b-40ab-b457-e55ef4d4bd65 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:45.957917 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 335/677] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:45.959161 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7add06-e5d0-4c5a-81c9-1cb3539d65ea None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:45.959482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7add06-e5d0-4c5a-81c9-1cb3539d65ea None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:45.959759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7add06-e5d0-4c5a-81c9-1cb3539d65ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:45.977997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-fc7add06-e5d0-4c5a-81c9-1cb3539d65ea None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:45.979213 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-fc7add06-e5d0-4c5a-81c9-1cb3539d65ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:46.047214 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74ee78-5643-47f4-a421-1e563482aac2 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:46.056652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 336/678] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:46.058121 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7add06-e5d0-4c5a-81c9-1cb3539d65ea None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:46.084481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a7884-385b-4b7f-b11c-83ee82ea938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:46.085409 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a7884-385b-4b7f-b11c-83ee82ea938a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:46.085694 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a7884-385b-4b7f-b11c-83ee82ea938a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:46.085967 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a7884-385b-4b7f-b11c-83ee82ea938a None admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:46.086726 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a7884-385b-4b7f-b11c-83ee82ea938a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:46.087033 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a7884-385b-4b7f-b11c-83ee82ea938a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:46.088944 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a7884-385b-4b7f-b11c-83ee82ea938a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:46.106022 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 343/679] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:42:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:46.106022 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a7884-385b-4b7f-b11c-83ee82ea938a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:46.154617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:46.166496 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:46.178435 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7add06-e5d0-4c5a-81c9-1cb3539d65ea None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:46.212013 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a7884-385b-4b7f-b11c-83ee82ea938a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:46.213834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f280e0-edbf-4e63-9d7a-7b0f0fa3623e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:46.214474 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f280e0-edbf-4e63-9d7a-7b0f0fa3623e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:46.214753 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f280e0-edbf-4e63-9d7a-7b0f0fa3623e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:46.215030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f280e0-edbf-4e63-9d7a-7b0f0fa3623e None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:46.215809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f280e0-edbf-4e63-9d7a-7b0f0fa3623e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:46.216118 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f280e0-edbf-4e63-9d7a-7b0f0fa3623e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:46.217562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f280e0-edbf-4e63-9d7a-7b0f0fa3623e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:46.235342 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 337/680] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:42:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:46.235342 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f280e0-edbf-4e63-9d7a-7b0f0fa3623e None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:46.254283 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348cdde-c562-4fcf-80a9-a3226092126c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:46.254925 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348cdde-c562-4fcf-80a9-a3226092126c None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:46.255204 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348cdde-c562-4fcf-80a9-a3226092126c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:46.255505 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348cdde-c562-4fcf-80a9-a3226092126c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:46.268547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348cdde-c562-4fcf-80a9-a3226092126c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:46.270000 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348cdde-c562-4fcf-80a9-a3226092126c None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:46.286728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-2348cdde-c562-4fcf-80a9-a3226092126c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:46.286728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:46.286728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:46.286728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:46.286728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:46.286728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:46.286728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:46.286728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:46.286728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:46.286728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:46.286728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:46.286728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:46.286728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:46.286728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:46.286728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:46.287815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:46.287815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:46.287815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:46.287815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:46.287815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:46.287815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:46.287815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:46.287815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:46.287815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:46.287815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:46.287815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:46.287815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:46.287815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:46.287815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:46.287815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:46.287815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:46.287815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:46.288768 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:46.288768 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:46.288768 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:46.288768 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:46.288768 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 344/681] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:46.289215 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348cdde-c562-4fcf-80a9-a3226092126c None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:46.350873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f280e0-edbf-4e63-9d7a-7b0f0fa3623e None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:46.386191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9344e-d4a8-4602-bd58-26b61f35e604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:46.387209 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9344e-d4a8-4602-bd58-26b61f35e604 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:46.387682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9344e-d4a8-4602-bd58-26b61f35e604 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:46.388089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9344e-d4a8-4602-bd58-26b61f35e604 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:46.393033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:46.396852 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348cdde-c562-4fcf-80a9-a3226092126c None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:46.404013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9344e-d4a8-4602-bd58-26b61f35e604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:46.407660 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:46.412203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-5cf9344e-d4a8-4602-bd58-26b61f35e604 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:46.412203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:46.412203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:46.412203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:46.412203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:46.412203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:46.412203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:46.412203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:46.412203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:46.412203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:46.412203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:46.412203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:46.412203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:46.412203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:46.412203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:46.412203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:46.414102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:46.414102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:46.414102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:46.414102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:46.414102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:46.414102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:46.414102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:46.414102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:46.414102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:46.414102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:46.414102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:46.414102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:46.414102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:46.414102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:46.414102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:46.414102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:46.414970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:46.414970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:46.414970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:46.414970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:46.414970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:46.414970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:46.414970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:46.414970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:46.414970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:46.414970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:46.414970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:46.414970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:46.414970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 338/682] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:42:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:46.415696 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9344e-d4a8-4602-bd58-26b61f35e604 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:46.436166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8f880-c046-4c9e-ad23-09ed7aea2819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:46.437087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8f880-c046-4c9e-ad23-09ed7aea2819 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:46.437956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8f880-c046-4c9e-ad23-09ed7aea2819 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:46.438238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8f880-c046-4c9e-ad23-09ed7aea2819 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:46.439031 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8f880-c046-4c9e-ad23-09ed7aea2819 None admin] RBAC: Adding query filter params (role.id=183fd05fe14a41828222fd09b6280796, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=03742c23cae849d9bf4ce0b432edd1cc) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:46.439795 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8f880-c046-4c9e-ad23-09ed7aea2819 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:46.441549 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8f880-c046-4c9e-ad23-09ed7aea2819 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:46.448740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 345/683] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:42:46 2022] GET /identity/v3/role_assignments?user.id=03742c23cae849d9bf4ce0b432edd1cc&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=183fd05fe14a41828222fd09b6280796 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:46.449615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8f880-c046-4c9e-ad23-09ed7aea2819 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:46.558686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9344e-d4a8-4602-bd58-26b61f35e604 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:46.578575 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8f880-c046-4c9e-ad23-09ed7aea2819 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:46.606172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fd362-b930-4adf-93de-e5e092f1317b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:46.606734 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fd362-b930-4adf-93de-e5e092f1317b None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:46.607017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fd362-b930-4adf-93de-e5e092f1317b None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:46.607295 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fd362-b930-4adf-93de-e5e092f1317b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:46.608329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fd362-b930-4adf-93de-e5e092f1317b None admin] RBAC: Adding query filter params (role.id=183fd05fe14a41828222fd09b6280796, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=dd31134e1f8545b0bbbe3c223b165df1) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:46.608648 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fd362-b930-4adf-93de-e5e092f1317b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:46.611533 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fd362-b930-4adf-93de-e5e092f1317b None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:46.620017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 339/684] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:42:46 2022] GET /identity/v3/role_assignments?user.id=dd31134e1f8545b0bbbe3c223b165df1&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=183fd05fe14a41828222fd09b6280796 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:46.620857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fd362-b930-4adf-93de-e5e092f1317b None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:46.621314 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2f78b-c737-4780-9d0d-6798f03886c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:46.622053 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2f78b-c737-4780-9d0d-6798f03886c7 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:46.622436 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2f78b-c737-4780-9d0d-6798f03886c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:46.622813 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2f78b-c737-4780-9d0d-6798f03886c7 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:46.623739 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2f78b-c737-4780-9d0d-6798f03886c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:46.624152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2f78b-c737-4780-9d0d-6798f03886c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:46.627004 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2f78b-c737-4780-9d0d-6798f03886c7 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:46.642665 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 346/685] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:46.648033 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2f78b-c737-4780-9d0d-6798f03886c7 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:46.701703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:46.723722 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:46.788131 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fd362-b930-4adf-93de-e5e092f1317b None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:46.795597 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2f78b-c737-4780-9d0d-6798f03886c7 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:46.838086 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b02091-0a26-4f7f-a37d-78dfe9e1c768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:46.838301 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb39f7-6222-4fcd-99f8-be24c41111b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:46.838675 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b02091-0a26-4f7f-a37d-78dfe9e1c768 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:46.838947 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb39f7-6222-4fcd-99f8-be24c41111b4 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:46.839049 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b02091-0a26-4f7f-a37d-78dfe9e1c768 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:46.839217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b02091-0a26-4f7f-a37d-78dfe9e1c768 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:46.839307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb39f7-6222-4fcd-99f8-be24c41111b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:46.841383 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb39f7-6222-4fcd-99f8-be24c41111b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:46.841505 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b02091-0a26-4f7f-a37d-78dfe9e1c768 None admin] RBAC: Adding query filter params (name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:46.841505 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b02091-0a26-4f7f-a37d-78dfe9e1c768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:46.842649 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b02091-0a26-4f7f-a37d-78dfe9e1c768 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:46.851563 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb39f7-6222-4fcd-99f8-be24c41111b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:46.853027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb39f7-6222-4fcd-99f8-be24c41111b4 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:46.854277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 340/686] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:42:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:46.861199 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b02091-0a26-4f7f-a37d-78dfe9e1c768 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:46.867390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-7dbb39f7-6222-4fcd-99f8-be24c41111b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:42:46.867390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:46.867390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:46.867390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:46.867390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:46.867390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:46.867390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:46.867390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:46.867390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:46.867390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:46.867390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:46.867390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:46.867390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:46.867390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:46.867390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:46.867390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:46.868740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:46.868740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:46.868740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:46.868740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:46.868740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:46.868740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:46.868740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:46.868740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:46.868740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:46.868740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:46.868740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:46.868740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:46.868740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:46.868740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:46.868740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:46.868740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:46.868740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:46.868740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:46.869673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:46.869673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:46.869673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:46.869673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:46.869673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:46.869673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:46.869673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:46.869673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:46.869673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:42:46.869673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:46.872330 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 347/687] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 28 03:42:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:46.878635 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb39f7-6222-4fcd-99f8-be24c41111b4 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:46.992601 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b02091-0a26-4f7f-a37d-78dfe9e1c768 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:46.994867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:47.005063 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb39f7-6222-4fcd-99f8-be24c41111b4 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:47.018909 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:47.034633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763eae3-2a26-4da3-be21-534ff5140dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:47.035303 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763eae3-2a26-4da3-be21-534ff5140dd0 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:47.035613 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763eae3-2a26-4da3-be21-534ff5140dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:47.035885 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763eae3-2a26-4da3-be21-534ff5140dd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:47.049412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763eae3-2a26-4da3-be21-534ff5140dd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:47.049412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763eae3-2a26-4da3-be21-534ff5140dd0 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:47.056168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd4123-a15f-4943-9013-9663bfa15d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:47.056999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd4123-a15f-4943-9013-9663bfa15d96 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:47.057432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd4123-a15f-4943-9013-9663bfa15d96 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:47.057912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd4123-a15f-4943-9013-9663bfa15d96 None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:47.058921 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd4123-a15f-4943-9013-9663bfa15d96 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:47.059497 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd4123-a15f-4943-9013-9663bfa15d96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:47.061181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd4123-a15f-4943-9013-9663bfa15d96 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:47.067475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-e763eae3-2a26-4da3-be21-534ff5140dd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:47.067475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:47.067475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:47.067475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:47.067475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:47.067475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:47.067475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:47.067475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:47.067475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:47.067475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:47.067475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:47.067475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:47.067475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:47.067475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:47.067475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:47.068378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:47.068378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:47.068378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:47.068378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:47.068378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:47.068378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:47.068378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:47.068378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:47.068378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:47.068378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:47.068378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:47.068378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:47.068378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:47.068378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:47.068378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:47.068378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:47.068378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:47.069256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:47.069256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:47.069256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:47.069256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:47.069256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 341/688] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:42:47.079159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763eae3-2a26-4da3-be21-534ff5140dd0 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:47.091968 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 348/689] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 28 03:42:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:47.098655 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd4123-a15f-4943-9013-9663bfa15d96 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:47.254428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd4123-a15f-4943-9013-9663bfa15d96 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:47.290364 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f53da2-fd8e-41ee-8a6c-0bb76e4a93f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:47.290986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f53da2-fd8e-41ee-8a6c-0bb76e4a93f8 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:47.291264 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f53da2-fd8e-41ee-8a6c-0bb76e4a93f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:47.291563 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f53da2-fd8e-41ee-8a6c-0bb76e4a93f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:47.339697 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:47.341320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763eae3-2a26-4da3-be21-534ff5140dd0 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:47.362806 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f53da2-fd8e-41ee-8a6c-0bb76e4a93f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:47.364310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f53da2-fd8e-41ee-8a6c-0bb76e4a93f8 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:47.412466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0104ed-e18b-4654-8f26-586683b51b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:47.413241 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0104ed-e18b-4654-8f26-586683b51b9a None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:47.413615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0104ed-e18b-4654-8f26-586683b51b9a None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:47.413892 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0104ed-e18b-4654-8f26-586683b51b9a None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:47.414641 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0104ed-e18b-4654-8f26-586683b51b9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:47.414945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0104ed-e18b-4654-8f26-586683b51b9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:47.416455 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0104ed-e18b-4654-8f26-586683b51b9a None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:47.430051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 342/690] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:47.431549 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc6b34-7a32-48c3-bb57-f562ec8673f2 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:47.431832 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc6b34-7a32-48c3-bb57-f562ec8673f2 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:47.432103 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc6b34-7a32-48c3-bb57-f562ec8673f2 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:47.433567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 343/691] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:47.440902 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1581310-7c35-406e-8782-2425f6b92bf8 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:47.441419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1581310-7c35-406e-8782-2425f6b92bf8 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:47.441847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1581310-7c35-406e-8782-2425f6b92bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:47.461504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-d1581310-7c35-406e-8782-2425f6b92bf8 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:47.463023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d1581310-7c35-406e-8782-2425f6b92bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:47.472064 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 349/692] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:47.472671 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f53da2-fd8e-41ee-8a6c-0bb76e4a93f8 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:47.493060 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:47.530066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:47.542599 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 344/693] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:47.543635 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1581310-7c35-406e-8782-2425f6b92bf8 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:47.584884 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f53da2-fd8e-41ee-8a6c-0bb76e4a93f8 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:47.629163 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022508d3-4749-4d50-9a59-0de427c0301a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:47.629817 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022508d3-4749-4d50-9a59-0de427c0301a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:47.630256 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022508d3-4749-4d50-9a59-0de427c0301a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:47.630540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022508d3-4749-4d50-9a59-0de427c0301a None admin] PATH_INFO: `/v3/users/swift` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:47.640061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022508d3-4749-4d50-9a59-0de427c0301a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:47.642368 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022508d3-4749-4d50-9a59-0de427c0301a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:47.658859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-022508d3-4749-4d50-9a59-0de427c0301a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 03:42:47.658859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:47.658859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:47.658859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:47.658859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:47.658859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:47.658859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:47.658859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:47.658859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:47.658859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:47.658859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:47.658859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:47.658859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:47.658859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:47.658859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:47.658859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:47.659856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:47.659856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:47.659856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:47.659856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:47.659856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:47.659856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:47.659856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:47.659856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:47.659856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:47.659856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:47.659856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:47.659856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:47.659856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:47.659856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:47.659856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:47.659856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:47.659856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:47.659856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:47.660796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:47.660796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:47.660796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:47.660796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:47.660796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:47.660796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:47.660796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:47.660796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:47.660796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 03:42:47.660796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:47.660796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 350/694] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:42:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:47.661387 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022508d3-4749-4d50-9a59-0de427c0301a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:47.697483 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1581310-7c35-406e-8782-2425f6b92bf8 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:47.743541 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ae144-ed00-440b-8f9d-49f912974f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:47.744206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ae144-ed00-440b-8f9d-49f912974f04 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:47.744484 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ae144-ed00-440b-8f9d-49f912974f04 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:47.744756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ae144-ed00-440b-8f9d-49f912974f04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:47.756390 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ae144-ed00-440b-8f9d-49f912974f04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:47.757981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ae144-ed00-440b-8f9d-49f912974f04 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:47.775017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-879ae144-ed00-440b-8f9d-49f912974f04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:47.775017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:47.775017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:47.775017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:47.775017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:47.775017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:47.775017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:47.775017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:47.775017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:47.775017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:47.775017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:47.775017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:47.775017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:47.775017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:47.775017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:47.777134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:47.777134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:47.777134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:47.777134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:47.777134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:47.777134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:47.777134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:47.777134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:47.777134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:47.777134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:47.777134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:47.777134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:47.777134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:47.777134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:47.777134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:47.777134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:47.777134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:47.779670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:47.779670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:47.779670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:47.779670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:47.779670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 345/695] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:47.779670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ae144-ed00-440b-8f9d-49f912974f04 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:47.794254 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022508d3-4749-4d50-9a59-0de427c0301a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:47.798680 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:47.800142 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:47.824339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0307c7f-be5d-4fc2-b3d3-45685d60dbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:47.825050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0307c7f-be5d-4fc2-b3d3-45685d60dbc9 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:47.825331 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0307c7f-be5d-4fc2-b3d3-45685d60dbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:47.825602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0307c7f-be5d-4fc2-b3d3-45685d60dbc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:47.836659 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0307c7f-be5d-4fc2-b3d3-45685d60dbc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:47.838100 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0307c7f-be5d-4fc2-b3d3-45685d60dbc9 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:47.852710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-d0307c7f-be5d-4fc2-b3d3-45685d60dbc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:47.852710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:47.852710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:47.852710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:47.852710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:47.852710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:47.852710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:47.852710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:47.852710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:47.852710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:47.852710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:47.852710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:47.852710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:47.852710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:47.852710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:47.857084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:47.857084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:47.857084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:47.857084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:47.857084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:47.857084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:47.857084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:47.857084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:47.857084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:47.857084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:47.857084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:47.857084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:47.857084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:47.857084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:47.857084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:47.857084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:47.857084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:47.857986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:47.857986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:47.857986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:47.857986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:47.857986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 351/696] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:47.857986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0307c7f-be5d-4fc2-b3d3-45685d60dbc9 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:47.895646 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ae144-ed00-440b-8f9d-49f912974f04 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:47.936242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51227d-e83b-48a4-b8af-5715204e70d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:47.937375 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51227d-e83b-48a4-b8af-5715204e70d6 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:47.937810 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51227d-e83b-48a4-b8af-5715204e70d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:47.938363 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51227d-e83b-48a4-b8af-5715204e70d6 None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:47.939373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51227d-e83b-48a4-b8af-5715204e70d6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:47.939860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51227d-e83b-48a4-b8af-5715204e70d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:47.941482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51227d-e83b-48a4-b8af-5715204e70d6 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:47.962104 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 346/697] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 28 03:42:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:47.963337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51227d-e83b-48a4-b8af-5715204e70d6 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:47.974864 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0307c7f-be5d-4fc2-b3d3-45685d60dbc9 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:48.010611 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3f812-eb0a-49a0-af55-c6a1673082dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:48.011146 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3f812-eb0a-49a0-af55-c6a1673082dd None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:48.011530 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3f812-eb0a-49a0-af55-c6a1673082dd None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:48.011878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3f812-eb0a-49a0-af55-c6a1673082dd None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:48.012654 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3f812-eb0a-49a0-af55-c6a1673082dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:48.013034 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3f812-eb0a-49a0-af55-c6a1673082dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:48.014493 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3f812-eb0a-49a0-af55-c6a1673082dd None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:48.027570 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 352/698] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:48.028558 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3f812-eb0a-49a0-af55-c6a1673082dd None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:48.052238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:48.054425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:48.081216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51227d-e83b-48a4-b8af-5715204e70d6 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:48.118910 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74070cfc-64c4-405e-8605-ba1b0b8944a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:48.119930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74070cfc-64c4-405e-8605-ba1b0b8944a6 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:48.120414 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74070cfc-64c4-405e-8605-ba1b0b8944a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:48.120857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74070cfc-64c4-405e-8605-ba1b0b8944a6 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:48.121752 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74070cfc-64c4-405e-8605-ba1b0b8944a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:48.122245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74070cfc-64c4-405e-8605-ba1b0b8944a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:48.124000 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74070cfc-64c4-405e-8605-ba1b0b8944a6 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:48.134831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3f812-eb0a-49a0-af55-c6a1673082dd None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:48.138466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 347/699] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:48.139708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74070cfc-64c4-405e-8605-ba1b0b8944a6 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:48.175919 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2ef91-004e-4ccc-b0a1-c2437cf9dde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:48.176618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2ef91-004e-4ccc-b0a1-c2437cf9dde9 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:48.176985 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2ef91-004e-4ccc-b0a1-c2437cf9dde9 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:48.177316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2ef91-004e-4ccc-b0a1-c2437cf9dde9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:48.248226 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2ef91-004e-4ccc-b0a1-c2437cf9dde9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:48.250457 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2ef91-004e-4ccc-b0a1-c2437cf9dde9 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:48.256226 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74070cfc-64c4-405e-8605-ba1b0b8944a6 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:48.275225 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:48.294741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31306f1-9ab1-4f58-b942-d47a0ea47b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:48.295745 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31306f1-9ab1-4f58-b942-d47a0ea47b56 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:48.296341 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31306f1-9ab1-4f58-b942-d47a0ea47b56 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:48.296875 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31306f1-9ab1-4f58-b942-d47a0ea47b56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:48.302408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:48.305126 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31306f1-9ab1-4f58-b942-d47a0ea47b56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:48.306797 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31306f1-9ab1-4f58-b942-d47a0ea47b56 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:48.320316 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-d31306f1-9ab1-4f58-b942-d47a0ea47b56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:48.320316 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:48.320316 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:48.320316 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:48.320316 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:48.320316 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:48.320316 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:48.320316 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:48.320316 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:48.320316 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:48.320316 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:48.320316 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:48.320316 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:42:48.320316 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:42:48.320316 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:42:48.321253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:42:48.321253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:48.321253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:48.321253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:48.321253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:48.321253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:48.321253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:48.321253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:48.321253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:48.321253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:48.321253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:48.321253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:48.321253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:48.321253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:48.321253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:48.321253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:48.321253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:48.322107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:42:48.322107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:42:48.322107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:42:48.322107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:42:48.322107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:42:48.322107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:42:48.322107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:48.322107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:48.324737 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 348/700] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:48.325839 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31306f1-9ab1-4f58-b942-d47a0ea47b56 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:48.360248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 353/701] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:48.361164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2ef91-004e-4ccc-b0a1-c2437cf9dde9 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:48.443492 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31306f1-9ab1-4f58-b942-d47a0ea47b56 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:48.464248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2ef91-004e-4ccc-b0a1-c2437cf9dde9 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:48.483808 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc296fd-e179-4624-98ac-4b4f2c134ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:48.484472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc296fd-e179-4624-98ac-4b4f2c134ed2 None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:48.484758 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc296fd-e179-4624-98ac-4b4f2c134ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:48.485038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc296fd-e179-4624-98ac-4b4f2c134ed2 None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:48.485756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc296fd-e179-4624-98ac-4b4f2c134ed2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:48.487282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc296fd-e179-4624-98ac-4b4f2c134ed2 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:48.488757 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:48.500506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaed0b-a125-446e-8f86-608a4c6c4bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:48.500879 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaed0b-a125-446e-8f86-608a4c6c4bd4 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:48.501171 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaed0b-a125-446e-8f86-608a4c6c4bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:48.501451 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaed0b-a125-446e-8f86-608a4c6c4bd4 None admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:48.502342 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eaed0b-a125-446e-8f86-608a4c6c4bd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:48.502653 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eaed0b-a125-446e-8f86-608a4c6c4bd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:48.504162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eaed0b-a125-446e-8f86-608a4c6c4bd4 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:48.517469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 354/702] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:42:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:48.523571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaed0b-a125-446e-8f86-608a4c6c4bd4 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:48.632112 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 349/703] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 28 03:42:48 2022] POST /identity/v3/users => generated 254 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:42:48.633340 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc296fd-e179-4624-98ac-4b4f2c134ed2 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:48.634275 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaed0b-a125-446e-8f86-608a4c6c4bd4 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:48.709564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099938ed-9d64-49fc-a0ba-56181b290006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:48.710241 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099938ed-9d64-49fc-a0ba-56181b290006 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:48.710524 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099938ed-9d64-49fc-a0ba-56181b290006 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:48.710798 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099938ed-9d64-49fc-a0ba-56181b290006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:48.735264 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099938ed-9d64-49fc-a0ba-56181b290006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:48.736777 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099938ed-9d64-49fc-a0ba-56181b290006 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:48.743899 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:48.790514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-099938ed-9d64-49fc-a0ba-56181b290006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:48.790514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:48.790514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:48.790514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:48.790514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:48.790514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:48.790514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:48.790514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:48.790514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:48.790514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:48.790514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:48.790514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:48.790514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:48.790514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:48.790514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:48.791645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:48.791645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:48.791645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:48.791645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:48.791645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:48.791645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:48.791645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:48.791645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:48.791645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:48.791645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:48.791645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:48.791645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:48.791645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:48.791645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:48.791645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:48.791645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:48.791645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:48.792808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:48.792808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:48.792808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:48.792808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:48.796981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 355/704] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:48.804469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099938ed-9d64-49fc-a0ba-56181b290006 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:48.864031 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc296fd-e179-4624-98ac-4b4f2c134ed2 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:48.870748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:48.912347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8387cd-0aa4-4a45-ba6a-cbbc8ded49de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:48.912962 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8387cd-0aa4-4a45-ba6a-cbbc8ded49de None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:48.913246 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8387cd-0aa4-4a45-ba6a-cbbc8ded49de None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:48.913755 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8387cd-0aa4-4a45-ba6a-cbbc8ded49de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:48.914325 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8387cd-0aa4-4a45-ba6a-cbbc8ded49de None admin] RBAC: Adding query filter params (role.id=8a5766c4aef44773834941d1bdbd1e98, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=5133abf4c32a45b0b2188f71496c572b) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:48.914636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8387cd-0aa4-4a45-ba6a-cbbc8ded49de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:48.916182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8387cd-0aa4-4a45-ba6a-cbbc8ded49de None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:48.923257 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 350/705] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:42:48 2022] GET /identity/v3/role_assignments?user.id=5133abf4c32a45b0b2188f71496c572b&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=8a5766c4aef44773834941d1bdbd1e98 => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:48.926024 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23375f-7499-440e-b7c5-06b80c556d15 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:48.926320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23375f-7499-440e-b7c5-06b80c556d15 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:48.926600 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23375f-7499-440e-b7c5-06b80c556d15 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:48.928277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 351/706] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:48.938010 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b272b39-62f2-4fe9-8c81-9fcfe88150af None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:48.938499 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b272b39-62f2-4fe9-8c81-9fcfe88150af None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:48.938804 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b272b39-62f2-4fe9-8c81-9fcfe88150af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:48.963157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-3b272b39-62f2-4fe9-8c81-9fcfe88150af None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:48.965019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-3b272b39-62f2-4fe9-8c81-9fcfe88150af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:48.972560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099938ed-9d64-49fc-a0ba-56181b290006 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:49.022359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90059135-bec7-4e60-892b-6a1be940b502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:49.023782 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90059135-bec7-4e60-892b-6a1be940b502 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:49.024218 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90059135-bec7-4e60-892b-6a1be940b502 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:49.024666 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90059135-bec7-4e60-892b-6a1be940b502 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:49.025545 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90059135-bec7-4e60-892b-6a1be940b502 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:49.026016 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90059135-bec7-4e60-892b-6a1be940b502 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:49.027596 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90059135-bec7-4e60-892b-6a1be940b502 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:49.041944 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 356/707] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:49.048450 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90059135-bec7-4e60-892b-6a1be940b502 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:49.094965 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 352/708] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 03:42:49.096686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2c0f6-f49a-401a-bc9f-91817858d065 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:49.097127 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2c0f6-f49a-401a-bc9f-91817858d065 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:49.097556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2c0f6-f49a-401a-bc9f-91817858d065 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:49.099390 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 353/709] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:49.105173 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55476107-c9a5-4c36-bb1c-b09569f83206 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:49.105484 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55476107-c9a5-4c36-bb1c-b09569f83206 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:49.105762 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55476107-c9a5-4c36-bb1c-b09569f83206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:49.133732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-55476107-c9a5-4c36-bb1c-b09569f83206 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:49.134940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-55476107-c9a5-4c36-bb1c-b09569f83206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:49.193016 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:49.193343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:49.200820 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90059135-bec7-4e60-892b-6a1be940b502 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:49.235682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 354/710] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:49.237128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55476107-c9a5-4c36-bb1c-b09569f83206 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:49.252045 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9eb1c-358d-4b01-b90a-0e58c7d7ab0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:49.252706 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9eb1c-358d-4b01-b90a-0e58c7d7ab0f None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:49.252987 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9eb1c-358d-4b01-b90a-0e58c7d7ab0f None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:49.253341 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9eb1c-358d-4b01-b90a-0e58c7d7ab0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:49.270441 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9eb1c-358d-4b01-b90a-0e58c7d7ab0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:49.272553 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9eb1c-358d-4b01-b90a-0e58c7d7ab0f None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:49.286647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-89a9eb1c-358d-4b01-b90a-0e58c7d7ab0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:49.286647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:49.286647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:49.286647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:49.286647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:49.286647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:49.286647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:49.286647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:49.286647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:49.286647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:49.286647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:49.286647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:49.286647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:42:49.286647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:42:49.286647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:42:49.287786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:42:49.287786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:49.287786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:49.287786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:49.287786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:49.287786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:49.287786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:49.287786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:49.287786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:49.287786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:49.287786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:49.287786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:49.287786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:49.287786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:49.287786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:49.287786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:49.287786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:49.288650 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:42:49.288650 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:42:49.288650 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:42:49.288650 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:42:49.288650 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:42:49.288650 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:42:49.288650 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:49.288650 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:49.291078 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 357/711] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:49.292097 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9eb1c-358d-4b01-b90a-0e58c7d7ab0f None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:49.356408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55476107-c9a5-4c36-bb1c-b09569f83206 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:49.394081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6659361-6be7-4032-aa69-96b16e423eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:49.395173 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6659361-6be7-4032-aa69-96b16e423eb1 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:49.395776 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6659361-6be7-4032-aa69-96b16e423eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:49.396299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6659361-6be7-4032-aa69-96b16e423eb1 None admin] PATH_INFO: `/v3/services/network` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:49.397129 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6659361-6be7-4032-aa69-96b16e423eb1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:49.398836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6659361-6be7-4032-aa69-96b16e423eb1 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:49.411631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-d6659361-6be7-4032-aa69-96b16e423eb1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 03:42:49.411631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:49.411631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:42:49.411631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:42:49.411631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:42:49.411631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:42:49.411631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:42:49.411631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:42:49.411631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 03:42:49.411631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:49.411631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:42:49.411631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:49.411631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:49.411631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:49.411631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:49.411631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:49.411631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:49.412685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:49.412685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:49.412685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:49.412685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:49.412685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:49.412685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:49.412685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:42:49.412685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:42:49.412685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:42:49.412685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:42:49.412685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:49.412685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:49.412685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:49.412685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:49.412685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:49.412685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:49.413553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:49.413553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:49.413553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:49.413553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:49.413553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:49.413553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:49.413553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:49.413553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:49.413553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:49.413553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:49.413553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:42:49.413553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:42:49.413553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 03:42:49.413553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:49.421203 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9eb1c-358d-4b01-b90a-0e58c7d7ab0f None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:49.422162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 355/712] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:49 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:49.423487 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6659361-6be7-4032-aa69-96b16e423eb1 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:49.464494 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791e86f-5f5a-4c7e-9099-804ffa879ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:49.465488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791e86f-5f5a-4c7e-9099-804ffa879ae8 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:49.466058 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791e86f-5f5a-4c7e-9099-804ffa879ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:49.467282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791e86f-5f5a-4c7e-9099-804ffa879ae8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:49.468355 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791e86f-5f5a-4c7e-9099-804ffa879ae8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:49.472356 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791e86f-5f5a-4c7e-9099-804ffa879ae8 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:49.474106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:49.486195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-f791e86f-5f5a-4c7e-9099-804ffa879ae8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 03:42:49.486195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:49.486195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:42:49.486195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:42:49.486195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:42:49.486195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:42:49.486195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:42:49.486195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:42:49.486195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 03:42:49.486195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:49.486195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:42:49.486195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:49.486195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:49.486195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:49.486195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:49.486195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:49.487181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:49.487181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:49.487181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:49.487181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:49.487181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:49.487181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:49.487181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:49.487181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:42:49.487181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:42:49.487181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:42:49.487181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:42:49.487181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:49.487181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:49.487181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:49.487181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:49.487181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:49.488042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:49.488042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:49.488042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:49.488042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:49.488042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:49.488042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:49.488042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:49.488042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:49.488042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:49.488042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:49.488042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:49.488042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:42:49.488042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:42:49.488042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 03:42:49.488042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:49.491096 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 358/713] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Jul 28 03:42:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:49.492164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791e86f-5f5a-4c7e-9099-804ffa879ae8 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:49.524125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:49.558042 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6659361-6be7-4032-aa69-96b16e423eb1 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:49.605554 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc02283-2a7a-4a40-9368-6ac461564e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:49.606553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc02283-2a7a-4a40-9368-6ac461564e1e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:49.607092 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc02283-2a7a-4a40-9368-6ac461564e1e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:49.607626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc02283-2a7a-4a40-9368-6ac461564e1e None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:49.608653 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc02283-2a7a-4a40-9368-6ac461564e1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:49.609866 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc02283-2a7a-4a40-9368-6ac461564e1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:49.611668 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc02283-2a7a-4a40-9368-6ac461564e1e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:49.624786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791e86f-5f5a-4c7e-9099-804ffa879ae8 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:49.625960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 356/714] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:42:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:49.626995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc02283-2a7a-4a40-9368-6ac461564e1e None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:49.670090 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1e228-04b2-4c81-8dcb-cf07fa1fe40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:49.671083 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1e228-04b2-4c81-8dcb-cf07fa1fe40a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:49.672232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1e228-04b2-4c81-8dcb-cf07fa1fe40a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:49.672881 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1e228-04b2-4c81-8dcb-cf07fa1fe40a None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:49.673774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1e228-04b2-4c81-8dcb-cf07fa1fe40a None admin] RBAC: Adding query filter params (name=network) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:49.674278 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1e228-04b2-4c81-8dcb-cf07fa1fe40a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:49.676133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1e228-04b2-4c81-8dcb-cf07fa1fe40a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:49.685971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 359/715] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 28 03:42:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:49.687260 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1e228-04b2-4c81-8dcb-cf07fa1fe40a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:49.758595 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:49.766552 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc02283-2a7a-4a40-9368-6ac461564e1e None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:49.787878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:49.808002 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1e228-04b2-4c81-8dcb-cf07fa1fe40a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:49.818581 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02b624-beb4-4941-b9bc-a68db8441544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:49.819584 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02b624-beb4-4941-b9bc-a68db8441544 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:49.819880 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02b624-beb4-4941-b9bc-a68db8441544 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:49.820158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02b624-beb4-4941-b9bc-a68db8441544 None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:49.821159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02b624-beb4-4941-b9bc-a68db8441544 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:49.821458 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02b624-beb4-4941-b9bc-a68db8441544 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:49.823493 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02b624-beb4-4941-b9bc-a68db8441544 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:49.831512 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 357/716] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 28 03:42:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:49.832606 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02b624-beb4-4941-b9bc-a68db8441544 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:49.860572 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad72f0-8d40-440b-a2e4-00c755162603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:49.861193 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad72f0-8d40-440b-a2e4-00c755162603 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:49.861475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad72f0-8d40-440b-a2e4-00c755162603 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:49.861755 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad72f0-8d40-440b-a2e4-00c755162603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:49.862570 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad72f0-8d40-440b-a2e4-00c755162603 None admin] RBAC: Adding query filter params (role.id=183fd05fe14a41828222fd09b6280796, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=382ff6087bf4486d8651162880825eb2) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:49.862883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad72f0-8d40-440b-a2e4-00c755162603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:49.864343 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad72f0-8d40-440b-a2e4-00c755162603 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:49.879769 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 360/717] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:42:49 2022] GET /identity/v3/role_assignments?user.id=382ff6087bf4486d8651162880825eb2&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=183fd05fe14a41828222fd09b6280796 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:49.881112 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad72f0-8d40-440b-a2e4-00c755162603 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:49.951451 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02b624-beb4-4941-b9bc-a68db8441544 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:50.000928 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f059490-b409-4351-a799-699a0f1f88a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:50.002070 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f059490-b409-4351-a799-699a0f1f88a3 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:50.004487 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f059490-b409-4351-a799-699a0f1f88a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:50.005133 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f059490-b409-4351-a799-699a0f1f88a3 None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:50.006386 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f059490-b409-4351-a799-699a0f1f88a3 None admin] RBAC: Adding query filter params (type=network) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:50.007704 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f059490-b409-4351-a799-699a0f1f88a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:50.011517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f059490-b409-4351-a799-699a0f1f88a3 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:50.031773 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 358/718] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 28 03:42:49 2022] GET /identity/v3/services?type=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:50.072174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad72f0-8d40-440b-a2e4-00c755162603 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:50.130791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa809f4-cbab-4269-85b3-c6075e40f43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:50.131811 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa809f4-cbab-4269-85b3-c6075e40f43e None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:50.132326 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa809f4-cbab-4269-85b3-c6075e40f43e None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:50.132809 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa809f4-cbab-4269-85b3-c6075e40f43e None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:50.133740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa809f4-cbab-4269-85b3-c6075e40f43e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:50.134318 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa809f4-cbab-4269-85b3-c6075e40f43e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:50.136003 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa809f4-cbab-4269-85b3-c6075e40f43e None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:50.144182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 361/719] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 28 03:42:49 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:51.037636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf0a0f-873f-4ed3-bdc5-6c734070ba74 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:51.038690 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf0a0f-873f-4ed3-bdc5-6c734070ba74 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:51.039184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf0a0f-873f-4ed3-bdc5-6c734070ba74 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:51.041081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 359/720] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:51.047360 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f19148-07ac-4159-a0b7-2363f19b4013 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:51.047783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f19148-07ac-4159-a0b7-2363f19b4013 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:51.048074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f19148-07ac-4159-a0b7-2363f19b4013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:51.076440 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-00f19148-07ac-4159-a0b7-2363f19b4013 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:51.078321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-00f19148-07ac-4159-a0b7-2363f19b4013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:51.082642 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:51.173807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 362/721] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:51.218494 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf0a0f-873f-4ed3-bdc5-6c734070ba74 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:51.234375 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bfd6e-daae-40c8-b25f-dacce3772f2c None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:51.234696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bfd6e-daae-40c8-b25f-dacce3772f2c None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:51.234976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bfd6e-daae-40c8-b25f-dacce3772f2c None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:51.236520 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 363/722] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:42:51.242186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df00ad3-c6c3-4147-9a0f-a8ecce076066 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:51.242481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df00ad3-c6c3-4147-9a0f-a8ecce076066 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:51.242762 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df00ad3-c6c3-4147-9a0f-a8ecce076066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:51.267561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:51.274581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-9df00ad3-c6c3-4147-9a0f-a8ecce076066 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:51.275792 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9df00ad3-c6c3-4147-9a0f-a8ecce076066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:51.395986 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf0a0f-873f-4ed3-bdc5-6c734070ba74 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:51.404627 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 364/723] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:51.423286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df00ad3-c6c3-4147-9a0f-a8ecce076066 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:51.457329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8a82f-517f-41c6-9084-226475542c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:51.458005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8a82f-517f-41c6-9084-226475542c2a None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:51.458327 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8a82f-517f-41c6-9084-226475542c2a None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:51.458676 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8a82f-517f-41c6-9084-226475542c2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:51.479268 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8a82f-517f-41c6-9084-226475542c2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:51.485063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-38a8a82f-517f-41c6-9084-226475542c2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:51.485063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:51.485063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:51.485063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:51.485063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:51.485063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:51.485063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:51.485063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:51.485063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:51.485063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:51.485063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:51.485063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:51.485063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:51.485063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:51.485063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:51.485063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:51.486034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:51.486034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:51.486034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:51.486034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:51.486034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:51.486034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:51.486034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:51.486034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:51.486034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:51.486034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:51.486034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:51.486034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:51.486034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:51.486034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:51.486034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:51.486034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:51.486900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:51.486900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:51.486900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:51.486900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:51.486900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:51.486900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:51.486900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:51.486900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:51.486900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:51.486900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:51.486900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:51.486900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:51.496909 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 360/724] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:42:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:51.501040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8a82f-517f-41c6-9084-226475542c2a None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:51.612867 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8a82f-517f-41c6-9084-226475542c2a None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:51.625411 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:51.656357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:51.691353 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df00ad3-c6c3-4147-9a0f-a8ecce076066 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:51.692016 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b3ebb-5637-451f-9bde-f63f4a1e3513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:51.692666 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b3ebb-5637-451f-9bde-f63f4a1e3513 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:51.693092 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b3ebb-5637-451f-9bde-f63f4a1e3513 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:51.693378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b3ebb-5637-451f-9bde-f63f4a1e3513 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:51.694157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b3ebb-5637-451f-9bde-f63f4a1e3513 None admin] RBAC: Adding query filter params (name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:51.694472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b3ebb-5637-451f-9bde-f63f4a1e3513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:51.695891 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b3ebb-5637-451f-9bde-f63f4a1e3513 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:51.721709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 361/725] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:42:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:51.732265 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b3ebb-5637-451f-9bde-f63f4a1e3513 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:51.733630 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8d58d-28ea-4757-bae4-287fdc570405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:51.734391 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8d58d-28ea-4757-bae4-287fdc570405 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:51.734747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8d58d-28ea-4757-bae4-287fdc570405 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:51.735073 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8d58d-28ea-4757-bae4-287fdc570405 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:51.746350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8d58d-28ea-4757-bae4-287fdc570405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:51.755730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-27f8d58d-28ea-4757-bae4-287fdc570405 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:42:51.755730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:51.755730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:51.755730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:51.755730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:51.755730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:51.755730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:51.755730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:51.755730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:51.755730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:51.755730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:51.755730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:51.755730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:51.755730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:51.755730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:51.755730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:51.756963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:51.756963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:51.756963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:51.756963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:51.756963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:51.756963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:51.756963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:51.756963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:51.756963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:51.756963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:51.756963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:51.756963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:51.756963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:51.756963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:51.756963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:51.756963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:51.757975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:51.757975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:51.757975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:51.757975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:51.757975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:51.757975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:51.757975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:51.757975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:51.757975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:51.757975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:51.757975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:42:51.757975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:51.757975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 365/726] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:42:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:42:51.760596 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8d58d-28ea-4757-bae4-287fdc570405 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:51.929054 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8d58d-28ea-4757-bae4-287fdc570405 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:51.986320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b3ebb-5637-451f-9bde-f63f4a1e3513 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:51.995699 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:52.009202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e10e3-4ec3-466d-bb6b-f293bce30bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:52.013703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e10e3-4ec3-466d-bb6b-f293bce30bcc None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:52.013703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e10e3-4ec3-466d-bb6b-f293bce30bcc None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:52.013703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e10e3-4ec3-466d-bb6b-f293bce30bcc None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:52.013703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e10e3-4ec3-466d-bb6b-f293bce30bcc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:52.013703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e10e3-4ec3-466d-bb6b-f293bce30bcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:52.013703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e10e3-4ec3-466d-bb6b-f293bce30bcc None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:52.027353 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 366/727] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:52.033734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e10e3-4ec3-466d-bb6b-f293bce30bcc None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:52.077023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79f863-eb70-4899-9e9a-e61ab09ea1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:52.078330 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79f863-eb70-4899-9e9a-e61ab09ea1ea None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:52.078558 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79f863-eb70-4899-9e9a-e61ab09ea1ea None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:52.078840 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79f863-eb70-4899-9e9a-e61ab09ea1ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:52.166898 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e10e3-4ec3-466d-bb6b-f293bce30bcc None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:52.244173 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3bdbd-072d-4a32-85e1-e0479fd9e1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:52.245151 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3bdbd-072d-4a32-85e1-e0479fd9e1b8 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:52.245675 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3bdbd-072d-4a32-85e1-e0479fd9e1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:52.246126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3bdbd-072d-4a32-85e1-e0479fd9e1b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:52.256489 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79f863-eb70-4899-9e9a-e61ab09ea1ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:52.258022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79f863-eb70-4899-9e9a-e61ab09ea1ea None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:52.259393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3bdbd-072d-4a32-85e1-e0479fd9e1b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:52.261141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3bdbd-072d-4a32-85e1-e0479fd9e1b8 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:52.277452 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:52.281593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-efd3bdbd-072d-4a32-85e1-e0479fd9e1b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:52.281593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:52.281593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:52.281593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:52.281593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:52.281593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:52.281593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:52.281593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:52.281593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:52.281593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:52.281593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:52.281593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:52.281593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:52.281593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:52.281593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:52.282473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:52.282473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:52.282473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:52.282473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:52.282473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:52.282473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:52.282473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:52.282473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:52.282473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:52.282473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:52.282473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:52.282473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:52.282473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:52.282473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:52.282473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:52.282473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:52.282473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:52.283339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:52.283339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:52.283339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:52.283339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:52.285343 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 367/728] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:52.290580 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3bdbd-072d-4a32-85e1-e0479fd9e1b8 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:52.299350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-ba79f863-eb70-4899-9e9a-e61ab09ea1ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:52.299350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:52.299350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:52.299350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:52.299350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:52.299350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:52.299350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:52.299350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:52.299350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:52.299350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:52.299350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:52.299350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:52.299350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:52.299350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:52.299350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:52.305420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:52.305420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:52.305420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:52.305420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:52.305420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:52.305420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:52.305420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:52.305420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:52.305420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:52.305420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:52.305420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:52.305420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:52.305420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:52.305420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:52.305420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:52.305420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:52.305420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:52.306315 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:52.306315 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:52.306315 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:52.306315 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:52.306315 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 362/729] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 562 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:52.306315 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79f863-eb70-4899-9e9a-e61ab09ea1ea None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:52.387717 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:52.462390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3bdbd-072d-4a32-85e1-e0479fd9e1b8 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:52.507432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1a464-47e4-43b3-a0d6-87f3a7129e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:52.507432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a464-47e4-43b3-a0d6-87f3a7129e20 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:52.507432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a464-47e4-43b3-a0d6-87f3a7129e20 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:52.507432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a464-47e4-43b3-a0d6-87f3a7129e20 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:52.507829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1a464-47e4-43b3-a0d6-87f3a7129e20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:52.507829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1a464-47e4-43b3-a0d6-87f3a7129e20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:52.507829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1a464-47e4-43b3-a0d6-87f3a7129e20 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:52.519395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 368/730] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:52.524624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1a464-47e4-43b3-a0d6-87f3a7129e20 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:52.536392 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79f863-eb70-4899-9e9a-e61ab09ea1ea None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:52.574196 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d8ee0-522b-4bcf-947f-ade432599097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:52.574825 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d8ee0-522b-4bcf-947f-ade432599097 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:52.575104 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d8ee0-522b-4bcf-947f-ade432599097 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:52.575408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d8ee0-522b-4bcf-947f-ade432599097 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:52.576109 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d8ee0-522b-4bcf-947f-ade432599097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:52.576414 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d8ee0-522b-4bcf-947f-ade432599097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:52.578040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d8ee0-522b-4bcf-947f-ade432599097 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:52.591501 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 363/731] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:52.592896 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3cbf0-c77a-4387-8860-a5e568db9f9b None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:52.594837 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3cbf0-c77a-4387-8860-a5e568db9f9b None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:52.594837 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3cbf0-c77a-4387-8860-a5e568db9f9b None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:52.598908 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 364/732] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:52.600241 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a7428-cb1e-49b9-93d6-4279b5e2c48d None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:52.600530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a7428-cb1e-49b9-93d6-4279b5e2c48d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:52.600812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a7428-cb1e-49b9-93d6-4279b5e2c48d None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:52.602077 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 365/733] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:52.603107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afc376-c83d-47b7-93b1-862e7529fcb1 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:52.603463 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afc376-c83d-47b7-93b1-862e7529fcb1 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:52.603753 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afc376-c83d-47b7-93b1-862e7529fcb1 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:52.604943 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 366/734] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:52.608114 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afc376-c83d-47b7-93b1-862e7529fcb1 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:52.643307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1a464-47e4-43b3-a0d6-87f3a7129e20 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:52.645775 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:52.670396 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:52.678125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a85389-8d29-42e4-b829-93bfaffa7ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:52.678761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a85389-8d29-42e4-b829-93bfaffa7ab7 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:52.679040 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a85389-8d29-42e4-b829-93bfaffa7ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:52.679312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a85389-8d29-42e4-b829-93bfaffa7ab7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:52.686276 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a85389-8d29-42e4-b829-93bfaffa7ab7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:52.688878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a85389-8d29-42e4-b829-93bfaffa7ab7 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:52.700721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-57a85389-8d29-42e4-b829-93bfaffa7ab7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:42:52.700721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:52.700721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:52.700721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:52.700721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:52.700721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:52.700721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:52.700721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:52.700721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:52.700721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:52.700721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:52.700721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:52.700721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:52.700721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:52.700721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:52.700721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:52.701911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:52.701911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:52.701911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:52.701911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:52.701911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:52.701911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:52.701911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:52.701911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:52.701911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:52.701911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:52.701911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:52.701911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:52.701911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:52.701911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:52.701911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:52.701911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:52.701911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:52.701911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:52.703615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:52.703615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:52.703615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:52.703615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:52.703615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:52.703615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:52.703615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:52.703615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:52.703615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:42:52.703615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:52.705853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 369/735] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 28 03:42:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:42:52.707732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fff6b-4cbe-4640-b099-a64299907391 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:52.708699 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fff6b-4cbe-4640-b099-a64299907391 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:52.708699 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fff6b-4cbe-4640-b099-a64299907391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:52.714467 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afc376-c83d-47b7-93b1-862e7529fcb1 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:52.727842 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-e29fff6b-4cbe-4640-b099-a64299907391 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:52.729038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e29fff6b-4cbe-4640-b099-a64299907391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:52.750213 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f0e16-67a3-4505-bba8-36b523d4e81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:52.750874 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f0e16-67a3-4505-bba8-36b523d4e81f None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:52.751135 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f0e16-67a3-4505-bba8-36b523d4e81f None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:52.751431 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f0e16-67a3-4505-bba8-36b523d4e81f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:52.758385 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f0e16-67a3-4505-bba8-36b523d4e81f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:52.759808 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f0e16-67a3-4505-bba8-36b523d4e81f None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:52.771036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-760f0e16-67a3-4505-bba8-36b523d4e81f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 03:42:52.771036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:52.771036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:52.771036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:52.771036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:52.771036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:52.771036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:52.771036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:52.771036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:52.771036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:52.771036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:52.771036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:52.771036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:52.771036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:52.771036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:52.771036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:52.772038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:52.772038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:52.772038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:52.772038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:52.772038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:52.772038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:52.772038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:52.772038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:52.772038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:52.772038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:52.772038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:52.772038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:52.772038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:52.772038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:52.772038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:52.772038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:52.772038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:52.772038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:52.772981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:52.772981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:52.772981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:52.772981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:52.772981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:52.772981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:52.772981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:52.772981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:52.772981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 03:42:52.772981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:52.772981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 367/736] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 28 03:42:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:52.773572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03daf4ec-e15e-49d6-8eea-079dd3c6d4ba None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:52.773998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03daf4ec-e15e-49d6-8eea-079dd3c6d4ba None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:52.773998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03daf4ec-e15e-49d6-8eea-079dd3c6d4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:52.798812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-03daf4ec-e15e-49d6-8eea-079dd3c6d4ba None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:52.800075 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-03daf4ec-e15e-49d6-8eea-079dd3c6d4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:52.897578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 368/737] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:52.898847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df031a-4828-465b-8c72-8c91d95c481d None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:52.899209 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df031a-4828-465b-8c72-8c91d95c481d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:52.899491 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df031a-4828-465b-8c72-8c91d95c481d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:52.920621 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 370/738] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:52.920621 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fff6b-4cbe-4640-b099-a64299907391 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:52.922051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-57df031a-4828-465b-8c72-8c91d95c481d None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:52.923089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-57df031a-4828-465b-8c72-8c91d95c481d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:52.977072 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:52.997339 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 369/739] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:52.998165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df031a-4828-465b-8c72-8c91d95c481d None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:53.013797 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:53.021838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fff6b-4cbe-4640-b099-a64299907391 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:53.056197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb840600-6850-498d-8707-fcb1b92d8456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:53.056812 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb840600-6850-498d-8707-fcb1b92d8456 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:53.057102 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb840600-6850-498d-8707-fcb1b92d8456 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:53.057374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb840600-6850-498d-8707-fcb1b92d8456 None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:53.058173 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb840600-6850-498d-8707-fcb1b92d8456 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:53.058481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb840600-6850-498d-8707-fcb1b92d8456 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:53.059956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb840600-6850-498d-8707-fcb1b92d8456 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:53.078329 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 371/740] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 28 03:42:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:53.079167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb840600-6850-498d-8707-fcb1b92d8456 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:53.101431 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df031a-4828-465b-8c72-8c91d95c481d None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:53.135780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653396b8-5f88-4f12-a3e7-8269ccc09f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:53.136532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653396b8-5f88-4f12-a3e7-8269ccc09f2a None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:53.136812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653396b8-5f88-4f12-a3e7-8269ccc09f2a None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:53.137078 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653396b8-5f88-4f12-a3e7-8269ccc09f2a None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:53.137860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653396b8-5f88-4f12-a3e7-8269ccc09f2a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:53.138157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653396b8-5f88-4f12-a3e7-8269ccc09f2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:53.139602 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653396b8-5f88-4f12-a3e7-8269ccc09f2a None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:53.162458 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 370/741] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 28 03:42:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:53.162458 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653396b8-5f88-4f12-a3e7-8269ccc09f2a None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:53.180299 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb840600-6850-498d-8707-fcb1b92d8456 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:53.197185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:53.213574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb88697-c76a-4d27-ae7f-4d4a81e5759a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:53.214211 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb88697-c76a-4d27-ae7f-4d4a81e5759a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:53.214496 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb88697-c76a-4d27-ae7f-4d4a81e5759a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:53.214773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb88697-c76a-4d27-ae7f-4d4a81e5759a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:53.225361 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb88697-c76a-4d27-ae7f-4d4a81e5759a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:53.230696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-cdb88697-c76a-4d27-ae7f-4d4a81e5759a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:42:53.230696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:53.230696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:53.230696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:53.230696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:53.230696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:53.230696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:53.230696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:53.230696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:53.230696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:53.230696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:53.230696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:53.230696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:53.230696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:53.230696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:53.230696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:53.231764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:53.231764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:53.231764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:53.231764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:53.231764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:53.231764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:53.231764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:53.231764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:53.231764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:53.231764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:53.231764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:53.231764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:53.231764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:53.231764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:53.231764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:53.231764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:53.232799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:53.232799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:53.232799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:53.232799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:53.232799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:53.232799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:53.232799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:53.232799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:53.232799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:53.232799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:53.232799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:42:53.232799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:53.232799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 372/742] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:42:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:53.234073 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb88697-c76a-4d27-ae7f-4d4a81e5759a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:53.253357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:53.262228 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653396b8-5f88-4f12-a3e7-8269ccc09f2a None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:53.297062 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434c2b2-5580-4129-bf85-29928c9b35fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:53.297689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434c2b2-5580-4129-bf85-29928c9b35fb None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:53.297970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434c2b2-5580-4129-bf85-29928c9b35fb None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:53.298238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434c2b2-5580-4129-bf85-29928c9b35fb None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:53.299042 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434c2b2-5580-4129-bf85-29928c9b35fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:53.300408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434c2b2-5580-4129-bf85-29928c9b35fb None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:53.341736 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb88697-c76a-4d27-ae7f-4d4a81e5759a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:53.375314 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce232d-eeae-449c-87b5-2c4ddc15d534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:53.376053 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce232d-eeae-449c-87b5-2c4ddc15d534 None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:53.376331 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce232d-eeae-449c-87b5-2c4ddc15d534 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:53.376604 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce232d-eeae-449c-87b5-2c4ddc15d534 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:53.377289 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce232d-eeae-449c-87b5-2c4ddc15d534 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:53.378656 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce232d-eeae-449c-87b5-2c4ddc15d534 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:53.402634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 371/743] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 28 03:42:53 2022] POST /identity/v3/services => generated 240 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:42:53.403591 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434c2b2-5580-4129-bf85-29928c9b35fb None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:53.471554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 373/744] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 28 03:42:53 2022] POST /identity/v3/services => generated 251 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:42:53.472615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce232d-eeae-449c-87b5-2c4ddc15d534 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:53.534153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:53.552308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434c2b2-5580-4129-bf85-29928c9b35fb None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:53.592506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:53.606224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7039549-b186-441b-8ce2-e21b3261981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:53.607747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7039549-b186-441b-8ce2-e21b3261981e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:53.608537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7039549-b186-441b-8ce2-e21b3261981e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:53.609873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7039549-b186-441b-8ce2-e21b3261981e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:53.622740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7039549-b186-441b-8ce2-e21b3261981e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:53.624840 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7039549-b186-441b-8ce2-e21b3261981e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:53.635662 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce232d-eeae-449c-87b5-2c4ddc15d534 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:53.646227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-a7039549-b186-441b-8ce2-e21b3261981e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:53.646227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:53.646227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:53.646227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:53.646227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:53.646227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:53.646227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:53.646227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:53.646227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:53.646227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:53.646227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:53.646227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:53.646227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:53.646227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:53.646227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:53.647145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:53.647145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:53.647145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:53.647145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:53.647145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:53.647145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:53.647145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:53.647145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:53.647145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:53.647145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:53.647145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:53.647145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:53.647145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:53.647145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:53.647145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:53.647145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:53.647145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:53.648731 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:53.648731 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:53.648731 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:53.648731 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:53.648731 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 372/745] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:53.648731 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7039549-b186-441b-8ce2-e21b3261981e None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:53.680867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d21d9e-289c-4faa-aaa6-4fa0e2d488c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:53.681826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d21d9e-289c-4faa-aaa6-4fa0e2d488c2 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:53.682130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d21d9e-289c-4faa-aaa6-4fa0e2d488c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:53.682374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d21d9e-289c-4faa-aaa6-4fa0e2d488c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:53.772978 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d21d9e-289c-4faa-aaa6-4fa0e2d488c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:53.774449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d21d9e-289c-4faa-aaa6-4fa0e2d488c2 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:53.791363 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7039549-b186-441b-8ce2-e21b3261981e None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:53.839498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f12568-d10f-4549-8204-cefd6169d277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:53.840191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f12568-d10f-4549-8204-cefd6169d277 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:53.840574 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f12568-d10f-4549-8204-cefd6169d277 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:53.840946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f12568-d10f-4549-8204-cefd6169d277 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:53.841960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f12568-d10f-4549-8204-cefd6169d277 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:53.842363 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f12568-d10f-4549-8204-cefd6169d277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:53.844515 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f12568-d10f-4549-8204-cefd6169d277 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:53.856999 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 373/746] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:53.858036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f12568-d10f-4549-8204-cefd6169d277 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:53.859679 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:53.863142 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:53.887703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 374/747] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:42:53.888861 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d21d9e-289c-4faa-aaa6-4fa0e2d488c2 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:53.989112 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f12568-d10f-4549-8204-cefd6169d277 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:54.021113 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d21d9e-289c-4faa-aaa6-4fa0e2d488c2 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:54.025761 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e9d5a-6116-405c-84b3-addcffc842a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:54.026490 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e9d5a-6116-405c-84b3-addcffc842a7 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:54.026869 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e9d5a-6116-405c-84b3-addcffc842a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:54.027242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e9d5a-6116-405c-84b3-addcffc842a7 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:54.028074 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e9d5a-6116-405c-84b3-addcffc842a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:54.028479 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e9d5a-6116-405c-84b3-addcffc842a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:54.030211 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e9d5a-6116-405c-84b3-addcffc842a7 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:54.045535 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 374/748] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:54.046639 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e9d5a-6116-405c-84b3-addcffc842a7 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:54.074683 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7ba2f-cadf-4bdc-812d-428a510966b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:54.075535 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7ba2f-cadf-4bdc-812d-428a510966b7 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:54.075918 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7ba2f-cadf-4bdc-812d-428a510966b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:54.076292 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7ba2f-cadf-4bdc-812d-428a510966b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:54.086940 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7ba2f-cadf-4bdc-812d-428a510966b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:54.088553 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7ba2f-cadf-4bdc-812d-428a510966b7 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:54.104393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-0cb7ba2f-cadf-4bdc-812d-428a510966b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:54.104393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:54.104393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:54.104393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:54.104393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:54.104393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:54.104393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:54.104393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:54.104393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:54.104393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:54.104393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:54.104393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:54.104393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:54.104393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:54.104393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:54.105506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:54.105506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:54.105506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:54.105506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:54.105506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:54.105506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:54.105506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:54.105506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:54.105506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:54.105506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:54.105506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:54.105506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:54.105506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:54.105506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:54.105506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:54.105506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:54.105506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:54.106463 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:54.106463 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:54.106463 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:54.106463 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:54.112107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 375/749] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:54.113103 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7ba2f-cadf-4bdc-812d-428a510966b7 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:54.126743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:54.159790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:54.178997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e9d5a-6116-405c-84b3-addcffc842a7 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:54.221740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7ba2f-cadf-4bdc-812d-428a510966b7 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:54.226020 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9211f-63cb-438b-8031-1ae6e07239b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:54.226863 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9211f-63cb-438b-8031-1ae6e07239b8 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:54.227293 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9211f-63cb-438b-8031-1ae6e07239b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:54.227729 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9211f-63cb-438b-8031-1ae6e07239b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:54.242408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9211f-63cb-438b-8031-1ae6e07239b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:54.244159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9211f-63cb-438b-8031-1ae6e07239b8 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:54.261740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-9da9211f-63cb-438b-8031-1ae6e07239b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:54.261740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:54.261740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:54.261740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:54.261740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:54.261740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:54.261740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:54.261740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:54.261740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:54.261740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:54.261740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:54.261740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:54.261740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:54.261740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:54.261740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:54.262856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:54.262856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:54.262856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:54.262856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:54.262856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:54.262856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:54.262856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:54.262856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:54.262856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:54.262856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:54.262856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:54.262856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:54.262856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:54.262856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:54.262856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:54.262856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:54.262856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:54.263891 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:54.263891 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:54.263891 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:54.263891 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:54.264720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 375/750] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:54.265649 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9211f-63cb-438b-8031-1ae6e07239b8 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:54.266910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f619c97-5ff9-4980-b356-d3ad16897d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:54.267792 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f619c97-5ff9-4980-b356-d3ad16897d6a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:54.268257 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f619c97-5ff9-4980-b356-d3ad16897d6a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:54.269019 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f619c97-5ff9-4980-b356-d3ad16897d6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:54.279493 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f619c97-5ff9-4980-b356-d3ad16897d6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:54.282199 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f619c97-5ff9-4980-b356-d3ad16897d6a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:54.298538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-9f619c97-5ff9-4980-b356-d3ad16897d6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:54.298538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:54.298538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:54.298538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:54.298538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:54.298538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:54.298538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:54.298538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:54.298538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:54.298538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:54.298538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:54.298538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:54.298538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:42:54.298538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:42:54.298538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:42:54.299620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:42:54.299620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:54.299620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:54.299620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:54.299620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:54.299620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:54.299620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:54.299620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:54.299620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:54.299620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:54.299620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:54.299620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:54.299620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:54.299620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:54.299620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:54.299620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:54.299620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:54.300486 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:42:54.300486 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:42:54.300486 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:42:54.300486 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:42:54.300486 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:42:54.300486 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:42:54.300486 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:54.300486 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:54.301496 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 376/751] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:54.301764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f619c97-5ff9-4980-b356-d3ad16897d6a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:54.402002 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9211f-63cb-438b-8031-1ae6e07239b8 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:54.410893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:54.419809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:54.432852 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f619c97-5ff9-4980-b356-d3ad16897d6a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:54.438592 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47a198-d435-4396-895a-bf26f71fcaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:54.439463 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47a198-d435-4396-895a-bf26f71fcaf2 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:54.439861 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47a198-d435-4396-895a-bf26f71fcaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:54.440234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47a198-d435-4396-895a-bf26f71fcaf2 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:54.441056 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47a198-d435-4396-895a-bf26f71fcaf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:54.441459 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47a198-d435-4396-895a-bf26f71fcaf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:54.442925 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47a198-d435-4396-895a-bf26f71fcaf2 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:54.459398 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 376/752] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:54.460561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47a198-d435-4396-895a-bf26f71fcaf2 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:54.478104 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50ac31-b896-4cfa-bab3-4a70f4fc1e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:54.478876 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50ac31-b896-4cfa-bab3-4a70f4fc1e05 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:54.479493 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50ac31-b896-4cfa-bab3-4a70f4fc1e05 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:54.479610 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50ac31-b896-4cfa-bab3-4a70f4fc1e05 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:54.480483 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50ac31-b896-4cfa-bab3-4a70f4fc1e05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:54.480829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50ac31-b896-4cfa-bab3-4a70f4fc1e05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:54.482258 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50ac31-b896-4cfa-bab3-4a70f4fc1e05 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:54.495725 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 377/753] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:54.496727 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50ac31-b896-4cfa-bab3-4a70f4fc1e05 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:54.588628 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47a198-d435-4396-895a-bf26f71fcaf2 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:54.617121 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50ac31-b896-4cfa-bab3-4a70f4fc1e05 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:54.627099 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89743f7a-27a5-4142-a02b-77f86ef05d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:54.627905 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89743f7a-27a5-4142-a02b-77f86ef05d5d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:54.628280 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89743f7a-27a5-4142-a02b-77f86ef05d5d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:54.628650 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89743f7a-27a5-4142-a02b-77f86ef05d5d None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:54.629503 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89743f7a-27a5-4142-a02b-77f86ef05d5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:54.629911 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89743f7a-27a5-4142-a02b-77f86ef05d5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:54.631493 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89743f7a-27a5-4142-a02b-77f86ef05d5d None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:54.643844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 377/754] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:42:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:54.645122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89743f7a-27a5-4142-a02b-77f86ef05d5d None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:54.659258 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6294d1-6271-427d-9528-0ba29a83d35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:54.659874 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6294d1-6271-427d-9528-0ba29a83d35c None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:54.660161 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6294d1-6271-427d-9528-0ba29a83d35c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:54.660441 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6294d1-6271-427d-9528-0ba29a83d35c None admin] PATH_INFO: `/v3/users/swift` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:54.668053 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6294d1-6271-427d-9528-0ba29a83d35c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:54.669518 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6294d1-6271-427d-9528-0ba29a83d35c None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:54.685587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-2b6294d1-6271-427d-9528-0ba29a83d35c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 03:42:54.685587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:54.685587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:54.685587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:54.685587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:54.685587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:54.685587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:54.685587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:54.685587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:54.685587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:54.685587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:54.685587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:54.685587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:54.685587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:54.685587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:54.685587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:54.686808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:54.686808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:54.686808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:54.686808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:54.686808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:54.686808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:54.686808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:54.686808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:54.686808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:54.686808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:54.686808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:54.686808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:54.686808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:54.686808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:54.686808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:54.686808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:54.686808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:54.686808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:54.688673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:54.688673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:54.688673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:54.688673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:54.688673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:54.688673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:54.688673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:54.688673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:54.688673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 03:42:54.688673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:54.688673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 378/755] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:42:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:54.689329 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6294d1-6271-427d-9528-0ba29a83d35c None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:54.689859 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:54.723708 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:54.777844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89743f7a-27a5-4142-a02b-77f86ef05d5d None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:54.815103 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6294d1-6271-427d-9528-0ba29a83d35c None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:54.822360 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5fb33-dcac-4696-b03e-2a8f76bd6d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:54.823025 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5fb33-dcac-4696-b03e-2a8f76bd6d72 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:54.823308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5fb33-dcac-4696-b03e-2a8f76bd6d72 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:54.823630 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5fb33-dcac-4696-b03e-2a8f76bd6d72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:54.831145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5fb33-dcac-4696-b03e-2a8f76bd6d72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:54.832621 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5fb33-dcac-4696-b03e-2a8f76bd6d72 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:54.846009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-dde5fb33-dcac-4696-b03e-2a8f76bd6d72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:54.846009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:54.846009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:54.846009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:54.846009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:54.846009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:54.846009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:54.846009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:54.846009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:54.846009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:54.846009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:54.846009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:54.846009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:42:54.846009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:42:54.846009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:42:54.848069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:42:54.848069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:54.848069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:54.848069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:54.848069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:54.848069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:54.848069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:54.848069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:54.848069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:54.848069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:54.848069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:54.848069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:54.848069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:54.848069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:54.848069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:54.848069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:54.848069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:54.850498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:42:54.850498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:42:54.850498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:42:54.850498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:42:54.850498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:42:54.850498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:42:54.850498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:54.850498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:54.853238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 378/756] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:54.853400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80879da0-f873-49e5-ad29-ceb88068b902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:54.853570 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5fb33-dcac-4696-b03e-2a8f76bd6d72 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:54.853717 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80879da0-f873-49e5-ad29-ceb88068b902 None admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:54.853717 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80879da0-f873-49e5-ad29-ceb88068b902 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:54.853717 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80879da0-f873-49e5-ad29-ceb88068b902 None admin] PATH_INFO: `/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/5133abf4c32a45b0b2188f71496c572b/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:54.859362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80879da0-f873-49e5-ad29-ceb88068b902 None admin] RBAC: Authorizing `identity:create_grant(project_id=28b7995e83524b9293d1c6fc319e5a85, user_id=5133abf4c32a45b0b2188f71496c572b, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:54.859362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80879da0-f873-49e5-ad29-ceb88068b902 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:54.951504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 379/757] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:42:54 2022] PUT /identity/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/5133abf4c32a45b0b2188f71496c572b/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:42:54.952382 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80879da0-f873-49e5-ad29-ceb88068b902 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:54.964564 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:54.973846 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5fb33-dcac-4696-b03e-2a8f76bd6d72 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:55.045203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4fe8f-09a1-4344-9307-52bda3fc4cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:55.045915 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4fe8f-09a1-4344-9307-52bda3fc4cf7 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:55.046253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4fe8f-09a1-4344-9307-52bda3fc4cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:55.047075 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4fe8f-09a1-4344-9307-52bda3fc4cf7 None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:55.048079 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4fe8f-09a1-4344-9307-52bda3fc4cf7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:55.048390 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4fe8f-09a1-4344-9307-52bda3fc4cf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:55.049862 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4fe8f-09a1-4344-9307-52bda3fc4cf7 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:55.088375 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 379/758] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 28 03:42:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:55.092552 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4fe8f-09a1-4344-9307-52bda3fc4cf7 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:55.103864 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:55.162077 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80879da0-f873-49e5-ad29-ceb88068b902 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:55.226701 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d0e66-f0da-4c4b-8e37-b8995ae26e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:55.227358 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d0e66-f0da-4c4b-8e37-b8995ae26e52 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:55.227645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d0e66-f0da-4c4b-8e37-b8995ae26e52 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:55.228095 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d0e66-f0da-4c4b-8e37-b8995ae26e52 None admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:55.229801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d0e66-f0da-4c4b-8e37-b8995ae26e52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:55.230169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d0e66-f0da-4c4b-8e37-b8995ae26e52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:55.231681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d0e66-f0da-4c4b-8e37-b8995ae26e52 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:55.246261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 380/759] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:42:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:55.252976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d0e66-f0da-4c4b-8e37-b8995ae26e52 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:55.263790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4fe8f-09a1-4344-9307-52bda3fc4cf7 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:55.301563 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56061de0-75f4-4133-8ed6-efaf6f660863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:55.302572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56061de0-75f4-4133-8ed6-efaf6f660863 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:55.303073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56061de0-75f4-4133-8ed6-efaf6f660863 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:55.303581 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56061de0-75f4-4133-8ed6-efaf6f660863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:55.330287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:55.367357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d0e66-f0da-4c4b-8e37-b8995ae26e52 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:55.391369 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:55.392517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56061de0-75f4-4133-8ed6-efaf6f660863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:55.393935 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56061de0-75f4-4133-8ed6-efaf6f660863 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:55.404290 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749b6a7-9e30-4812-9d55-00c0fa37021a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:55.405404 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749b6a7-9e30-4812-9d55-00c0fa37021a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:55.406561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749b6a7-9e30-4812-9d55-00c0fa37021a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:55.407054 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749b6a7-9e30-4812-9d55-00c0fa37021a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:55.408193 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749b6a7-9e30-4812-9d55-00c0fa37021a None admin] RBAC: Adding query filter params (role.id=183fd05fe14a41828222fd09b6280796, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=420e2a81b66a470e8db624efd61fd1cd) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:55.408706 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749b6a7-9e30-4812-9d55-00c0fa37021a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:55.410344 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749b6a7-9e30-4812-9d55-00c0fa37021a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:55.417353 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 381/760] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:42:55 2022] GET /identity/v3/role_assignments?user.id=420e2a81b66a470e8db624efd61fd1cd&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=183fd05fe14a41828222fd09b6280796 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:55.536330 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 380/761] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:42:55.541961 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749b6a7-9e30-4812-9d55-00c0fa37021a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:55.628546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa17215-0ede-4900-ab1e-364d3db17b46 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:55.629181 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa17215-0ede-4900-ab1e-364d3db17b46 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:55.629681 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa17215-0ede-4900-ab1e-364d3db17b46 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:55.631486 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 381/762] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:55.636935 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bfc05-7c8b-40cf-a545-bb797ce435c1 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:55.637497 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bfc05-7c8b-40cf-a545-bb797ce435c1 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:55.637975 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bfc05-7c8b-40cf-a545-bb797ce435c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:55.658186 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-a68bfc05-7c8b-40cf-a545-bb797ce435c1 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:55.659797 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a68bfc05-7c8b-40cf-a545-bb797ce435c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:55.679050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749b6a7-9e30-4812-9d55-00c0fa37021a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:55.715233 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:55.720353 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f2808-ca0e-4ce0-8638-bd33d85f5778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:55.721089 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f2808-ca0e-4ce0-8638-bd33d85f5778 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:55.721371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f2808-ca0e-4ce0-8638-bd33d85f5778 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:55.721651 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f2808-ca0e-4ce0-8638-bd33d85f5778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:55.734653 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f2808-ca0e-4ce0-8638-bd33d85f5778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:55.736128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f2808-ca0e-4ce0-8638-bd33d85f5778 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:55.737893 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 382/763] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 03:42:55.751887 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-777f2808-ca0e-4ce0-8638-bd33d85f5778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:55.751887 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:55.751887 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:55.751887 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:55.751887 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:55.751887 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:55.751887 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:55.751887 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:55.751887 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:55.751887 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:55.751887 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:55.751887 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:55.751887 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:55.751887 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:55.751887 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:55.755512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:55.755512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:55.755512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:55.755512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:55.755512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:55.755512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:55.755512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:55.755512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:55.755512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:55.755512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:55.755512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:55.755512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:55.755512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:55.755512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:55.755512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:55.755512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:55.755512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:55.756412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:55.756412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:55.756412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:55.756412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:55.756412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 382/764] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:55.756683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae823be-7151-402b-b813-7b67efed41fc None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:55.756683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae823be-7151-402b-b813-7b67efed41fc None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:55.756683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae823be-7151-402b-b813-7b67efed41fc None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:55.756873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 383/765] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:42:55.762087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae823be-7151-402b-b813-7b67efed41fc None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:55.762477 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376dcd5-4207-4c7e-b4da-96bebbca1360 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:55.762813 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376dcd5-4207-4c7e-b4da-96bebbca1360 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:55.763094 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376dcd5-4207-4c7e-b4da-96bebbca1360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:55.785469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-6376dcd5-4207-4c7e-b4da-96bebbca1360 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:55.785469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-6376dcd5-4207-4c7e-b4da-96bebbca1360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:55.822781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:55.858567 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 383/766] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:42:55.859841 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376dcd5-4207-4c7e-b4da-96bebbca1360 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:55.883068 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae823be-7151-402b-b813-7b67efed41fc None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:55.919502 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c06b0-bead-4cd9-a86f-6b0d6679d323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:55.920502 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c06b0-bead-4cd9-a86f-6b0d6679d323 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:55.921016 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c06b0-bead-4cd9-a86f-6b0d6679d323 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:55.922129 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c06b0-bead-4cd9-a86f-6b0d6679d323 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:55.923045 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c06b0-bead-4cd9-a86f-6b0d6679d323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:55.923582 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c06b0-bead-4cd9-a86f-6b0d6679d323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:55.925161 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c06b0-bead-4cd9-a86f-6b0d6679d323 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:55.938154 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 384/767] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:55.943666 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c06b0-bead-4cd9-a86f-6b0d6679d323 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:55.967237 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376dcd5-4207-4c7e-b4da-96bebbca1360 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:56.007293 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771504f9-2dc2-4b09-95c6-152dc3d2ed43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:56.007599 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:56.008097 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771504f9-2dc2-4b09-95c6-152dc3d2ed43 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:56.008457 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771504f9-2dc2-4b09-95c6-152dc3d2ed43 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:56.008731 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771504f9-2dc2-4b09-95c6-152dc3d2ed43 None admin] PATH_INFO: `/v3/services/network` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:56.009418 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771504f9-2dc2-4b09-95c6-152dc3d2ed43 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:56.010850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771504f9-2dc2-4b09-95c6-152dc3d2ed43 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:56.021394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-771504f9-2dc2-4b09-95c6-152dc3d2ed43 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 03:42:56.021394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:56.021394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:42:56.021394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:42:56.021394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:42:56.021394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:42:56.021394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:42:56.021394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:42:56.021394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 03:42:56.021394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:56.021394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:42:56.021394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:56.021394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:56.021394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:56.021394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:56.021394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:56.021394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:56.022765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:56.022765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:56.022765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:56.022765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:56.022765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:56.022765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:56.022765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:42:56.022765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:42:56.022765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:42:56.022765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:42:56.022765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:56.022765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:56.022765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:56.022765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:56.022765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:56.022765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:56.029972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:56.029972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:56.029972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:56.029972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:56.029972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:56.029972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:56.029972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:56.029972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:56.029972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:56.029972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:56.029972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:42:56.029972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:42:56.029972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 03:42:56.029972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:56.029972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 384/768] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:55 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:56.031154 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771504f9-2dc2-4b09-95c6-152dc3d2ed43 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:56.054578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c06b0-bead-4cd9-a86f-6b0d6679d323 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:56.068458 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:56.090853 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565844c2-2d42-4a37-9a88-ad4df4885a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:56.091731 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565844c2-2d42-4a37-9a88-ad4df4885a25 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:56.092115 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565844c2-2d42-4a37-9a88-ad4df4885a25 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:56.092494 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565844c2-2d42-4a37-9a88-ad4df4885a25 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:56.093418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565844c2-2d42-4a37-9a88-ad4df4885a25 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:56.094916 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565844c2-2d42-4a37-9a88-ad4df4885a25 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:56.104412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-565844c2-2d42-4a37-9a88-ad4df4885a25 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 03:42:56.104412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:56.104412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:42:56.104412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:42:56.104412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:42:56.104412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:42:56.104412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:42:56.104412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:42:56.104412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 03:42:56.104412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:56.104412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:42:56.104412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:56.104412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:56.104412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:56.104412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:56.104412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:56.105593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:56.105593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:56.105593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:56.105593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:56.105593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:56.105593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:56.105593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:56.105593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:42:56.105593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:42:56.105593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:42:56.105593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:42:56.105593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:56.105593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:56.105593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:56.105593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:56.105593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:56.106633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:56.106633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:56.106633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:56.106633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:56.106633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:56.106633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:56.106633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:56.106633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:56.106633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:56.106633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:56.106633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:56.106633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:42:56.106633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:42:56.106633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 03:42:56.106633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:56.109432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 385/769] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Jul 28 03:42:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:56.110572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565844c2-2d42-4a37-9a88-ad4df4885a25 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:56.144439 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771504f9-2dc2-4b09-95c6-152dc3d2ed43 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:56.182295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fb404-f863-4df2-8cbd-cc83ba71ddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:56.182984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fb404-f863-4df2-8cbd-cc83ba71ddfe None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:56.183266 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fb404-f863-4df2-8cbd-cc83ba71ddfe None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:56.183568 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fb404-f863-4df2-8cbd-cc83ba71ddfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:56.191789 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fb404-f863-4df2-8cbd-cc83ba71ddfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:56.193224 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fb404-f863-4df2-8cbd-cc83ba71ddfe None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:56.205692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-632fb404-f863-4df2-8cbd-cc83ba71ddfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:56.205692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:56.205692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:56.205692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:56.205692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:56.205692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:56.205692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:56.205692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:56.205692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:56.205692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:56.205692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:56.205692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:56.205692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:42:56.205692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:42:56.205692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:42:56.206791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:42:56.206791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:56.206791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:56.206791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:56.206791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:56.206791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:56.206791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:56.206791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:56.206791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:56.206791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:56.206791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:56.206791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:56.206791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:56.206791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:56.206791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:56.206791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:56.206791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:56.207910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:42:56.207910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:42:56.207910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:42:56.207910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:42:56.207910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:42:56.207910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:42:56.207910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:42:56.207910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:56.211982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 385/770] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:42:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:56.212871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fb404-f863-4df2-8cbd-cc83ba71ddfe None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:56.219911 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565844c2-2d42-4a37-9a88-ad4df4885a25 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:56.235669 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:56.256003 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d73a9-4ad5-425d-8ade-c0915d498449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:56.256737 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d73a9-4ad5-425d-8ade-c0915d498449 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:56.257127 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d73a9-4ad5-425d-8ade-c0915d498449 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:56.257511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d73a9-4ad5-425d-8ade-c0915d498449 None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:56.258321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d73a9-4ad5-425d-8ade-c0915d498449 None admin] RBAC: Adding query filter params (name=network) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:56.258737 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d73a9-4ad5-425d-8ade-c0915d498449 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:56.260485 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d73a9-4ad5-425d-8ade-c0915d498449 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:56.266328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 386/771] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 28 03:42:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:56.267265 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d73a9-4ad5-425d-8ade-c0915d498449 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:56.323170 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:56.331689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fb404-f863-4df2-8cbd-cc83ba71ddfe None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:56.367546 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd3017-f315-4450-a445-1b6b454c3620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:56.368504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd3017-f315-4450-a445-1b6b454c3620 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:56.368960 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd3017-f315-4450-a445-1b6b454c3620 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:56.369406 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd3017-f315-4450-a445-1b6b454c3620 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:56.370268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd3017-f315-4450-a445-1b6b454c3620 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:56.371818 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd3017-f315-4450-a445-1b6b454c3620 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:56.373414 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd3017-f315-4450-a445-1b6b454c3620 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:56.379948 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d73a9-4ad5-425d-8ade-c0915d498449 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:56.380094 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 386/772] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 28 03:42:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:56.381132 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd3017-f315-4450-a445-1b6b454c3620 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:56.429530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ef3ab-7fbb-4f1d-955c-b323797595fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:56.430254 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ef3ab-7fbb-4f1d-955c-b323797595fd None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:56.430605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ef3ab-7fbb-4f1d-955c-b323797595fd None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:56.430948 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ef3ab-7fbb-4f1d-955c-b323797595fd None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:56.432230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ef3ab-7fbb-4f1d-955c-b323797595fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:56.432810 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ef3ab-7fbb-4f1d-955c-b323797595fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:56.434549 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ef3ab-7fbb-4f1d-955c-b323797595fd None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:56.457104 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 387/773] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:42:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:56.458410 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ef3ab-7fbb-4f1d-955c-b323797595fd None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:56.493988 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:56.515510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd3017-f315-4450-a445-1b6b454c3620 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:56.557328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2dca35-bcef-46a4-9065-f53f03b85a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:56.558334 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dca35-bcef-46a4-9065-f53f03b85a44 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:56.558821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dca35-bcef-46a4-9065-f53f03b85a44 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:56.559298 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2dca35-bcef-46a4-9065-f53f03b85a44 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:56.560384 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2dca35-bcef-46a4-9065-f53f03b85a44 None admin] RBAC: Adding query filter params (type=network) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:56.560905 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2dca35-bcef-46a4-9065-f53f03b85a44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:56.563116 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2dca35-bcef-46a4-9065-f53f03b85a44 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:56.573303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 387/774] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 28 03:42:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:56.574379 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2dca35-bcef-46a4-9065-f53f03b85a44 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:56.576310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ef3ab-7fbb-4f1d-955c-b323797595fd None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:56.601764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:56.622304 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931adf54-e1f4-466a-9abc-19707b989c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:56.622934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931adf54-e1f4-466a-9abc-19707b989c88 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:56.623219 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931adf54-e1f4-466a-9abc-19707b989c88 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:56.623524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931adf54-e1f4-466a-9abc-19707b989c88 None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:56.625442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931adf54-e1f4-466a-9abc-19707b989c88 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:56.625866 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931adf54-e1f4-466a-9abc-19707b989c88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:56.627527 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931adf54-e1f4-466a-9abc-19707b989c88 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:56.633987 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 388/775] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 28 03:42:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:56.637615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931adf54-e1f4-466a-9abc-19707b989c88 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:56.691451 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2dca35-bcef-46a4-9065-f53f03b85a44 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:56.729868 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1597f-afea-49e3-afd4-ad36d40aa42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:56.730863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1597f-afea-49e3-afd4-ad36d40aa42e None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:56.731379 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1597f-afea-49e3-afd4-ad36d40aa42e None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:56.731862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1597f-afea-49e3-afd4-ad36d40aa42e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:56.732986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1597f-afea-49e3-afd4-ad36d40aa42e None admin] RBAC: Adding query filter params (role.id=8a5766c4aef44773834941d1bdbd1e98, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=382ff6087bf4486d8651162880825eb2) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:56.734135 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1597f-afea-49e3-afd4-ad36d40aa42e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:56.736239 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:56.736992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1597f-afea-49e3-afd4-ad36d40aa42e None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:56.743490 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931adf54-e1f4-466a-9abc-19707b989c88 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:56.749242 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 388/776] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:42:56 2022] GET /identity/v3/role_assignments?user.id=382ff6087bf4486d8651162880825eb2&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=8a5766c4aef44773834941d1bdbd1e98 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:56.751817 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1597f-afea-49e3-afd4-ad36d40aa42e None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:56.791972 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281211c-0180-42e1-821c-304357c162a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:56.791972 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281211c-0180-42e1-821c-304357c162a1 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:56.791972 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281211c-0180-42e1-821c-304357c162a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:56.791972 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281211c-0180-42e1-821c-304357c162a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:56.792291 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281211c-0180-42e1-821c-304357c162a1 None admin] RBAC: Adding query filter params (interface=public, service_id=0b0ec90caeb24ed7b2839de67a09fbec, region_id=RegionOne) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:56.792291 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281211c-0180-42e1-821c-304357c162a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:56.792291 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281211c-0180-42e1-821c-304357c162a1 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:56.798767 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 389/777] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 28 03:42:56 2022] GET /identity/v3/endpoints?service_id=0b0ec90caeb24ed7b2839de67a09fbec&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:56.808595 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281211c-0180-42e1-821c-304357c162a1 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:56.876116 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:56.895062 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1597f-afea-49e3-afd4-ad36d40aa42e None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:56.936239 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b84a1-9c06-48a7-ba99-8dbf8a7ddc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:56.938086 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b84a1-9c06-48a7-ba99-8dbf8a7ddc39 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:56.938621 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b84a1-9c06-48a7-ba99-8dbf8a7ddc39 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:56.939103 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b84a1-9c06-48a7-ba99-8dbf8a7ddc39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:56.940129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b84a1-9c06-48a7-ba99-8dbf8a7ddc39 None admin] RBAC: Adding query filter params (interface=public, service_id=814d92ce46da4106a789a5f2c3e9f9e4, region_id=RegionOne) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:56.940660 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b84a1-9c06-48a7-ba99-8dbf8a7ddc39 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:56.942384 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b84a1-9c06-48a7-ba99-8dbf8a7ddc39 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:56.953682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 389/778] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 28 03:42:56 2022] GET /identity/v3/endpoints?service_id=814d92ce46da4106a789a5f2c3e9f9e4&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:56.961425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b84a1-9c06-48a7-ba99-8dbf8a7ddc39 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:57.020486 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281211c-0180-42e1-821c-304357c162a1 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:57.103758 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b84a1-9c06-48a7-ba99-8dbf8a7ddc39 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:57.113665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1443c-7062-49fc-857d-795828355b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:57.114685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1443c-7062-49fc-857d-795828355b4a None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:57.115174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1443c-7062-49fc-857d-795828355b4a None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:57.115675 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1443c-7062-49fc-857d-795828355b4a None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:57.116542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1443c-7062-49fc-857d-795828355b4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:57.118135 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1443c-7062-49fc-857d-795828355b4a None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:57.134074 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 390/779] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 28 03:42:56 2022] GET /identity/v3/services => generated 772 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:57.148177 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c181a6-c5ef-4f61-b38c-77c721e4ed62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:57.148843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c181a6-c5ef-4f61-b38c-77c721e4ed62 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:57.149127 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c181a6-c5ef-4f61-b38c-77c721e4ed62 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:57.149403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c181a6-c5ef-4f61-b38c-77c721e4ed62 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:57.150188 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c181a6-c5ef-4f61-b38c-77c721e4ed62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:57.151710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c181a6-c5ef-4f61-b38c-77c721e4ed62 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:57.159243 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 390/780] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 28 03:42:56 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:57.391362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a1e6b-70e4-4671-ba97-290c4ff852c2 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:57.391844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a1e6b-70e4-4671-ba97-290c4ff852c2 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:57.391844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a1e6b-70e4-4671-ba97-290c4ff852c2 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:57.393345 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 391/781] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:57.398884 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005187a0-3c35-491f-9740-0594f70935a7 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:57.399793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005187a0-3c35-491f-9740-0594f70935a7 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:57.400274 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005187a0-3c35-491f-9740-0594f70935a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:57.422995 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-005187a0-3c35-491f-9740-0594f70935a7 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:57.424236 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-005187a0-3c35-491f-9740-0594f70935a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:57.440850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:57.513442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 391/782] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:42:57.548759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a1e6b-70e4-4671-ba97-290c4ff852c2 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:57.586940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:57.683294 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a1e6b-70e4-4671-ba97-290c4ff852c2 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:57.730250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94752a60-f4ac-4e01-89bf-1c25f74de096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:57.730963 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94752a60-f4ac-4e01-89bf-1c25f74de096 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:57.731246 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94752a60-f4ac-4e01-89bf-1c25f74de096 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:57.731543 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94752a60-f4ac-4e01-89bf-1c25f74de096 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:57.748197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94752a60-f4ac-4e01-89bf-1c25f74de096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:57.754147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-94752a60-f4ac-4e01-89bf-1c25f74de096 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:42:57.754147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:57.754147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:57.754147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:57.754147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:57.754147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:57.754147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:57.754147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:57.754147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:57.754147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:57.754147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:57.754147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:57.754147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:57.754147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:57.754147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:57.754147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:57.755071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:57.755071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:57.755071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:57.755071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:57.755071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:57.755071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:57.755071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:57.755071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:57.755071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:57.755071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:57.755071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:57.755071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:57.755071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:57.755071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:57.755071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:57.755071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:57.755954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:57.755954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:57.755954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:57.755954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:57.755954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:57.755954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:57.755954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:57.755954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:57.755954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:57.755954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:57.755954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:42:57.755954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:57.755954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 392/783] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:42:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:57.761479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005187a0-3c35-491f-9740-0594f70935a7 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:57.868683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133058d-2c82-485c-9b26-3f15004b719b None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:57.869027 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133058d-2c82-485c-9b26-3f15004b719b None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:57.869234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133058d-2c82-485c-9b26-3f15004b719b None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:57.870832 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 393/784] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:57.891148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cd445-b72b-44f6-810b-8548a1d9d6e8 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:57.891520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cd445-b72b-44f6-810b-8548a1d9d6e8 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:57.891765 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cd445-b72b-44f6-810b-8548a1d9d6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:57.914966 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005187a0-3c35-491f-9740-0594f70935a7 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:57.918181 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-c77cd445-b72b-44f6-810b-8548a1d9d6e8 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:57.919413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c77cd445-b72b-44f6-810b-8548a1d9d6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:57.951493 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71df77-fef6-4493-85c4-5a9a5486d998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:57.952049 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71df77-fef6-4493-85c4-5a9a5486d998 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:57.952380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71df77-fef6-4493-85c4-5a9a5486d998 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:57.953166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71df77-fef6-4493-85c4-5a9a5486d998 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:57.953890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71df77-fef6-4493-85c4-5a9a5486d998 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:57.954194 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71df77-fef6-4493-85c4-5a9a5486d998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:57.955591 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71df77-fef6-4493-85c4-5a9a5486d998 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:57.972015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 392/785] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:42:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:57.977702 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71df77-fef6-4493-85c4-5a9a5486d998 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:57.992419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:58.068226 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 394/786] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:42:58.094495 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cd445-b72b-44f6-810b-8548a1d9d6e8 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:58.122405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:58.195607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71df77-fef6-4493-85c4-5a9a5486d998 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:58.222298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cd445-b72b-44f6-810b-8548a1d9d6e8 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:58.264707 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9feb7c-9c29-4b05-8603-3955f2ef3daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:58.265638 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9feb7c-9c29-4b05-8603-3955f2ef3daf None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:58.265921 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9feb7c-9c29-4b05-8603-3955f2ef3daf None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:58.266197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9feb7c-9c29-4b05-8603-3955f2ef3daf None admin] PATH_INFO: `/v3/roles/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:58.286020 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9feb7c-9c29-4b05-8603-3955f2ef3daf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:42:58.292387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-3e9feb7c-9c29-4b05-8603-3955f2ef3daf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:58.292387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:58.292387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:58.292387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:58.292387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:58.292387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:58.292387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:58.292387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:58.292387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:58.292387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:58.292387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:58.292387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:58.292387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:42:58.292387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:42:58.292387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:42:58.292387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:42:58.293475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:42:58.293475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:42:58.293475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:42:58.293475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:42:58.293475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:58.293475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:58.293475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:58.293475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:58.293475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:58.293475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:58.293475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:58.293475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:58.293475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:58.293475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:58.293475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:58.293475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:58.294361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:58.294361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:58.294361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:58.294361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:58.294361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:42:58.294361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:42:58.294361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:42:58.294361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:42:58.294361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:42:58.294361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:42:58.294361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:42:58.294361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:58.294361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 395/787] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:42:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:42:58.296797 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1e59d-5c88-4613-872a-56e600c9506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:58.297075 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1e59d-5c88-4613-872a-56e600c9506a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:58.297244 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1e59d-5c88-4613-872a-56e600c9506a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:58.303346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1e59d-5c88-4613-872a-56e600c9506a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:58.303479 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9feb7c-9c29-4b05-8603-3955f2ef3daf None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:58.315467 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1e59d-5c88-4613-872a-56e600c9506a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:58.316926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1e59d-5c88-4613-872a-56e600c9506a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:58.343867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-5af1e59d-5c88-4613-872a-56e600c9506a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:58.343867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:58.343867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:58.343867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:58.343867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:58.343867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:58.343867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:58.343867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:58.343867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:58.343867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:58.343867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:58.343867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:58.343867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:58.343867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:58.343867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:58.344802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:58.344802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:58.344802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:58.344802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:58.344802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:58.344802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:58.344802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:58.344802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:58.344802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:58.344802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:58.344802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:58.344802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:58.344802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:58.344802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:58.344802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:58.344802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:58.344802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:58.345689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:58.345689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:58.345689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:58.345689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:58.352690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 393/788] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:42:58.353548 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1e59d-5c88-4613-872a-56e600c9506a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:58.444835 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:58.475778 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:58.494338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9feb7c-9c29-4b05-8603-3955f2ef3daf None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:58.533492 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1e59d-5c88-4613-872a-56e600c9506a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:58.560733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b93218-6ea7-4547-8ca6-472b277135ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:58.561386 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b93218-6ea7-4547-8ca6-472b277135ff None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:58.562457 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b93218-6ea7-4547-8ca6-472b277135ff None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:58.562457 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b93218-6ea7-4547-8ca6-472b277135ff None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:58.563348 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b93218-6ea7-4547-8ca6-472b277135ff None admin] RBAC: Adding query filter params (name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:58.563658 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b93218-6ea7-4547-8ca6-472b277135ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:58.565096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b93218-6ea7-4547-8ca6-472b277135ff None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:58.583034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 396/789] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:42:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:58.588358 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b93218-6ea7-4547-8ca6-472b277135ff None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:58.606964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc377f-b995-4228-982f-58eaa5ca8467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:58.607614 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc377f-b995-4228-982f-58eaa5ca8467 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:58.607899 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc377f-b995-4228-982f-58eaa5ca8467 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:58.608174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc377f-b995-4228-982f-58eaa5ca8467 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:58.609049 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc377f-b995-4228-982f-58eaa5ca8467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:58.609478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc377f-b995-4228-982f-58eaa5ca8467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:58.610939 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc377f-b995-4228-982f-58eaa5ca8467 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:58.635931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 394/790] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:58.642195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc377f-b995-4228-982f-58eaa5ca8467 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:58.718836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b93218-6ea7-4547-8ca6-472b277135ff None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:58.754180 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90703e9c-53ad-4a1e-a0b9-65a39a00de53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:58.754754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90703e9c-53ad-4a1e-a0b9-65a39a00de53 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:58.755034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90703e9c-53ad-4a1e-a0b9-65a39a00de53 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:58.755302 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90703e9c-53ad-4a1e-a0b9-65a39a00de53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:58.771367 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90703e9c-53ad-4a1e-a0b9-65a39a00de53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:58.771367 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90703e9c-53ad-4a1e-a0b9-65a39a00de53 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:58.771367 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:58.787567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-90703e9c-53ad-4a1e-a0b9-65a39a00de53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:58.787567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:58.787567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:58.787567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:58.787567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:58.787567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:58.787567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:58.787567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:58.787567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:58.787567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:58.787567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:58.787567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:58.787567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:58.787567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:58.787567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:58.788442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:58.788442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:58.788442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:58.788442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:58.788442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:58.788442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:58.788442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:58.788442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:58.788442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:58.788442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:58.788442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:58.788442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:58.788442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:58.788442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:58.788442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:58.788442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:58.788442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:58.789320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:58.789320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:58.789320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:58.789320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:58.791522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 397/791] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:58.800347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90703e9c-53ad-4a1e-a0b9-65a39a00de53 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:58.853424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc377f-b995-4228-982f-58eaa5ca8467 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:58.888729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:58.922358 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7a5c3-0351-4d53-a6ad-699250d458a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:58.923018 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7a5c3-0351-4d53-a6ad-699250d458a5 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:58.923303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7a5c3-0351-4d53-a6ad-699250d458a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:58.923608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7a5c3-0351-4d53-a6ad-699250d458a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:58.931575 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7a5c3-0351-4d53-a6ad-699250d458a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:58.933121 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7a5c3-0351-4d53-a6ad-699250d458a5 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:58.948085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-e9b7a5c3-0351-4d53-a6ad-699250d458a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:42:58.948085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:58.948085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:58.948085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:58.948085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:58.948085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:58.948085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:58.948085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:58.948085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:58.948085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:58.948085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:58.948085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:58.948085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:58.948085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:58.948085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:58.948085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:58.949070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:58.949070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:58.949070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:58.949070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:58.949070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:58.949070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:58.949070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:58.949070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:58.949070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:58.949070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:58.949070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:58.949070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:58.949070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:58.949070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:58.949070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:58.949070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:58.949070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:58.949070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:58.950074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:58.950074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:58.950074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:58.950074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:58.950074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:58.950074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:58.950074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:58.950074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:58.950074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:42:58.950074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:58.950074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 395/792] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 28 03:42:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:58.959361 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7a5c3-0351-4d53-a6ad-699250d458a5 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:59.012630 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90703e9c-53ad-4a1e-a0b9-65a39a00de53 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:59.087882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548fe13-73da-436d-82cd-88f433dbd5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:59.088771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548fe13-73da-436d-82cd-88f433dbd5aa None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:59.089201 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548fe13-73da-436d-82cd-88f433dbd5aa None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:59.089819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548fe13-73da-436d-82cd-88f433dbd5aa None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:59.091742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548fe13-73da-436d-82cd-88f433dbd5aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:59.092897 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548fe13-73da-436d-82cd-88f433dbd5aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:59.094441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548fe13-73da-436d-82cd-88f433dbd5aa None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:59.098628 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7a5c3-0351-4d53-a6ad-699250d458a5 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:59.119256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 398/793] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:59.126072 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548fe13-73da-436d-82cd-88f433dbd5aa None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:59.172550 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3558a2e-742f-4c15-b79f-37ad014859cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:59.173462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3558a2e-742f-4c15-b79f-37ad014859cf None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:59.174547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3558a2e-742f-4c15-b79f-37ad014859cf None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:59.175081 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3558a2e-742f-4c15-b79f-37ad014859cf None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:59.176226 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3558a2e-742f-4c15-b79f-37ad014859cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:59.177432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3558a2e-742f-4c15-b79f-37ad014859cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:59.183876 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3558a2e-742f-4c15-b79f-37ad014859cf None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:59.219348 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 396/794] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 28 03:42:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:42:59.221757 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:59.225174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3558a2e-742f-4c15-b79f-37ad014859cf None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:59.303754 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:59.320283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548fe13-73da-436d-82cd-88f433dbd5aa None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:59.382790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d58af-de97-4df0-a4e4-d85c53b43537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:59.383469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d58af-de97-4df0-a4e4-d85c53b43537 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:59.383757 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d58af-de97-4df0-a4e4-d85c53b43537 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:59.384195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d58af-de97-4df0-a4e4-d85c53b43537 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:59.392782 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d58af-de97-4df0-a4e4-d85c53b43537 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:59.394251 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d58af-de97-4df0-a4e4-d85c53b43537 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:59.395090 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3558a2e-742f-4c15-b79f-37ad014859cf None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:59.407408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-e54d58af-de97-4df0-a4e4-d85c53b43537 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 03:42:59.407408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:59.407408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:59.407408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:59.407408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:59.407408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:59.407408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:59.407408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:59.407408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:59.407408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:59.407408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:59.407408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:59.407408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:42:59.407408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:42:59.407408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:42:59.407408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:42:59.408391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:59.408391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:59.408391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:42:59.408391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:59.408391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:42:59.408391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:42:59.408391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:59.408391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:59.408391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:59.408391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:59.408391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:59.408391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:59.408391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:59.408391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:59.408391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:59.408391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:59.408391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:59.408391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:59.409334 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:59.409334 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:59.409334 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:42:59.409334 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:42:59.409334 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:42:59.409334 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:42:59.409334 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:42:59.409334 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:42:59.409334 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 03:42:59.409334 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:59.409334 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 399/795] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 28 03:42:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:59.410429 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb205d0d-d7b2-4402-b20a-8c78838d27e7 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:59.410429 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb205d0d-d7b2-4402-b20a-8c78838d27e7 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:59.410598 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb205d0d-d7b2-4402-b20a-8c78838d27e7 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:59.415946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 400/796] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:59.416879 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb205d0d-d7b2-4402-b20a-8c78838d27e7 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:59.443773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a061838-3b06-4a22-b695-77873764ab60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:59.445274 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a061838-3b06-4a22-b695-77873764ab60 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:59.445741 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a061838-3b06-4a22-b695-77873764ab60 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:59.446168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a061838-3b06-4a22-b695-77873764ab60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:59.536068 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a061838-3b06-4a22-b695-77873764ab60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:59.537714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a061838-3b06-4a22-b695-77873764ab60 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:59.539218 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb205d0d-d7b2-4402-b20a-8c78838d27e7 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:59.549899 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:59.573412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:59.577062 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4a0ce-3f90-4290-a5f8-5093f32c1503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:59.578297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4a0ce-3f90-4290-a5f8-5093f32c1503 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:59.578585 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4a0ce-3f90-4290-a5f8-5093f32c1503 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:59.579339 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4a0ce-3f90-4290-a5f8-5093f32c1503 None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:59.580155 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4a0ce-3f90-4290-a5f8-5093f32c1503 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:42:59.580467 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4a0ce-3f90-4290-a5f8-5093f32c1503 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:59.582283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4a0ce-3f90-4290-a5f8-5093f32c1503 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:59.602088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 401/797] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 28 03:42:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:42:59.603359 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367d14c-a9f4-4b02-a49c-c295a8fb3e63 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:59.603638 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367d14c-a9f4-4b02-a49c-c295a8fb3e63 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:59.603913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367d14c-a9f4-4b02-a49c-c295a8fb3e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:59.624080 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-5367d14c-a9f4-4b02-a49c-c295a8fb3e63 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:59.625521 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-5367d14c-a9f4-4b02-a49c-c295a8fb3e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:59.648007 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 397/798] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:42:59 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:42:59.649342 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ad767-aeed-48d3-baa8-971afe6afaa8 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:59.649640 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ad767-aeed-48d3-baa8-971afe6afaa8 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:59.649915 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ad767-aeed-48d3-baa8-971afe6afaa8 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:59.651153 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 398/799] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:59.657050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ad767-aeed-48d3-baa8-971afe6afaa8 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:59.696382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 402/800] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:42:59.696382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424c825-3dea-43bb-86ef-5c0ced53711e None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:59.696382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424c825-3dea-43bb-86ef-5c0ced53711e None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:59.696382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424c825-3dea-43bb-86ef-5c0ced53711e None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:59.699791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 403/801] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:42:59.699791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424c825-3dea-43bb-86ef-5c0ced53711e None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:59.762609 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ad767-aeed-48d3-baa8-971afe6afaa8 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:59.799852 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa386513-e94c-46f3-91b8-f3dbcc8446be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:59.800330 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:59.800488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa386513-e94c-46f3-91b8-f3dbcc8446be None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:59.800768 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa386513-e94c-46f3-91b8-f3dbcc8446be None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:59.801036 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa386513-e94c-46f3-91b8-f3dbcc8446be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:59.803719 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:59.806747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424c825-3dea-43bb-86ef-5c0ced53711e None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:42:59.811659 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa386513-e94c-46f3-91b8-f3dbcc8446be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:59.813699 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa386513-e94c-46f3-91b8-f3dbcc8446be None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:59.827164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-fa386513-e94c-46f3-91b8-f3dbcc8446be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:59.827164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:59.827164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:59.827164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:59.827164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:59.827164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:59.827164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:59.827164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:59.827164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:59.827164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:59.827164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:59.827164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:59.827164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:59.827164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:59.827164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:59.829072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:59.829072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:59.829072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:59.829072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:59.829072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:59.829072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:59.829072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:59.829072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:59.829072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:59.829072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:59.829072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:59.829072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:59.829072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:59.829072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:59.829072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:59.829072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:59.829072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:59.830377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:59.830377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:59.830377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:59.830377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:42:59.830377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 399/802] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:59.830644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502f055-3d03-4aca-804b-fdadb6012dea None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:59.830817 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502f055-3d03-4aca-804b-fdadb6012dea None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:59.831052 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502f055-3d03-4aca-804b-fdadb6012dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:59.845955 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8972a7-c7d5-460f-95d4-e383b30d9d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:42:59.846599 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8972a7-c7d5-460f-95d4-e383b30d9d74 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:59.846879 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8972a7-c7d5-460f-95d4-e383b30d9d74 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:59.847152 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8972a7-c7d5-460f-95d4-e383b30d9d74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:59.849168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-8502f055-3d03-4aca-804b-fdadb6012dea None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:59.850426 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-8502f055-3d03-4aca-804b-fdadb6012dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:59.857262 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8972a7-c7d5-460f-95d4-e383b30d9d74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:42:59.858737 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8972a7-c7d5-460f-95d4-e383b30d9d74 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:42:59.873210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-ea8972a7-c7d5-460f-95d4-e383b30d9d74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:59.873210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:42:59.873210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:42:59.873210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:42:59.873210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:42:59.873210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:42:59.873210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:42:59.873210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:42:59.873210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:42:59.873210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:42:59.873210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:42:59.873210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:42:59.873210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:42:59.873210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:42:59.873210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:42:59.874343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:42:59.874343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:42:59.874343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:42:59.874343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:42:59.874343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:42:59.874343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:42:59.874343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:42:59.874343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:42:59.874343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:42:59.874343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:42:59.874343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:42:59.874343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:42:59.874343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:42:59.874343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:42:59.874343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:42:59.874343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:42:59.874343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:42:59.875707 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:42:59.875707 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:42:59.875707 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:42:59.875707 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:42:59.875707 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 404/803] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:42:59.875975 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed83a84-2c1f-4c74-9069-b4a522c291d4 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:42:59.876222 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed83a84-2c1f-4c74-9069-b4a522c291d4 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:42:59.876483 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed83a84-2c1f-4c74-9069-b4a522c291d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:42:59.894439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-bed83a84-2c1f-4c74-9069-b4a522c291d4 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:42:59.895698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-bed83a84-2c1f-4c74-9069-b4a522c291d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:42:59.923063 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 400/804] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:42:59.923988 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502f055-3d03-4aca-804b-fdadb6012dea None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:42:59.967971 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 405/805] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:42:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:42:59.969154 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed83a84-2c1f-4c74-9069-b4a522c291d4 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:00.030694 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502f055-3d03-4aca-804b-fdadb6012dea None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:00.048741 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:00.049578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:00.065207 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624f613-63bd-46c5-bfc7-f7a893386bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:00.065859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624f613-63bd-46c5-bfc7-f7a893386bf3 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:00.066141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624f613-63bd-46c5-bfc7-f7a893386bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:00.066414 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624f613-63bd-46c5-bfc7-f7a893386bf3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:00.074751 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed83a84-2c1f-4c74-9069-b4a522c291d4 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:00.076497 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624f613-63bd-46c5-bfc7-f7a893386bf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:43:00.081989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-d624f613-63bd-46c5-bfc7-f7a893386bf3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:43:00.081989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:00.081989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:00.081989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:00.081989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:00.081989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:00.081989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:00.081989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:00.081989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:00.081989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:00.081989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:00.081989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:00.081989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:43:00.081989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:43:00.081989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:43:00.081989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:43:00.082971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:43:00.082971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:43:00.082971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:43:00.082971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:43:00.082971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:00.082971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:00.082971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:00.082971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:00.082971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:00.082971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:00.082971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:00.082971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:00.082971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:00.082971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:00.082971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:00.082971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:00.083840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:00.083840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:00.083840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:00.083840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:00.083840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:43:00.083840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:43:00.083840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:43:00.083840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:43:00.083840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:43:00.083840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:43:00.083840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:43:00.083840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:00.083840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 401/806] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:42:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:00.084512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624f613-63bd-46c5-bfc7-f7a893386bf3 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:00.110458 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ff14f-8e70-4faf-9e1e-d736531770d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:00.111091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ff14f-8e70-4faf-9e1e-d736531770d4 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:00.111397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ff14f-8e70-4faf-9e1e-d736531770d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:00.111678 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ff14f-8e70-4faf-9e1e-d736531770d4 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:00.112368 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ff14f-8e70-4faf-9e1e-d736531770d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:00.112671 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ff14f-8e70-4faf-9e1e-d736531770d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:00.114144 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ff14f-8e70-4faf-9e1e-d736531770d4 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:00.126819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 406/807] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:00.127658 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ff14f-8e70-4faf-9e1e-d736531770d4 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:00.190823 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624f613-63bd-46c5-bfc7-f7a893386bf3 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:00.224774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713178bf-e04c-4f55-998a-21a49b466751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:00.225407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713178bf-e04c-4f55-998a-21a49b466751 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:00.225665 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713178bf-e04c-4f55-998a-21a49b466751 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:00.225939 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713178bf-e04c-4f55-998a-21a49b466751 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:00.226624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713178bf-e04c-4f55-998a-21a49b466751 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:00.226922 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713178bf-e04c-4f55-998a-21a49b466751 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:00.227924 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ff14f-8e70-4faf-9e1e-d736531770d4 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:00.228329 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713178bf-e04c-4f55-998a-21a49b466751 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:00.239943 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 402/808] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:00.240742 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713178bf-e04c-4f55-998a-21a49b466751 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:00.266745 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5b541-48a1-4a96-b2a5-91ad3b885b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:00.267476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5b541-48a1-4a96-b2a5-91ad3b885b28 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:00.267760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5b541-48a1-4a96-b2a5-91ad3b885b28 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:00.268037 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5b541-48a1-4a96-b2a5-91ad3b885b28 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:00.268662 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5b541-48a1-4a96-b2a5-91ad3b885b28 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:00.270039 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5b541-48a1-4a96-b2a5-91ad3b885b28 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:00.279369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-6ce5b541-48a1-4a96-b2a5-91ad3b885b28 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 03:43:00.279369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:00.279369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:43:00.279369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:43:00.279369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:43:00.279369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:43:00.279369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:43:00.279369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:00.279369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 03:43:00.279369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:00.279369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:00.279369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:00.279369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:00.279369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:00.279369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:00.279369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:00.280283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:00.280283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:00.280283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:00.280283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:00.280283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:00.280283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:00.280283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:00.280283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:43:00.280283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:43:00.280283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:43:00.280283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:43:00.280283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:00.280283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:00.280283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:00.280283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:00.280283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:00.281122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:00.281122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:00.281122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:00.281122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:00.281122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:00.281122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:00.281122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:00.281122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:00.281122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:00.281122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:00.281122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:00.281122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:43:00.281122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:00.281122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 03:43:00.281122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:00.281122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 407/809] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Jul 28 03:43:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:00.281960 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:00.282032 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5b541-48a1-4a96-b2a5-91ad3b885b28 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:00.285502 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:00.341775 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713178bf-e04c-4f55-998a-21a49b466751 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:00.376541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6da70-ca4b-49e8-8b47-ec7abff9d4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:00.377191 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6da70-ca4b-49e8-8b47-ec7abff9d4a9 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:00.377472 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6da70-ca4b-49e8-8b47-ec7abff9d4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:00.377749 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6da70-ca4b-49e8-8b47-ec7abff9d4a9 None admin] PATH_INFO: `/v3/services/network` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:00.378391 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6da70-ca4b-49e8-8b47-ec7abff9d4a9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:00.379792 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6da70-ca4b-49e8-8b47-ec7abff9d4a9 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:00.382378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5b541-48a1-4a96-b2a5-91ad3b885b28 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:00.388491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-7bb6da70-ca4b-49e8-8b47-ec7abff9d4a9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 03:43:00.388491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:00.388491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:43:00.388491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:43:00.388491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:43:00.388491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:43:00.388491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:43:00.388491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:00.388491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 03:43:00.388491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:00.388491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:00.388491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:00.388491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:00.388491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:00.388491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:00.388491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:00.388491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:00.389735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:00.389735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:00.389735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:00.389735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:00.389735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:00.389735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:00.389735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:43:00.389735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:43:00.389735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:43:00.389735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:43:00.389735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:00.389735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:00.389735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:00.389735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:00.389735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:00.389735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:00.391618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:00.391618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:00.391618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:00.391618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:00.391618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:00.391618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:00.391618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:00.391618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:00.391618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:00.391618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:00.391618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:43:00.391618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:00.391618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 03:43:00.391618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:00.391618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 403/810] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:43:00 2022] GET /identity/v3/services/network => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:00.392579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6da70-ca4b-49e8-8b47-ec7abff9d4a9 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:00.422279 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2cfc8-6278-4fc0-8329-e8ace0e78ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:00.422889 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2cfc8-6278-4fc0-8329-e8ace0e78ec1 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:00.423170 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2cfc8-6278-4fc0-8329-e8ace0e78ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:00.423478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2cfc8-6278-4fc0-8329-e8ace0e78ec1 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:00.424191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2cfc8-6278-4fc0-8329-e8ace0e78ec1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:00.424495 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2cfc8-6278-4fc0-8329-e8ace0e78ec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:00.425880 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2cfc8-6278-4fc0-8329-e8ace0e78ec1 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:00.433893 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 408/811] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:43:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:00.434679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2cfc8-6278-4fc0-8329-e8ace0e78ec1 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:00.493431 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6da70-ca4b-49e8-8b47-ec7abff9d4a9 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:00.494967 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:00.498432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:00.527487 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b49de-493c-4127-947b-ad985aa0e8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:00.528584 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b49de-493c-4127-947b-ad985aa0e8ac None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:00.529178 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b49de-493c-4127-947b-ad985aa0e8ac None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:00.529650 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b49de-493c-4127-947b-ad985aa0e8ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:00.536486 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2cfc8-6278-4fc0-8329-e8ace0e78ec1 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:00.536787 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b49de-493c-4127-947b-ad985aa0e8ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:00.538689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b49de-493c-4127-947b-ad985aa0e8ac None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:00.549909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-790b49de-493c-4127-947b-ad985aa0e8ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:00.549909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:00.549909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:00.549909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:00.549909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:00.549909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:00.549909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:00.549909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:00.549909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:00.549909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:00.549909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:00.549909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:00.549909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:43:00.549909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:43:00.549909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:43:00.550977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:43:00.550977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:00.550977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:00.550977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:00.550977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:00.550977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:00.550977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:00.550977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:00.550977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:00.550977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:00.550977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:00.550977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:00.550977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:00.550977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:00.550977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:00.550977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:00.550977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:00.552378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:43:00.552378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:43:00.552378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:43:00.552378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:43:00.552378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:43:00.552378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:43:00.552378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:00.552378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:00.552378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 404/812] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:43:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:00.552378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b49de-493c-4127-947b-ad985aa0e8ac None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:00.574886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35898c-7748-4cec-a820-4cdf5588c24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:00.575562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35898c-7748-4cec-a820-4cdf5588c24b None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:00.575837 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35898c-7748-4cec-a820-4cdf5588c24b None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:00.576106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35898c-7748-4cec-a820-4cdf5588c24b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:00.583244 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35898c-7748-4cec-a820-4cdf5588c24b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:00.584720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35898c-7748-4cec-a820-4cdf5588c24b None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:00.596914 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-9f35898c-7748-4cec-a820-4cdf5588c24b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:00.596914 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:00.596914 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:00.596914 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:00.596914 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:00.596914 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:00.596914 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:00.596914 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:00.596914 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:00.596914 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:00.596914 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:00.596914 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:00.596914 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:43:00.596914 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:43:00.596914 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:43:00.597858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:43:00.597858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:00.597858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:00.597858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:00.597858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:00.597858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:00.597858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:00.597858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:00.597858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:00.597858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:00.597858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:00.597858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:00.597858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:00.597858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:00.597858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:00.597858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:00.597858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:00.598749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:43:00.598749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:43:00.598749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:43:00.598749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:43:00.598749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:43:00.598749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:43:00.598749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:00.598749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:00.598749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 409/813] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:43:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:00.598749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35898c-7748-4cec-a820-4cdf5588c24b None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:00.655944 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b49de-493c-4127-947b-ad985aa0e8ac None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:00.690337 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43918ae4-1537-40d2-82db-674486c9ad85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:00.690956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43918ae4-1537-40d2-82db-674486c9ad85 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:00.691240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43918ae4-1537-40d2-82db-674486c9ad85 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:00.691543 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43918ae4-1537-40d2-82db-674486c9ad85 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:00.692225 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43918ae4-1537-40d2-82db-674486c9ad85 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:00.692774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43918ae4-1537-40d2-82db-674486c9ad85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:00.693899 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43918ae4-1537-40d2-82db-674486c9ad85 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:00.698333 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 405/814] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 28 03:43:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:00.699095 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43918ae4-1537-40d2-82db-674486c9ad85 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:00.700770 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35898c-7748-4cec-a820-4cdf5588c24b None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:00.726095 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:00.728078 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:00.737180 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4c52c-b588-495a-a37a-db5c3e05fb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:00.738414 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4c52c-b588-495a-a37a-db5c3e05fb2a None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:00.738414 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4c52c-b588-495a-a37a-db5c3e05fb2a None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:00.738414 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4c52c-b588-495a-a37a-db5c3e05fb2a None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:00.739046 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4c52c-b588-495a-a37a-db5c3e05fb2a None admin] RBAC: Adding query filter params (name=network) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:00.739374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4c52c-b588-495a-a37a-db5c3e05fb2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:00.740752 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4c52c-b588-495a-a37a-db5c3e05fb2a None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:00.745253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 410/815] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 28 03:43:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:00.746030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4c52c-b588-495a-a37a-db5c3e05fb2a None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:00.803959 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43918ae4-1537-40d2-82db-674486c9ad85 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:00.837856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06769bf-32fc-4d53-88fc-d4841adccd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:00.838506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06769bf-32fc-4d53-88fc-d4841adccd2b None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:00.838782 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06769bf-32fc-4d53-88fc-d4841adccd2b None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:00.839056 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06769bf-32fc-4d53-88fc-d4841adccd2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:00.849645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06769bf-32fc-4d53-88fc-d4841adccd2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:00.851254 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06769bf-32fc-4d53-88fc-d4841adccd2b None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:00.856544 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4c52c-b588-495a-a37a-db5c3e05fb2a None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:00.865992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-a06769bf-32fc-4d53-88fc-d4841adccd2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:00.865992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:00.865992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:00.865992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:00.865992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:00.865992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:00.865992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:00.865992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:00.865992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:00.865992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:00.865992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:00.865992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:00.865992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:43:00.865992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:43:00.865992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:43:00.867047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:43:00.867047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:00.867047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:00.867047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:00.867047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:00.867047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:00.867047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:00.867047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:00.867047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:00.867047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:00.867047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:00.867047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:00.867047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:00.867047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:00.867047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:00.867047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:00.867047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:00.868428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:43:00.868428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:43:00.868428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:00.868428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:00.868428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 406/816] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:00.868428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06769bf-32fc-4d53-88fc-d4841adccd2b None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:00.894467 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2bbf2-eac9-46fb-8c5d-1e1f7ac519c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:00.895103 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2bbf2-eac9-46fb-8c5d-1e1f7ac519c4 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:00.895426 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2bbf2-eac9-46fb-8c5d-1e1f7ac519c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:00.895707 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2bbf2-eac9-46fb-8c5d-1e1f7ac519c4 None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:00.896460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2bbf2-eac9-46fb-8c5d-1e1f7ac519c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:00.896770 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2bbf2-eac9-46fb-8c5d-1e1f7ac519c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:00.898214 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2bbf2-eac9-46fb-8c5d-1e1f7ac519c4 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:00.911032 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 411/817] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:43:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:00.911867 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2bbf2-eac9-46fb-8c5d-1e1f7ac519c4 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:00.946567 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:00.961377 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:00.967226 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06769bf-32fc-4d53-88fc-d4841adccd2b None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:01.001764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b8114-6334-4d05-afc8-3cb20e4499ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:01.002388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b8114-6334-4d05-afc8-3cb20e4499ab None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:01.002670 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b8114-6334-4d05-afc8-3cb20e4499ab None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:01.002949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b8114-6334-4d05-afc8-3cb20e4499ab None admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:01.003740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b8114-6334-4d05-afc8-3cb20e4499ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:01.004046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b8114-6334-4d05-afc8-3cb20e4499ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:01.005484 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b8114-6334-4d05-afc8-3cb20e4499ab None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:01.011271 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2bbf2-eac9-46fb-8c5d-1e1f7ac519c4 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:01.018126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 407/818] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:43:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:01.018935 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b8114-6334-4d05-afc8-3cb20e4499ab None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:01.047449 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b731d-80b4-44f4-accc-3bc1e1519884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:01.048078 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b731d-80b4-44f4-accc-3bc1e1519884 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:01.048339 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b731d-80b4-44f4-accc-3bc1e1519884 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:01.048619 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b731d-80b4-44f4-accc-3bc1e1519884 None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:01.049300 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b731d-80b4-44f4-accc-3bc1e1519884 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:01.049604 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b731d-80b4-44f4-accc-3bc1e1519884 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:01.050975 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b731d-80b4-44f4-accc-3bc1e1519884 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:01.055706 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 412/819] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 28 03:43:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:01.056475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b731d-80b4-44f4-accc-3bc1e1519884 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:01.121654 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b8114-6334-4d05-afc8-3cb20e4499ab None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:01.156656 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c83557-36ab-4a5b-b2af-c104229f5da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:01.157284 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c83557-36ab-4a5b-b2af-c104229f5da2 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:01.157565 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c83557-36ab-4a5b-b2af-c104229f5da2 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:01.157846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c83557-36ab-4a5b-b2af-c104229f5da2 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:01.158533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c83557-36ab-4a5b-b2af-c104229f5da2 None admin] RBAC: Adding query filter params (type=network) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:01.158837 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c83557-36ab-4a5b-b2af-c104229f5da2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:01.160246 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c83557-36ab-4a5b-b2af-c104229f5da2 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:01.165415 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 408/820] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 28 03:43:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:01.166175 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c83557-36ab-4a5b-b2af-c104229f5da2 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:01.168800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:01.170542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b731d-80b4-44f4-accc-3bc1e1519884 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:01.183153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:01.205137 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a455c-baa8-45c1-b6d8-d8cd56c32297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:01.205765 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a455c-baa8-45c1-b6d8-d8cd56c32297 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:01.206044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a455c-baa8-45c1-b6d8-d8cd56c32297 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:01.206328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a455c-baa8-45c1-b6d8-d8cd56c32297 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:01.207012 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a455c-baa8-45c1-b6d8-d8cd56c32297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:01.207328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a455c-baa8-45c1-b6d8-d8cd56c32297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:01.208722 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a455c-baa8-45c1-b6d8-d8cd56c32297 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:01.220284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 413/821] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:01.221080 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a455c-baa8-45c1-b6d8-d8cd56c32297 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:01.268645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c83557-36ab-4a5b-b2af-c104229f5da2 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:01.302205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e4ca2-1d4d-4c63-b492-7a45fcdb4c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:01.302884 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e4ca2-1d4d-4c63-b492-7a45fcdb4c50 None admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:01.303168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e4ca2-1d4d-4c63-b492-7a45fcdb4c50 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:01.303487 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e4ca2-1d4d-4c63-b492-7a45fcdb4c50 None admin] PATH_INFO: `/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/420e2a81b66a470e8db624efd61fd1cd/roles/183fd05fe14a41828222fd09b6280796` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:01.319137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e4ca2-1d4d-4c63-b492-7a45fcdb4c50 None admin] RBAC: Authorizing `identity:create_grant(project_id=28b7995e83524b9293d1c6fc319e5a85, user_id=420e2a81b66a470e8db624efd61fd1cd, role_id=183fd05fe14a41828222fd09b6280796)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:01.320654 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e4ca2-1d4d-4c63-b492-7a45fcdb4c50 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:01.320863 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a455c-baa8-45c1-b6d8-d8cd56c32297 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:01.354065 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c323bc-d3cd-48ec-9162-e86cbc6a29ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:01.354650 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c323bc-d3cd-48ec-9162-e86cbc6a29ce None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:01.354926 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c323bc-d3cd-48ec-9162-e86cbc6a29ce None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:01.355198 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c323bc-d3cd-48ec-9162-e86cbc6a29ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:01.356016 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c323bc-d3cd-48ec-9162-e86cbc6a29ce None admin] RBAC: Adding query filter params (role.id=8a5766c4aef44773834941d1bdbd1e98, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=5133abf4c32a45b0b2188f71496c572b) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:01.356324 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c323bc-d3cd-48ec-9162-e86cbc6a29ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:01.357742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c323bc-d3cd-48ec-9162-e86cbc6a29ce None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:01.364177 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 414/822] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:43:01 2022] GET /identity/v3/role_assignments?user.id=5133abf4c32a45b0b2188f71496c572b&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=8a5766c4aef44773834941d1bdbd1e98 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:01.364999 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c323bc-d3cd-48ec-9162-e86cbc6a29ce None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:01.404901 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:01.418584 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 409/823] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:43:01 2022] PUT /identity/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/420e2a81b66a470e8db624efd61fd1cd/roles/183fd05fe14a41828222fd09b6280796 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:43:01.419722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e4ca2-1d4d-4c63-b492-7a45fcdb4c50 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:01.499692 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c323bc-d3cd-48ec-9162-e86cbc6a29ce None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:01.503768 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:01.550550 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096429c-3540-4519-9d2c-8d8c40b7013c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:01.551163 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096429c-3540-4519-9d2c-8d8c40b7013c None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:01.551479 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096429c-3540-4519-9d2c-8d8c40b7013c None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:01.551756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096429c-3540-4519-9d2c-8d8c40b7013c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:01.552212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e4ca2-1d4d-4c63-b492-7a45fcdb4c50 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:01.552709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096429c-3540-4519-9d2c-8d8c40b7013c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:01.553894 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096429c-3540-4519-9d2c-8d8c40b7013c None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:01.598397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3e58d-ce1c-46d8-b014-a7e16cc603ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:01.599488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3e58d-ce1c-46d8-b014-a7e16cc603ff None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:01.599605 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3e58d-ce1c-46d8-b014-a7e16cc603ff None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:01.599992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3e58d-ce1c-46d8-b014-a7e16cc603ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:01.600816 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3e58d-ce1c-46d8-b014-a7e16cc603ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:01.602275 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3e58d-ce1c-46d8-b014-a7e16cc603ff None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:01.664349 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 415/824] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 03:43:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:43:01.665235 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096429c-3540-4519-9d2c-8d8c40b7013c None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:01.699123 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 410/825] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 03:43:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:43:01.819696 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:01.842019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096429c-3540-4519-9d2c-8d8c40b7013c None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:01.909455 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736a270-4638-4f85-8d6f-8b552a2bac9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:01.910126 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736a270-4638-4f85-8d6f-8b552a2bac9d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:01.910414 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736a270-4638-4f85-8d6f-8b552a2bac9d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:01.910685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736a270-4638-4f85-8d6f-8b552a2bac9d None admin] PATH_INFO: `/v3/users/swift` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:01.918829 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736a270-4638-4f85-8d6f-8b552a2bac9d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:01.920391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736a270-4638-4f85-8d6f-8b552a2bac9d None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:01.934742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-f736a270-4638-4f85-8d6f-8b552a2bac9d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 03:43:01.934742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:01.934742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:01.934742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:01.934742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:01.934742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:01.934742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:01.934742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:01.934742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:01.934742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:01.934742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:01.934742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:01.934742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:43:01.934742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:43:01.934742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:43:01.934742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:43:01.935958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:01.935958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:01.935958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:43:01.935958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:01.935958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:43:01.935958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:01.935958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:01.935958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:01.935958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:01.935958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:01.935958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:01.935958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:01.935958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:01.935958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:01.935958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:01.935958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:01.935958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:01.935958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:01.937730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:01.937730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:01.937730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:43:01.937730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:43:01.937730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:43:01.937730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:43:01.937730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:43:01.937730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:43:01.937730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 03:43:01.937730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:01.937730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 416/826] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:43:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:01.943426 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3e58d-ce1c-46d8-b014-a7e16cc603ff None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:02.077049 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3e58d-ce1c-46d8-b014-a7e16cc603ff None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:02.088737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:02.114894 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adced1-9743-419f-8568-a738f73116ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:02.115657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adced1-9743-419f-8568-a738f73116ab None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:02.116016 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adced1-9743-419f-8568-a738f73116ab None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:02.116365 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adced1-9743-419f-8568-a738f73116ab None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:02.117261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4adced1-9743-419f-8568-a738f73116ab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:02.117644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4adced1-9743-419f-8568-a738f73116ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:02.119252 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4adced1-9743-419f-8568-a738f73116ab None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:02.138736 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 411/827] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 28 03:43:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:02.144949 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736a270-4638-4f85-8d6f-8b552a2bac9d None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:02.247762 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736a270-4638-4f85-8d6f-8b552a2bac9d None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:02.283292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2e03c-df91-4233-a6b6-1309b8653712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:02.283971 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2e03c-df91-4233-a6b6-1309b8653712 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:02.284302 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2e03c-df91-4233-a6b6-1309b8653712 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:02.284578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2e03c-df91-4233-a6b6-1309b8653712 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:02.296676 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2e03c-df91-4233-a6b6-1309b8653712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:02.298135 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2e03c-df91-4233-a6b6-1309b8653712 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:02.300830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:02.313366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-e7c2e03c-df91-4233-a6b6-1309b8653712 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:02.313366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:02.313366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:02.313366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:02.313366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:02.313366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:02.313366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:02.313366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:02.313366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:02.313366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:02.313366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:02.313366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:02.313366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:43:02.313366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:43:02.313366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:43:02.317614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:43:02.317614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:02.317614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:02.317614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:02.317614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:02.317614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:02.317614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:02.317614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:02.317614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:02.317614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:02.317614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:02.317614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:02.317614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:02.317614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:02.317614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:02.317614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:02.317614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:02.318692 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:43:02.318692 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:43:02.318692 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:02.318692 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:02.318692 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 417/828] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:02.324139 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adced1-9743-419f-8568-a738f73116ab None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:02.429186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adced1-9743-419f-8568-a738f73116ab None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:02.464327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fc1a4-6703-44aa-97ba-1af323c638ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:02.464943 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fc1a4-6703-44aa-97ba-1af323c638ff None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:02.465224 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fc1a4-6703-44aa-97ba-1af323c638ff None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:02.465498 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fc1a4-6703-44aa-97ba-1af323c638ff None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:02.466186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fc1a4-6703-44aa-97ba-1af323c638ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:02.466486 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fc1a4-6703-44aa-97ba-1af323c638ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:02.468088 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fc1a4-6703-44aa-97ba-1af323c638ff None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:02.479746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 412/829] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:02.485352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2e03c-df91-4233-a6b6-1309b8653712 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:02.586929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2e03c-df91-4233-a6b6-1309b8653712 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:02.620415 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3c5c7-0246-48f3-8c3c-bd77338606f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:02.621124 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3c5c7-0246-48f3-8c3c-bd77338606f1 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:02.621400 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3c5c7-0246-48f3-8c3c-bd77338606f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:02.621669 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3c5c7-0246-48f3-8c3c-bd77338606f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:02.629117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3c5c7-0246-48f3-8c3c-bd77338606f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:02.630611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3c5c7-0246-48f3-8c3c-bd77338606f1 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:02.642958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-bcd3c5c7-0246-48f3-8c3c-bd77338606f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:02.642958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:02.642958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:02.642958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:02.642958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:02.642958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:02.642958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:02.642958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:02.642958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:02.642958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:02.642958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:02.642958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:02.642958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:43:02.642958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:43:02.642958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:43:02.643980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:43:02.643980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:02.643980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:02.643980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:02.643980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:02.643980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:02.643980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:02.643980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:02.643980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:02.643980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:02.643980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:02.643980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:02.643980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:02.643980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:02.643980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:02.643980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:02.643980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:02.645110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:43:02.645110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:43:02.645110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:43:02.645110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:43:02.645110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:43:02.645110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:43:02.645110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:02.645110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:02.645110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 418/830] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:43:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:02.650137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fc1a4-6703-44aa-97ba-1af323c638ff None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:02.685302 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:02.764396 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fc1a4-6703-44aa-97ba-1af323c638ff None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:02.802956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7e52b-ea2f-4373-a170-909900fe9cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:02.803619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7e52b-ea2f-4373-a170-909900fe9cc3 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:02.803905 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7e52b-ea2f-4373-a170-909900fe9cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:02.804185 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7e52b-ea2f-4373-a170-909900fe9cc3 None admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:02.804950 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7e52b-ea2f-4373-a170-909900fe9cc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:02.805261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7e52b-ea2f-4373-a170-909900fe9cc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:02.806722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7e52b-ea2f-4373-a170-909900fe9cc3 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:02.819792 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 413/831] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:43:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:02.825444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3c5c7-0246-48f3-8c3c-bd77338606f1 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:02.883764 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:02.928440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3c5c7-0246-48f3-8c3c-bd77338606f1 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:02.963108 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75baccc-18da-4595-93ae-c52804a64e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:02.964172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75baccc-18da-4595-93ae-c52804a64e9b None admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:02.964655 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75baccc-18da-4595-93ae-c52804a64e9b None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:02.965162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75baccc-18da-4595-93ae-c52804a64e9b None admin] PATH_INFO: `/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/382ff6087bf4486d8651162880825eb2/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:02.967306 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75baccc-18da-4595-93ae-c52804a64e9b None admin] RBAC: Authorizing `identity:create_grant(project_id=28b7995e83524b9293d1c6fc319e5a85, user_id=382ff6087bf4486d8651162880825eb2, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:02.969622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75baccc-18da-4595-93ae-c52804a64e9b None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:03.037910 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 419/832] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:43:02 2022] PUT /identity/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/382ff6087bf4486d8651162880825eb2/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:43:03.653582 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92692633-9ff0-4903-a939-b94945ba0398 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:03.654890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92692633-9ff0-4903-a939-b94945ba0398 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:03.656117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92692633-9ff0-4903-a939-b94945ba0398 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:03.658218 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 414/833] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:03.663955 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f7564-d370-4d69-872f-ed49a0ce5f3e None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:03.664571 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f7564-d370-4d69-872f-ed49a0ce5f3e None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:03.665060 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f7564-d370-4d69-872f-ed49a0ce5f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:03.685011 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-913f7564-d370-4d69-872f-ed49a0ce5f3e None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:03.686638 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-913f7564-d370-4d69-872f-ed49a0ce5f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:03.740577 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133be61e-0ec5-4967-82a7-1677aa22b472 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:03.740919 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133be61e-0ec5-4967-82a7-1677aa22b472 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:03.741146 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133be61e-0ec5-4967-82a7-1677aa22b472 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:03.742803 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 415/834] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:03.748485 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6396b8d-016f-4ca9-94c2-58f66a2f6ad1 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:03.748773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6396b8d-016f-4ca9-94c2-58f66a2f6ad1 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:03.749114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6396b8d-016f-4ca9-94c2-58f66a2f6ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:03.765503 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 420/835] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 03:43:03.774715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-a6396b8d-016f-4ca9-94c2-58f66a2f6ad1 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:03.776963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a6396b8d-016f-4ca9-94c2-58f66a2f6ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:03.793285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f7564-d370-4d69-872f-ed49a0ce5f3e None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:03.856658 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:03.877069 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 416/836] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:03.900955 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6396b8d-016f-4ca9-94c2-58f66a2f6ad1 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:03.926265 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:03.940512 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f7564-d370-4d69-872f-ed49a0ce5f3e None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:03.990259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556ae92-dc2e-4c02-aae6-2ce2730dc074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:03.990952 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556ae92-dc2e-4c02-aae6-2ce2730dc074 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:03.991399 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556ae92-dc2e-4c02-aae6-2ce2730dc074 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:03.991694 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556ae92-dc2e-4c02-aae6-2ce2730dc074 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:04.004987 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556ae92-dc2e-4c02-aae6-2ce2730dc074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:43:04.011053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-2556ae92-dc2e-4c02-aae6-2ce2730dc074 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:43:04.011053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:04.011053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:04.011053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:04.011053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:04.011053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:04.011053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:04.011053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:04.011053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:04.011053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:04.011053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:04.011053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:04.011053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:43:04.011053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:43:04.011053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:43:04.011053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:43:04.012936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:43:04.012936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:43:04.012936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:43:04.012936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:43:04.012936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:04.012936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:04.012936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:04.012936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:04.012936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:04.012936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:04.012936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:04.012936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:04.012936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:04.012936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:04.012936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:04.012936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:04.013780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:04.013780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:04.013780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:04.013780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:04.013780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:43:04.013780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:43:04.013780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:43:04.013780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:43:04.013780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:43:04.013780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:43:04.013780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:43:04.013780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:04.018536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 421/837] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:43:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:04.019545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556ae92-dc2e-4c02-aae6-2ce2730dc074 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:04.070828 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6396b8d-016f-4ca9-94c2-58f66a2f6ad1 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:04.135363 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63616fa3-7c13-4061-aa4d-034ffeaa15c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:04.136441 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63616fa3-7c13-4061-aa4d-034ffeaa15c4 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:04.136925 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63616fa3-7c13-4061-aa4d-034ffeaa15c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:04.137410 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63616fa3-7c13-4061-aa4d-034ffeaa15c4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:04.138551 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63616fa3-7c13-4061-aa4d-034ffeaa15c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:04.141216 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63616fa3-7c13-4061-aa4d-034ffeaa15c4 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:04.148834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556ae92-dc2e-4c02-aae6-2ce2730dc074 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:04.158403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-63616fa3-7c13-4061-aa4d-034ffeaa15c4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 03:43:04.158403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:04.158403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:43:04.158403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:43:04.158403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:43:04.158403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:43:04.158403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:43:04.158403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:04.158403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 03:43:04.158403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:04.158403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:04.158403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:04.158403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:04.158403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:04.158403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:04.158403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:04.159790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:04.159790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:04.159790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:04.159790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:04.159790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:04.159790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:04.159790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:04.159790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:43:04.159790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:43:04.159790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:43:04.159790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:43:04.159790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:04.159790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:04.159790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:04.159790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:04.159790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:04.160606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:04.160606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:04.160606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:04.160606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:04.160606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:04.160606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:04.160606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:04.160606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:04.160606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:04.160606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:04.160606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:04.160606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:43:04.160606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:04.160606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 03:43:04.160606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:04.162127 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 417/838] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Jul 28 03:43:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:04.162890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6b55d-8024-4b31-bedb-d0b2fcdc3b8d None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:04.163405 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6b55d-8024-4b31-bedb-d0b2fcdc3b8d None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:04.163967 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6b55d-8024-4b31-bedb-d0b2fcdc3b8d None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:04.164892 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:04.167360 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 418/839] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:04.167774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6b55d-8024-4b31-bedb-d0b2fcdc3b8d None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:04.205158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9ef44-d1a6-44ba-af9a-59cd72ae1c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:04.206108 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9ef44-d1a6-44ba-af9a-59cd72ae1c88 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:04.207473 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9ef44-d1a6-44ba-af9a-59cd72ae1c88 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:04.207473 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9ef44-d1a6-44ba-af9a-59cd72ae1c88 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:04.207473 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9ef44-d1a6-44ba-af9a-59cd72ae1c88 None admin] RBAC: Adding query filter params (name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:04.207907 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9ef44-d1a6-44ba-af9a-59cd72ae1c88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:04.209104 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9ef44-d1a6-44ba-af9a-59cd72ae1c88 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:04.224575 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 422/840] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:43:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:04.224575 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bafaf-5c31-44b2-ba8b-f5e327b7d507 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:04.224575 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bafaf-5c31-44b2-ba8b-f5e327b7d507 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:04.224575 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bafaf-5c31-44b2-ba8b-f5e327b7d507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:04.247225 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-ed8bafaf-5c31-44b2-ba8b-f5e327b7d507 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:04.248473 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ed8bafaf-5c31-44b2-ba8b-f5e327b7d507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:04.287092 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:04.308876 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6b55d-8024-4b31-bedb-d0b2fcdc3b8d None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:04.335697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 423/841] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:04.337641 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bafaf-5c31-44b2-ba8b-f5e327b7d507 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:04.350544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bae9f8-77a5-4440-8a8c-990308d88911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:04.352063 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bae9f8-77a5-4440-8a8c-990308d88911 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:04.352634 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bae9f8-77a5-4440-8a8c-990308d88911 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:04.352838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bae9f8-77a5-4440-8a8c-990308d88911 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:04.353510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bae9f8-77a5-4440-8a8c-990308d88911 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:04.353818 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bae9f8-77a5-4440-8a8c-990308d88911 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:04.355246 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bae9f8-77a5-4440-8a8c-990308d88911 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:04.361287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 419/842] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 28 03:43:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:04.362175 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bae9f8-77a5-4440-8a8c-990308d88911 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:04.446802 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:04.450707 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bafaf-5c31-44b2-ba8b-f5e327b7d507 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:04.477434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bae9f8-77a5-4440-8a8c-990308d88911 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:04.485573 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b402b3-3d60-408a-a79b-67b136e92419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:04.486230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b402b3-3d60-408a-a79b-67b136e92419 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:04.486511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b402b3-3d60-408a-a79b-67b136e92419 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:04.486787 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b402b3-3d60-408a-a79b-67b136e92419 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:04.497890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b402b3-3d60-408a-a79b-67b136e92419 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:04.500189 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b402b3-3d60-408a-a79b-67b136e92419 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:04.515852 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0857dc-bb99-47fd-b2a8-7ed473c88254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:04.516450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-00b402b3-3d60-408a-a79b-67b136e92419 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:04.516450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:04.516450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:04.516450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:04.516450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:04.516450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:04.516450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:04.516450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:04.516450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:04.516450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:04.516450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:04.516450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:04.516450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:43:04.516450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:43:04.516450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:43:04.517517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:43:04.517517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:04.517517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:04.517517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:04.517517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:04.517517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:04.517517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:04.517517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:04.517517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:04.517517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:04.517517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:04.517517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:04.517517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:04.517517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:04.517517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:04.517517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:04.517517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:04.519085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:43:04.519085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:43:04.519085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:04.519085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:04.519450 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0857dc-bb99-47fd-b2a8-7ed473c88254 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:04.519450 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0857dc-bb99-47fd-b2a8-7ed473c88254 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:04.519880 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0857dc-bb99-47fd-b2a8-7ed473c88254 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:04.520607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0857dc-bb99-47fd-b2a8-7ed473c88254 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:04.522250 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0857dc-bb99-47fd-b2a8-7ed473c88254 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:04.522384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 424/843] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:04.523239 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b402b3-3d60-408a-a79b-67b136e92419 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:04.533713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-eb0857dc-bb99-47fd-b2a8-7ed473c88254 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 03:43:04.533713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:04.533713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:43:04.533713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:43:04.533713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:43:04.533713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:43:04.533713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:43:04.533713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:04.533713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 03:43:04.533713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:04.533713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:04.533713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:04.533713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:04.533713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:04.533713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:04.533713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:04.533713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:04.534998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:04.534998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:04.534998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:04.534998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:04.534998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:04.534998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:04.534998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:43:04.534998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:43:04.534998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:43:04.534998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:43:04.534998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:04.534998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:04.534998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:04.534998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:04.534998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:04.534998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:04.536084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:04.536084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:04.536084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:04.536084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:04.536084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:04.536084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:04.536084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:04.536084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:04.536084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:04.536084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:04.536084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:43:04.536084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:04.536084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 03:43:04.536084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:04.540024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 420/844] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:43:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:04.540975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0857dc-bb99-47fd-b2a8-7ed473c88254 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:04.552276 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:04.636870 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b402b3-3d60-408a-a79b-67b136e92419 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:04.661359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0857dc-bb99-47fd-b2a8-7ed473c88254 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:04.674659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0e1b7-6471-4233-96ee-3bc0f6159735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:04.675311 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0e1b7-6471-4233-96ee-3bc0f6159735 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:04.675616 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0e1b7-6471-4233-96ee-3bc0f6159735 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:04.675999 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0e1b7-6471-4233-96ee-3bc0f6159735 None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:04.676687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0e1b7-6471-4233-96ee-3bc0f6159735 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:04.676986 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0e1b7-6471-4233-96ee-3bc0f6159735 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:04.678404 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0e1b7-6471-4233-96ee-3bc0f6159735 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:04.683076 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 425/845] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 28 03:43:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:04.683903 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0e1b7-6471-4233-96ee-3bc0f6159735 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:04.709471 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4c667-2e71-4ed6-b505-19fa7e29ce9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:04.710187 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:04.711388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4c667-2e71-4ed6-b505-19fa7e29ce9b None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:04.711829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4c667-2e71-4ed6-b505-19fa7e29ce9b None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:04.712254 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4c667-2e71-4ed6-b505-19fa7e29ce9b None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:04.713133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4c667-2e71-4ed6-b505-19fa7e29ce9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:04.713622 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4c667-2e71-4ed6-b505-19fa7e29ce9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:04.715217 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4c667-2e71-4ed6-b505-19fa7e29ce9b None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:04.736906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 421/846] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:04.736906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4c667-2e71-4ed6-b505-19fa7e29ce9b None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:04.821099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:04.850587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0e1b7-6471-4233-96ee-3bc0f6159735 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:04.862686 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4c667-2e71-4ed6-b505-19fa7e29ce9b None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:04.898585 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf0978-7236-4480-87ac-aec695b11760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:04.899217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf0978-7236-4480-87ac-aec695b11760 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:04.899500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf0978-7236-4480-87ac-aec695b11760 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:04.899783 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf0978-7236-4480-87ac-aec695b11760 None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:04.900465 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf0978-7236-4480-87ac-aec695b11760 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:04.900761 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf0978-7236-4480-87ac-aec695b11760 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:04.902149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf0978-7236-4480-87ac-aec695b11760 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:04.908230 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d91fa3-33bb-44f8-b031-03f2dfa37b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:04.908385 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 426/847] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:43:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:04.908462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d91fa3-33bb-44f8-b031-03f2dfa37b0a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:04.909154 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d91fa3-33bb-44f8-b031-03f2dfa37b0a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:04.909154 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d91fa3-33bb-44f8-b031-03f2dfa37b0a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:04.914876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf0978-7236-4480-87ac-aec695b11760 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:04.921642 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d91fa3-33bb-44f8-b031-03f2dfa37b0a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:04.923105 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d91fa3-33bb-44f8-b031-03f2dfa37b0a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:04.935801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-a4d91fa3-33bb-44f8-b031-03f2dfa37b0a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 03:43:04.935801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:04.935801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:04.935801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:04.935801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:04.935801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:04.935801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:04.935801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:04.935801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:04.935801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:04.935801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:04.935801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:04.935801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:43:04.935801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:43:04.935801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:43:04.935801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:43:04.936964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:04.936964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:04.936964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:43:04.936964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:04.936964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:43:04.936964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:04.936964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:04.936964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:04.936964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:04.936964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:04.936964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:04.936964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:04.936964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:04.936964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:04.936964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:04.936964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:04.936964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:04.936964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:04.937912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:04.937912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:04.937912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:43:04.937912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:43:04.937912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:43:04.937912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:43:04.937912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:43:04.937912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:43:04.937912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 03:43:04.937912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:04.941910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 422/848] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 28 03:43:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:04.942978 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d91fa3-33bb-44f8-b031-03f2dfa37b0a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:05.049183 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf0978-7236-4480-87ac-aec695b11760 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:05.053339 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:05.058613 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d91fa3-33bb-44f8-b031-03f2dfa37b0a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:05.088481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:05.096961 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c6485-e6d1-4e52-9985-91850d084d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:05.097732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d38542-d642-4460-a8d6-ccafbf5d3bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:05.097996 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c6485-e6d1-4e52-9985-91850d084d2e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:05.098421 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c6485-e6d1-4e52-9985-91850d084d2e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:05.098739 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d38542-d642-4460-a8d6-ccafbf5d3bb3 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:05.099021 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c6485-e6d1-4e52-9985-91850d084d2e None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:05.099203 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d38542-d642-4460-a8d6-ccafbf5d3bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:05.099601 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d38542-d642-4460-a8d6-ccafbf5d3bb3 None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:05.100172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c6485-e6d1-4e52-9985-91850d084d2e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:05.100619 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c6485-e6d1-4e52-9985-91850d084d2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:05.100746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d38542-d642-4460-a8d6-ccafbf5d3bb3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:05.101135 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d38542-d642-4460-a8d6-ccafbf5d3bb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:05.102448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c6485-e6d1-4e52-9985-91850d084d2e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:05.102773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d38542-d642-4460-a8d6-ccafbf5d3bb3 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:05.115745 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 427/849] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:43:04 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:05.129607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 423/850] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 28 03:43:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:05.135581 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c6485-e6d1-4e52-9985-91850d084d2e None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:05.251153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c6485-e6d1-4e52-9985-91850d084d2e None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:05.291274 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed322ba-34de-4a32-8e00-49ae51b2124a None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:05.291625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed322ba-34de-4a32-8e00-49ae51b2124a None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:05.291868 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed322ba-34de-4a32-8e00-49ae51b2124a None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:05.293641 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 424/851] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:05.295047 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee0fb6-82d1-4d8e-bbc5-fe82c9a0b593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:05.295716 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee0fb6-82d1-4d8e-bbc5-fe82c9a0b593 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:05.296582 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee0fb6-82d1-4d8e-bbc5-fe82c9a0b593 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:05.296855 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee0fb6-82d1-4d8e-bbc5-fe82c9a0b593 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:05.299951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abd26b-f438-487e-a302-a4b9e9cc885f None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:05.300187 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abd26b-f438-487e-a302-a4b9e9cc885f None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:05.300464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abd26b-f438-487e-a302-a4b9e9cc885f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:05.311166 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:05.321690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-d1abd26b-f438-487e-a302-a4b9e9cc885f None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:05.327081 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-d1abd26b-f438-487e-a302-a4b9e9cc885f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:05.382513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee0fb6-82d1-4d8e-bbc5-fe82c9a0b593 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:05.384592 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee0fb6-82d1-4d8e-bbc5-fe82c9a0b593 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:05.417296 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 425/852] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 03:43:05.440338 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abd26b-f438-487e-a302-a4b9e9cc885f None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:05.507959 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 428/853] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:43:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:43:05.520304 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee0fb6-82d1-4d8e-bbc5-fe82c9a0b593 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:05.569911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abd26b-f438-487e-a302-a4b9e9cc885f None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:05.579382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:05.595452 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:05.619262 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27601e-e116-4d12-a2db-0c78f4eeec05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:05.620293 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27601e-e116-4d12-a2db-0c78f4eeec05 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:05.620743 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27601e-e116-4d12-a2db-0c78f4eeec05 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:05.621755 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27601e-e116-4d12-a2db-0c78f4eeec05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:05.636121 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27601e-e116-4d12-a2db-0c78f4eeec05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:43:05.643851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-1f27601e-e116-4d12-a2db-0c78f4eeec05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:43:05.643851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:05.643851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:05.643851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:05.643851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:05.643851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:05.643851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:05.643851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:05.643851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:05.643851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:05.643851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:05.643851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:05.643851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:43:05.643851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:43:05.643851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:43:05.643851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:43:05.645012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:43:05.645012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:43:05.645012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:43:05.645012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:43:05.645012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:05.645012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:05.645012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:05.645012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:05.645012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:05.645012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:05.645012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:05.645012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:05.645012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:05.645012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:05.645012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:05.645012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:05.646038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:05.646038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:05.646038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:05.646038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:05.646038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:43:05.646038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:43:05.646038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:43:05.646038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:43:05.646038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:43:05.646038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:43:05.646038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:43:05.646038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:05.648939 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 426/854] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:43:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:05.659418 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27601e-e116-4d12-a2db-0c78f4eeec05 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:05.659593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee0fb6-82d1-4d8e-bbc5-fe82c9a0b593 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:05.708543 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd8e95-939d-4f65-b290-70f368150293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:05.709677 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd8e95-939d-4f65-b290-70f368150293 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:05.710159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd8e95-939d-4f65-b290-70f368150293 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:05.710730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd8e95-939d-4f65-b290-70f368150293 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:05.723826 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd8e95-939d-4f65-b290-70f368150293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:05.725704 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd8e95-939d-4f65-b290-70f368150293 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:05.742828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-1ebd8e95-939d-4f65-b290-70f368150293 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:05.742828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:05.742828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:05.742828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:05.742828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:05.742828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:05.742828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:05.742828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:05.742828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:05.742828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:05.742828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:05.742828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:05.742828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:43:05.742828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:43:05.742828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:43:05.747807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:43:05.747807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:05.747807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:05.747807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:05.747807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:05.747807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:05.747807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:05.747807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:05.747807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:05.747807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:05.747807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:05.747807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:05.747807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:05.747807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:05.747807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:05.747807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:05.747807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:05.748708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:43:05.748708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:43:05.748708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:05.748708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:05.748708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 429/855] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:05.751946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd8e95-939d-4f65-b290-70f368150293 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:05.775484 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27601e-e116-4d12-a2db-0c78f4eeec05 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:05.813436 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2138ca-6172-4642-9934-e1a896958bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:05.813777 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2138ca-6172-4642-9934-e1a896958bb5 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:05.814069 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2138ca-6172-4642-9934-e1a896958bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:05.814350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2138ca-6172-4642-9934-e1a896958bb5 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:05.815081 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2138ca-6172-4642-9934-e1a896958bb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:05.815409 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2138ca-6172-4642-9934-e1a896958bb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:05.816848 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2138ca-6172-4642-9934-e1a896958bb5 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:05.831453 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 427/856] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:43:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:05.832338 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2138ca-6172-4642-9934-e1a896958bb5 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:05.861766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:05.869384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd8e95-939d-4f65-b290-70f368150293 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:05.874781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:05.908654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77911545-69a7-44be-a49d-5306f1d37ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:05.910005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77911545-69a7-44be-a49d-5306f1d37ad3 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:05.910520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77911545-69a7-44be-a49d-5306f1d37ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:05.910995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77911545-69a7-44be-a49d-5306f1d37ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:05.911931 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77911545-69a7-44be-a49d-5306f1d37ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:05.912441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77911545-69a7-44be-a49d-5306f1d37ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:05.914038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77911545-69a7-44be-a49d-5306f1d37ad3 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:05.928104 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 430/857] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:05.933811 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77911545-69a7-44be-a49d-5306f1d37ad3 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:05.947045 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2138ca-6172-4642-9934-e1a896958bb5 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:05.991797 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a311f8-7fb0-4f72-a967-8a4a2e46ac4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:05.992835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a311f8-7fb0-4f72-a967-8a4a2e46ac4f None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:05.993340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a311f8-7fb0-4f72-a967-8a4a2e46ac4f None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:05.993831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a311f8-7fb0-4f72-a967-8a4a2e46ac4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:06.005018 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a311f8-7fb0-4f72-a967-8a4a2e46ac4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:06.006739 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a311f8-7fb0-4f72-a967-8a4a2e46ac4f None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:06.022240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-62a311f8-7fb0-4f72-a967-8a4a2e46ac4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:06.022240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:06.022240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:06.022240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:06.022240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:06.022240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:06.022240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:06.022240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:06.022240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:06.022240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:06.022240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:06.022240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:06.022240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:43:06.022240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:43:06.022240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:43:06.023166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:43:06.023166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:06.023166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:06.023166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:06.023166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:06.023166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:06.023166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:06.023166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:06.023166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:06.023166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:06.023166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:06.023166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:06.023166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:06.023166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:06.023166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:06.023166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:06.023166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:06.024451 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:43:06.024451 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:43:06.024451 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:06.024451 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:06.031106 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 428/858] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:06.032194 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a311f8-7fb0-4f72-a967-8a4a2e46ac4f None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:06.051634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77911545-69a7-44be-a49d-5306f1d37ad3 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:06.090579 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6f81f-d254-49af-bf9e-d28f627ced1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:06.091212 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6f81f-d254-49af-bf9e-d28f627ced1d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:06.091516 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6f81f-d254-49af-bf9e-d28f627ced1d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:06.091835 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6f81f-d254-49af-bf9e-d28f627ced1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:06.099959 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6f81f-d254-49af-bf9e-d28f627ced1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:06.101472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6f81f-d254-49af-bf9e-d28f627ced1d None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:06.113793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-5eb6f81f-d254-49af-bf9e-d28f627ced1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:06.113793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:06.113793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:06.113793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:06.113793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:06.113793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:06.113793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:06.113793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:06.113793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:06.113793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:06.113793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:06.113793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:06.113793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:43:06.113793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:43:06.113793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:43:06.114754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:43:06.114754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:06.114754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:06.114754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:06.114754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:06.114754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:06.114754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:06.114754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:06.114754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:06.114754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:06.114754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:06.114754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:06.114754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:06.114754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:06.114754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:06.114754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:06.114754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:06.115679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:43:06.115679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:43:06.115679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:43:06.115679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:43:06.115679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:43:06.115679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:43:06.115679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:06.115679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:06.119812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 431/859] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:43:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:06.120962 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6f81f-d254-49af-bf9e-d28f627ced1d None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:06.137205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:06.139507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:06.147293 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a311f8-7fb0-4f72-a967-8a4a2e46ac4f None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:06.184989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f86462-5d29-44d8-b2fa-c212cc739b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:06.186381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f86462-5d29-44d8-b2fa-c212cc739b50 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:06.186381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f86462-5d29-44d8-b2fa-c212cc739b50 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:06.186914 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f86462-5d29-44d8-b2fa-c212cc739b50 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:06.187882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f86462-5d29-44d8-b2fa-c212cc739b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:06.188447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f86462-5d29-44d8-b2fa-c212cc739b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:06.190055 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f86462-5d29-44d8-b2fa-c212cc739b50 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:06.206947 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 429/860] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:06.208153 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f86462-5d29-44d8-b2fa-c212cc739b50 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:06.231190 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6f81f-d254-49af-bf9e-d28f627ced1d None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:06.269611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638a945-b538-42bd-afd4-275b7b350a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:06.270209 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638a945-b538-42bd-afd4-275b7b350a83 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:06.270490 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638a945-b538-42bd-afd4-275b7b350a83 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:06.270771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638a945-b538-42bd-afd4-275b7b350a83 None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:06.271547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638a945-b538-42bd-afd4-275b7b350a83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:06.271860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638a945-b538-42bd-afd4-275b7b350a83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:06.273418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638a945-b538-42bd-afd4-275b7b350a83 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:06.292018 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 432/861] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:43:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:06.292929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638a945-b538-42bd-afd4-275b7b350a83 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:06.319688 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f86462-5d29-44d8-b2fa-c212cc739b50 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:06.356421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170eb9a-cc5c-4ba9-9e03-6f4b4de7db00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:06.357455 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170eb9a-cc5c-4ba9-9e03-6f4b4de7db00 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:06.357964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170eb9a-cc5c-4ba9-9e03-6f4b4de7db00 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:06.359154 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170eb9a-cc5c-4ba9-9e03-6f4b4de7db00 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:06.367921 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170eb9a-cc5c-4ba9-9e03-6f4b4de7db00 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:06.369728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170eb9a-cc5c-4ba9-9e03-6f4b4de7db00 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:06.374756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:06.382815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-c170eb9a-cc5c-4ba9-9e03-6f4b4de7db00 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 03:43:06.382815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:06.382815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:06.382815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:06.382815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:06.382815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:06.382815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:06.382815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:06.382815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:06.382815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:06.382815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:06.382815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:06.382815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:43:06.382815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:43:06.382815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:43:06.382815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:43:06.390579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:06.390579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:06.390579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:43:06.390579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:06.390579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:43:06.390579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:06.390579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:06.390579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:06.390579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:06.390579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:06.390579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:06.390579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:06.390579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:06.390579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:06.390579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:06.390579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:06.390579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:06.390579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:06.391527 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:06.391527 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:06.391527 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:43:06.391527 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:43:06.391527 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:43:06.391527 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:43:06.391527 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:43:06.391527 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:43:06.391527 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 03:43:06.391527 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:06.392601 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 430/862] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:43:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:06.393750 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170eb9a-cc5c-4ba9-9e03-6f4b4de7db00 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:06.401782 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638a945-b538-42bd-afd4-275b7b350a83 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:06.427736 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:06.438646 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329788d-59ee-4f6d-91df-2682cf6e7aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:06.439278 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329788d-59ee-4f6d-91df-2682cf6e7aa3 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:06.439590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329788d-59ee-4f6d-91df-2682cf6e7aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:06.439855 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329788d-59ee-4f6d-91df-2682cf6e7aa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:06.440651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329788d-59ee-4f6d-91df-2682cf6e7aa3 None admin] RBAC: Adding query filter params (role.id=183fd05fe14a41828222fd09b6280796, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=420e2a81b66a470e8db624efd61fd1cd) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:06.440961 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329788d-59ee-4f6d-91df-2682cf6e7aa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:06.442405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329788d-59ee-4f6d-91df-2682cf6e7aa3 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:06.455635 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 433/863] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:43:06 2022] GET /identity/v3/role_assignments?user.id=420e2a81b66a470e8db624efd61fd1cd&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=183fd05fe14a41828222fd09b6280796 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:06.509408 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170eb9a-cc5c-4ba9-9e03-6f4b4de7db00 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:06.549151 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e648b01-c3b7-42e4-84dc-c9923c969399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:06.550184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e648b01-c3b7-42e4-84dc-c9923c969399 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:06.550665 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e648b01-c3b7-42e4-84dc-c9923c969399 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:06.551159 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e648b01-c3b7-42e4-84dc-c9923c969399 None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:06.552242 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e648b01-c3b7-42e4-84dc-c9923c969399 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:06.552766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e648b01-c3b7-42e4-84dc-c9923c969399 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:06.554660 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e648b01-c3b7-42e4-84dc-c9923c969399 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:06.577489 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 431/864] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 28 03:43:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:06.584101 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329788d-59ee-4f6d-91df-2682cf6e7aa3 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:06.696605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329788d-59ee-4f6d-91df-2682cf6e7aa3 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:06.733050 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485454e-5fdd-4ec1-b0d4-53c0472311ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:06.734067 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485454e-5fdd-4ec1-b0d4-53c0472311ca None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:06.734348 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485454e-5fdd-4ec1-b0d4-53c0472311ca None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:06.734620 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485454e-5fdd-4ec1-b0d4-53c0472311ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:06.743761 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:06.808296 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485454e-5fdd-4ec1-b0d4-53c0472311ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:06.809765 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485454e-5fdd-4ec1-b0d4-53c0472311ca None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:06.851254 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9d5e4-fa38-441b-82e3-3eee248ee081 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:06.851834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9d5e4-fa38-441b-82e3-3eee248ee081 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:06.851834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9d5e4-fa38-441b-82e3-3eee248ee081 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:06.854753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 432/865] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:43:06.859023 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d8aee-a007-4133-bb59-34c2114b9bf0 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:06.859313 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d8aee-a007-4133-bb59-34c2114b9bf0 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:06.859702 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d8aee-a007-4133-bb59-34c2114b9bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:06.878779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-287d8aee-a007-4133-bb59-34c2114b9bf0 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:06.880270 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-287d8aee-a007-4133-bb59-34c2114b9bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:06.927355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 434/866] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:43:06 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:43:06.929741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485454e-5fdd-4ec1-b0d4-53c0472311ca None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:06.966412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:06.974411 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 433/867] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 03:43:06.980133 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:06.996673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d8aee-a007-4133-bb59-34c2114b9bf0 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:07.050692 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485454e-5fdd-4ec1-b0d4-53c0472311ca None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:07.090535 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb75559-029f-44fb-8d2c-ed9ffa1d56a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:07.091546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb75559-029f-44fb-8d2c-ed9ffa1d56a9 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:07.092031 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb75559-029f-44fb-8d2c-ed9ffa1d56a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:07.093103 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb75559-029f-44fb-8d2c-ed9ffa1d56a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:07.102843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d8aee-a007-4133-bb59-34c2114b9bf0 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:07.105291 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb75559-029f-44fb-8d2c-ed9ffa1d56a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:07.106950 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb75559-029f-44fb-8d2c-ed9ffa1d56a9 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:07.125305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-2eb75559-029f-44fb-8d2c-ed9ffa1d56a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:07.125305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:07.125305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:07.125305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:07.125305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:07.125305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:07.125305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:07.125305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:07.125305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:07.125305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:07.125305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:07.125305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:07.125305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:43:07.125305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:43:07.125305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:43:07.126394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:43:07.126394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:07.126394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:07.126394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:07.126394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:07.126394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:07.126394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:07.126394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:07.126394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:07.126394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:07.126394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:07.126394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:07.126394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:07.126394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:07.126394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:07.126394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:07.126394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:07.127382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:43:07.127382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:43:07.127382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:07.127382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:07.134134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 435/868] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:07.135771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb75559-029f-44fb-8d2c-ed9ffa1d56a9 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:07.141233 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e9204-fa6e-4ce0-a76b-bf1d91bc7072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:07.141923 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e9204-fa6e-4ce0-a76b-bf1d91bc7072 None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:07.142199 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e9204-fa6e-4ce0-a76b-bf1d91bc7072 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:07.142466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e9204-fa6e-4ce0-a76b-bf1d91bc7072 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:07.143164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e9204-fa6e-4ce0-a76b-bf1d91bc7072 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:07.144657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e9204-fa6e-4ce0-a76b-bf1d91bc7072 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:07.219765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 434/869] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 28 03:43:06 2022] POST /identity/v3/services => generated 269 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:43:07.240376 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:07.252873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb75559-029f-44fb-8d2c-ed9ffa1d56a9 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:07.264351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c14c73-fe40-40d3-a90e-abc061410841 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:07.265429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c14c73-fe40-40d3-a90e-abc061410841 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:07.265926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c14c73-fe40-40d3-a90e-abc061410841 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:07.267710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 435/870] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:43:07.273453 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab53b2-bc8e-4146-ba6a-d953ef4723d5 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:07.273738 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab53b2-bc8e-4146-ba6a-d953ef4723d5 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:07.274018 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab53b2-bc8e-4146-ba6a-d953ef4723d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:07.294318 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-40ab53b2-bc8e-4146-ba6a-d953ef4723d5 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:07.295616 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-40ab53b2-bc8e-4146-ba6a-d953ef4723d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:07.303519 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e920ab-a387-4073-beee-d4ef8991ddf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:07.304455 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e920ab-a387-4073-beee-d4ef8991ddf2 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:07.304901 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e920ab-a387-4073-beee-d4ef8991ddf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:07.305481 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e920ab-a387-4073-beee-d4ef8991ddf2 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:07.306204 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e920ab-a387-4073-beee-d4ef8991ddf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:07.306560 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e920ab-a387-4073-beee-d4ef8991ddf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:07.308046 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e920ab-a387-4073-beee-d4ef8991ddf2 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:07.327452 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 436/871] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:07.328834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e920ab-a387-4073-beee-d4ef8991ddf2 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:07.367722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:07.380217 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 436/872] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:07 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 03:43:07.402389 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab53b2-bc8e-4146-ba6a-d953ef4723d5 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:07.456526 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e920ab-a387-4073-beee-d4ef8991ddf2 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:07.505060 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609937c-5f9b-4c79-bd3a-cff37a7fbb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:07.506257 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609937c-5f9b-4c79-bd3a-cff37a7fbb5a None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:07.506724 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609937c-5f9b-4c79-bd3a-cff37a7fbb5a None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:07.507475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609937c-5f9b-4c79-bd3a-cff37a7fbb5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:07.517165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609937c-5f9b-4c79-bd3a-cff37a7fbb5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:07.520117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609937c-5f9b-4c79-bd3a-cff37a7fbb5a None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:07.528255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab53b2-bc8e-4146-ba6a-d953ef4723d5 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:07.537615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-e609937c-5f9b-4c79-bd3a-cff37a7fbb5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:07.537615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:07.537615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:07.537615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:07.537615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:07.537615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:07.537615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:07.537615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:07.537615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:07.537615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:07.537615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:07.537615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:07.537615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:43:07.537615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:43:07.537615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:43:07.538545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:43:07.538545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:07.538545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:07.538545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:07.538545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:07.538545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:07.538545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:07.538545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:07.538545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:07.538545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:07.538545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:07.538545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:07.538545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:07.538545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:07.538545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:07.538545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:07.538545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:07.539461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:43:07.539461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:43:07.539461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:43:07.539461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:43:07.539461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:43:07.539461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:43:07.539461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:07.539461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:07.545565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 437/873] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:43:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:07.547937 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609937c-5f9b-4c79-bd3a-cff37a7fbb5a None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:07.558158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:07.575066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a909a3c-c35a-412a-a5d4-72ed6d803623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:07.575992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909a3c-c35a-412a-a5d4-72ed6d803623 None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:07.576454 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909a3c-c35a-412a-a5d4-72ed6d803623 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:07.576890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a909a3c-c35a-412a-a5d4-72ed6d803623 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:07.578209 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a909a3c-c35a-412a-a5d4-72ed6d803623 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:07.579876 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a909a3c-c35a-412a-a5d4-72ed6d803623 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:07.662404 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609937c-5f9b-4c79-bd3a-cff37a7fbb5a None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:07.703362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 437/874] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 28 03:43:07 2022] POST /identity/v3/services => generated 251 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:43:07.714954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77504c-3c9b-4c51-af35-7c5647d22cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:07.718776 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77504c-3c9b-4c51-af35-7c5647d22cde None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:07.718776 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77504c-3c9b-4c51-af35-7c5647d22cde None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:07.718776 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77504c-3c9b-4c51-af35-7c5647d22cde None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:07.718776 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77504c-3c9b-4c51-af35-7c5647d22cde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:07.718776 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77504c-3c9b-4c51-af35-7c5647d22cde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:07.720437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77504c-3c9b-4c51-af35-7c5647d22cde None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:07.741444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 438/875] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:43:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:07.743743 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a909a3c-c35a-412a-a5d4-72ed6d803623 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:07.808081 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:07.868309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a909a3c-c35a-412a-a5d4-72ed6d803623 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:07.903474 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bd4bf-6520-4339-ad39-16b33a5e035f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:07.904493 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bd4bf-6520-4339-ad39-16b33a5e035f None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:07.904775 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bd4bf-6520-4339-ad39-16b33a5e035f None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:07.905705 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bd4bf-6520-4339-ad39-16b33a5e035f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:07.906857 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bd4bf-6520-4339-ad39-16b33a5e035f None admin] RBAC: Adding query filter params (role.id=8a5766c4aef44773834941d1bdbd1e98, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=382ff6087bf4486d8651162880825eb2) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:07.907169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bd4bf-6520-4339-ad39-16b33a5e035f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:07.908632 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bd4bf-6520-4339-ad39-16b33a5e035f None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:07.919492 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 438/876] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:43:07 2022] GET /identity/v3/role_assignments?user.id=382ff6087bf4486d8651162880825eb2&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=8a5766c4aef44773834941d1bdbd1e98 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:08.666873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1eaf70-52b7-4c53-920f-255ee1b82f2e None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:08.667443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1eaf70-52b7-4c53-920f-255ee1b82f2e None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:08.667443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1eaf70-52b7-4c53-920f-255ee1b82f2e None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:08.669031 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 439/877] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:08.674357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72591b-cd59-4209-a6f3-684e93d24792 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:08.674652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72591b-cd59-4209-a6f3-684e93d24792 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:08.674931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72591b-cd59-4209-a6f3-684e93d24792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:08.693809 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-1b72591b-cd59-4209-a6f3-684e93d24792 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:08.695008 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-1b72591b-cd59-4209-a6f3-684e93d24792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:08.767664 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 439/878] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:08.790679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1eaf70-52b7-4c53-920f-255ee1b82f2e None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:08.857962 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:08.900430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1eaf70-52b7-4c53-920f-255ee1b82f2e None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:08.940174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5c623-8120-475f-af1b-10e260f75b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:08.941156 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5c623-8120-475f-af1b-10e260f75b48 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:08.941623 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5c623-8120-475f-af1b-10e260f75b48 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:08.942087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5c623-8120-475f-af1b-10e260f75b48 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:08.954345 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5c623-8120-475f-af1b-10e260f75b48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:43:08.959673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-9fa5c623-8120-475f-af1b-10e260f75b48 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 03:43:08.959673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:08.959673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:08.959673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:08.959673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:08.959673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:08.959673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:08.959673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:08.959673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:08.959673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:08.959673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:08.959673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:08.959673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:43:08.959673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:43:08.959673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:43:08.959673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:43:08.960611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:43:08.960611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:43:08.960611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:43:08.960611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:43:08.960611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:08.960611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:08.960611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:08.960611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:08.960611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:08.960611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:08.960611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:08.960611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:08.960611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:08.960611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:08.960611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:08.960611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:08.961444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:08.961444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:08.961444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:08.961444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:08.961444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:43:08.961444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:43:08.961444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:43:08.961444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:43:08.961444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:43:08.961444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:43:08.961444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 03:43:08.961444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:08.963709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 440/879] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 28 03:43:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:08.972515 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72591b-cd59-4209-a6f3-684e93d24792 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:09.018829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:09.079514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72591b-cd59-4209-a6f3-684e93d24792 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:09.117749 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d139b1-ca06-45df-be49-a270b0954f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:09.118652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d139b1-ca06-45df-be49-a270b0954f2c None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:09.119095 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d139b1-ca06-45df-be49-a270b0954f2c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:09.119565 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d139b1-ca06-45df-be49-a270b0954f2c None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:09.120459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d139b1-ca06-45df-be49-a270b0954f2c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:09.120966 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d139b1-ca06-45df-be49-a270b0954f2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:09.122503 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d139b1-ca06-45df-be49-a270b0954f2c None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:09.132504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 440/880] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 28 03:43:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:09.137795 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5c623-8120-475f-af1b-10e260f75b48 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:09.253360 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5c623-8120-475f-af1b-10e260f75b48 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:09.276958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:09.289243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5145e14-dfe8-4cdf-b002-a93dbdd66bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:09.289901 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5145e14-dfe8-4cdf-b002-a93dbdd66bd4 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:09.290184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5145e14-dfe8-4cdf-b002-a93dbdd66bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:09.290462 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5145e14-dfe8-4cdf-b002-a93dbdd66bd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:09.301336 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5145e14-dfe8-4cdf-b002-a93dbdd66bd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:09.302797 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5145e14-dfe8-4cdf-b002-a93dbdd66bd4 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:09.320365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-c5145e14-dfe8-4cdf-b002-a93dbdd66bd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:09.320365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:09.320365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:09.320365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:09.320365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:09.320365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:09.320365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:09.320365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:09.320365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:09.320365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:09.320365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:09.320365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:09.320365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:43:09.320365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:43:09.320365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:43:09.321371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:43:09.321371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:09.321371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:09.321371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:09.321371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:09.321371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:09.321371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:09.321371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:09.321371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:09.321371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:09.321371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:09.321371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:09.321371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:09.321371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:09.321371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:09.321371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:09.321371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:09.322259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:43:09.322259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:43:09.322259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:09.322259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:09.322259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 441/881] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:09.327763 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d139b1-ca06-45df-be49-a270b0954f2c None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:09.383214 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0500e-f99d-4174-9fb4-8de6db03d4d9 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:09.383532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0500e-f99d-4174-9fb4-8de6db03d4d9 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:09.383806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0500e-f99d-4174-9fb4-8de6db03d4d9 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:09.385315 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 442/882] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:09.390559 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab738081-d120-4b32-962e-7823a812e091 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:09.390850 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab738081-d120-4b32-962e-7823a812e091 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:09.391128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab738081-d120-4b32-962e-7823a812e091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:09.410051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-ab738081-d120-4b32-962e-7823a812e091 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:09.411346 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ab738081-d120-4b32-962e-7823a812e091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:09.435441 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d139b1-ca06-45df-be49-a270b0954f2c None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:09.439893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:09.482205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d48db-0216-4656-889e-162cc3ea70d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:09.482829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d48db-0216-4656-889e-162cc3ea70d9 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:09.483681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d48db-0216-4656-889e-162cc3ea70d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:09.483945 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d48db-0216-4656-889e-162cc3ea70d9 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:09.484814 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d48db-0216-4656-889e-162cc3ea70d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:09.485141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d48db-0216-4656-889e-162cc3ea70d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:09.486519 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d48db-0216-4656-889e-162cc3ea70d9 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:09.503479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 441/883] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:09.504520 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d48db-0216-4656-889e-162cc3ea70d9 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:09.515467 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 443/884] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:09.530939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab738081-d120-4b32-962e-7823a812e091 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:09.632322 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d48db-0216-4656-889e-162cc3ea70d9 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:09.642354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab738081-d120-4b32-962e-7823a812e091 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:09.645773 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:09.683552 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb7036-8a40-4912-99a1-39355d937d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:09.684613 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb7036-8a40-4912-99a1-39355d937d9a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:09.685119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb7036-8a40-4912-99a1-39355d937d9a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:09.685588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb7036-8a40-4912-99a1-39355d937d9a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:09.690683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96911bdd-204f-4f85-a326-a929124e68eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:09.691469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96911bdd-204f-4f85-a326-a929124e68eb None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:09.691826 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96911bdd-204f-4f85-a326-a929124e68eb None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:09.692173 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96911bdd-204f-4f85-a326-a929124e68eb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:09.692928 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96911bdd-204f-4f85-a326-a929124e68eb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:09.694392 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96911bdd-204f-4f85-a326-a929124e68eb None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:09.696538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb7036-8a40-4912-99a1-39355d937d9a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:09.698404 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb7036-8a40-4912-99a1-39355d937d9a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:09.706255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-96911bdd-204f-4f85-a326-a929124e68eb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 03:43:09.706255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:09.706255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:43:09.706255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:43:09.706255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:43:09.706255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:43:09.706255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:43:09.706255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:09.706255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 03:43:09.706255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:09.706255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:09.706255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:09.706255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:09.706255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:09.706255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:09.706255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:09.707245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:09.707245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:09.707245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:09.707245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:09.707245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:09.707245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:09.707245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:09.707245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:43:09.707245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:43:09.707245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:43:09.707245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:43:09.707245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:09.707245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:09.707245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:09.707245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:09.707245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:09.708350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:09.708350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:09.708350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:09.708350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:09.708350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:09.708350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:09.708350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:09.708350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:09.708350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:09.708350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:09.708350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:09.708350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:43:09.708350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:09.708350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 03:43:09.708350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:09.712560 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 444/885] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Jul 28 03:43:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:09.713397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96911bdd-204f-4f85-a326-a929124e68eb None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:09.714810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-9ccb7036-8a40-4912-99a1-39355d937d9a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 03:43:09.714810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:09.714810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:09.714810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:09.714810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:09.714810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:09.714810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:09.714810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:09.714810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:09.714810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:09.714810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:09.714810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:09.714810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:43:09.714810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:43:09.714810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:43:09.714810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:43:09.715838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:09.715838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:09.715838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:43:09.715838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:09.715838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:43:09.715838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:09.715838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:09.715838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:09.715838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:09.715838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:09.715838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:09.715838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:09.715838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:09.715838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:09.715838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:09.715838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:09.715838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:09.715838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:09.716779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:09.716779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:09.716779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:43:09.716779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:43:09.716779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:43:09.716779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:43:09.716779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:43:09.716779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:43:09.716779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 03:43:09.716779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:09.723510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 442/886] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 28 03:43:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:09.725925 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb7036-8a40-4912-99a1-39355d937d9a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:09.754918 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:09.846822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb7036-8a40-4912-99a1-39355d937d9a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:09.850455 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96911bdd-204f-4f85-a326-a929124e68eb None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:09.884398 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75062ae9-19e0-41e8-a483-dee8e1603181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:09.885000 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75062ae9-19e0-41e8-a483-dee8e1603181 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:09.885286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75062ae9-19e0-41e8-a483-dee8e1603181 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:09.885565 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75062ae9-19e0-41e8-a483-dee8e1603181 None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:09.886372 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75062ae9-19e0-41e8-a483-dee8e1603181 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:09.886681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75062ae9-19e0-41e8-a483-dee8e1603181 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:09.888397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75062ae9-19e0-41e8-a483-dee8e1603181 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:09.894123 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6a7da-3612-4601-9fbd-f8c86c9c0a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:09.895097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6a7da-3612-4601-9fbd-f8c86c9c0a01 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:09.895621 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6a7da-3612-4601-9fbd-f8c86c9c0a01 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:09.896378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6a7da-3612-4601-9fbd-f8c86c9c0a01 None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:09.897278 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6a7da-3612-4601-9fbd-f8c86c9c0a01 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:09.897919 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6a7da-3612-4601-9fbd-f8c86c9c0a01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:09.900487 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6a7da-3612-4601-9fbd-f8c86c9c0a01 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:09.912594 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 445/887] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 28 03:43:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:09.914249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 443/888] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 28 03:43:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:09.915145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6a7da-3612-4601-9fbd-f8c86c9c0a01 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:09.915253 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75062ae9-19e0-41e8-a483-dee8e1603181 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:09.956088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:10.016376 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:10.034278 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75062ae9-19e0-41e8-a483-dee8e1603181 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:10.043113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6a7da-3612-4601-9fbd-f8c86c9c0a01 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:10.070212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466a387-4ba1-4cdd-99cd-e957b22ac9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:10.070932 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466a387-4ba1-4cdd-99cd-e957b22ac9f2 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:10.071215 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466a387-4ba1-4cdd-99cd-e957b22ac9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:10.071514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466a387-4ba1-4cdd-99cd-e957b22ac9f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:10.082183 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6889c76-dc44-467a-b561-400ed06a0f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:10.082876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6889c76-dc44-467a-b561-400ed06a0f35 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:10.083337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6889c76-dc44-467a-b561-400ed06a0f35 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:10.083743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6889c76-dc44-467a-b561-400ed06a0f35 None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:10.084497 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6889c76-dc44-467a-b561-400ed06a0f35 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:10.084898 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6889c76-dc44-467a-b561-400ed06a0f35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:10.086372 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6889c76-dc44-467a-b561-400ed06a0f35 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:10.091283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 446/889] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 28 03:43:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:10.094377 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fe07c-3145-4915-8d63-5f82fe8d1c04 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:10.094781 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fe07c-3145-4915-8d63-5f82fe8d1c04 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:10.094954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fe07c-3145-4915-8d63-5f82fe8d1c04 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:10.099496 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 447/890] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:10.099496 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38839643-1ffb-44f2-a3b0-b172dc8bca64 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:10.099496 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38839643-1ffb-44f2-a3b0-b172dc8bca64 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:10.099496 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38839643-1ffb-44f2-a3b0-b172dc8bca64 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:10.099838 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 448/891] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:10.100221 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38839643-1ffb-44f2-a3b0-b172dc8bca64 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:10.147209 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466a387-4ba1-4cdd-99cd-e957b22ac9f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:10.148675 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d466a387-4ba1-4cdd-99cd-e957b22ac9f2 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:10.197321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:10.204443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38839643-1ffb-44f2-a3b0-b172dc8bca64 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:10.230409 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:10.238574 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394dfa8-3405-4177-a135-f4ffd9a7d299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:10.239194 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394dfa8-3405-4177-a135-f4ffd9a7d299 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:10.239514 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394dfa8-3405-4177-a135-f4ffd9a7d299 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:10.239788 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394dfa8-3405-4177-a135-f4ffd9a7d299 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:10.243347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394dfa8-3405-4177-a135-f4ffd9a7d299 None admin] RBAC: Adding query filter params (interface=public, service_id=47e763cda8b94c32a9918fd9e38263c7, region_id=RegionOne) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:10.243347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394dfa8-3405-4177-a135-f4ffd9a7d299 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:10.243347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394dfa8-3405-4177-a135-f4ffd9a7d299 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:10.247277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 449/892] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 28 03:43:10 2022] GET /identity/v3/endpoints?service_id=47e763cda8b94c32a9918fd9e38263c7&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:10.248429 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f9442-7f45-4d90-a2b4-72dabd469db5 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:10.248748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f9442-7f45-4d90-a2b4-72dabd469db5 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:10.249148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f9442-7f45-4d90-a2b4-72dabd469db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:10.254523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 444/893] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:43:09 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:43:10.254523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8527b6-3887-4554-925e-f2a4a59d0bd0 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:10.254523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8527b6-3887-4554-925e-f2a4a59d0bd0 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:10.254523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8527b6-3887-4554-925e-f2a4a59d0bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:10.267150 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-938f9442-7f45-4d90-a2b4-72dabd469db5 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:10.268368 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-938f9442-7f45-4d90-a2b4-72dabd469db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:10.272286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-2f8527b6-3887-4554-925e-f2a4a59d0bd0 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:10.273451 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-2f8527b6-3887-4554-925e-f2a4a59d0bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:10.334609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 450/894] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:10.335494 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f9442-7f45-4d90-a2b4-72dabd469db5 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:10.343446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 445/895] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:10.343446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8527b6-3887-4554-925e-f2a4a59d0bd0 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:10.429729 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:10.439602 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f9442-7f45-4d90-a2b4-72dabd469db5 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:10.446711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8527b6-3887-4554-925e-f2a4a59d0bd0 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:10.459658 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:10.472271 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee34c1-036c-4b0f-bdfe-48b973d7a624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:10.472947 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee34c1-036c-4b0f-bdfe-48b973d7a624 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:10.473427 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee34c1-036c-4b0f-bdfe-48b973d7a624 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:10.473856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee34c1-036c-4b0f-bdfe-48b973d7a624 None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:10.474866 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee34c1-036c-4b0f-bdfe-48b973d7a624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:10.476269 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee34c1-036c-4b0f-bdfe-48b973d7a624 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:10.481025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de2fdb-e629-4ac4-972b-0b27e6c82af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:10.481665 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de2fdb-e629-4ac4-972b-0b27e6c82af6 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:10.483811 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de2fdb-e629-4ac4-972b-0b27e6c82af6 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:10.484043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 451/896] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 28 03:43:10 2022] GET /identity/v3/services => generated 1268 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:43:10.484551 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de2fdb-e629-4ac4-972b-0b27e6c82af6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:10.484653 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee34c1-036c-4b0f-bdfe-48b973d7a624 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:10.493646 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de2fdb-e629-4ac4-972b-0b27e6c82af6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:10.495139 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de2fdb-e629-4ac4-972b-0b27e6c82af6 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:10.511840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-15de2fdb-e629-4ac4-972b-0b27e6c82af6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:10.511840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:10.511840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:10.511840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:10.511840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:10.511840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:10.511840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:10.511840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:10.511840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:10.511840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:10.511840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:10.511840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:10.511840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:43:10.511840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:43:10.511840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:43:10.512831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:43:10.512831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:10.512831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:10.512831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:10.512831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:10.512831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:10.512831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:10.512831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:10.512831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:10.512831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:10.512831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:10.512831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:10.512831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:10.512831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:10.512831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:10.512831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:10.512831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:10.513737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:43:10.513737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:43:10.513737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:10.513737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:10.518240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 446/897] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:10.519155 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de2fdb-e629-4ac4-972b-0b27e6c82af6 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:10.605283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee34c1-036c-4b0f-bdfe-48b973d7a624 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:10.630399 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de2fdb-e629-4ac4-972b-0b27e6c82af6 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:10.645716 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf63e0-a024-4cee-b94a-505cd388f760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:10.646439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf63e0-a024-4cee-b94a-505cd388f760 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:10.646721 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf63e0-a024-4cee-b94a-505cd388f760 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:10.646994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf63e0-a024-4cee-b94a-505cd388f760 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:10.648825 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf63e0-a024-4cee-b94a-505cd388f760 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:10.649029 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf63e0-a024-4cee-b94a-505cd388f760 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:10.660307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-d5bf63e0-a024-4cee-b94a-505cd388f760 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 03:43:10.660307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:10.660307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:43:10.660307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:43:10.660307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:43:10.660307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:43:10.660307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:43:10.660307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:10.660307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 03:43:10.660307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:10.660307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:10.660307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:10.660307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:10.660307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:10.660307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:10.660307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:10.660307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:10.661397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:10.661397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:10.661397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:10.661397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:10.661397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:10.661397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:10.661397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:43:10.661397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:43:10.661397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:43:10.661397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:43:10.661397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:10.661397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:10.661397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:10.661397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:10.661397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:10.661397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:10.662698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:10.662698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:10.662698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:10.662698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:10.662698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:10.662698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:10.662698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:10.662698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:10.662698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:10.662698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:10.662698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:43:10.662698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:10.662698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 03:43:10.662698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:10.662698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 452/898] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:43:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:10.663535 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf63e0-a024-4cee-b94a-505cd388f760 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:10.672756 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cd1ef-648f-4bcb-a205-5c56e9fdedcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:10.673413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cd1ef-648f-4bcb-a205-5c56e9fdedcf None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:10.673693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cd1ef-648f-4bcb-a205-5c56e9fdedcf None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:10.673965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cd1ef-648f-4bcb-a205-5c56e9fdedcf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:10.674602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241cd1ef-648f-4bcb-a205-5c56e9fdedcf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:10.676033 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241cd1ef-648f-4bcb-a205-5c56e9fdedcf None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:10.684635 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:10.685133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-241cd1ef-648f-4bcb-a205-5c56e9fdedcf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 03:43:10.685133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:10.685133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:43:10.685133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:43:10.685133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:43:10.685133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:43:10.685133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:43:10.685133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:10.685133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 03:43:10.685133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:10.685133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:10.685133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:10.685133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:10.685133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:10.685133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:10.685133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:10.685133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:10.686084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:10.686084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:10.686084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:10.686084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:10.686084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:10.686084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:10.686084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:43:10.686084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:43:10.686084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:43:10.686084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:43:10.686084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:10.686084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:10.686084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:10.686084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:10.686084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:10.686084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:10.687014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:10.687014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:10.687014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:10.687014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:10.687014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:10.687014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:10.687014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:10.687014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:10.687014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:10.687014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:10.687014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:43:10.687014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:10.687014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 03:43:10.687014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:10.687014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 447/899] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 28 03:43:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:10.688424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cd1ef-648f-4bcb-a205-5c56e9fdedcf None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:10.716718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:10.790210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf63e0-a024-4cee-b94a-505cd388f760 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:10.800527 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cd1ef-648f-4bcb-a205-5c56e9fdedcf None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:10.826557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2c0ed-8c6a-4de1-b5df-445352ab96af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:10.828048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c0ed-8c6a-4de1-b5df-445352ab96af None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:10.828511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c0ed-8c6a-4de1-b5df-445352ab96af None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:10.828938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c0ed-8c6a-4de1-b5df-445352ab96af None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:10.829773 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2c0ed-8c6a-4de1-b5df-445352ab96af None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:10.830236 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2c0ed-8c6a-4de1-b5df-445352ab96af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:10.831821 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2c0ed-8c6a-4de1-b5df-445352ab96af None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:10.840906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9398c-3906-483e-9331-7a1a0a1c3747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:10.846540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9398c-3906-483e-9331-7a1a0a1c3747 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:10.846540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9398c-3906-483e-9331-7a1a0a1c3747 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:10.846540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9398c-3906-483e-9331-7a1a0a1c3747 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:10.846540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9398c-3906-483e-9331-7a1a0a1c3747 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:10.846540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9398c-3906-483e-9331-7a1a0a1c3747 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:10.846540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9398c-3906-483e-9331-7a1a0a1c3747 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:10.846954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 453/900] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:10.847028 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2c0ed-8c6a-4de1-b5df-445352ab96af None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:10.851167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 448/901] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:43:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:10.852127 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9398c-3906-483e-9331-7a1a0a1c3747 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:10.939512 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:10.957563 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:10.961694 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2c0ed-8c6a-4de1-b5df-445352ab96af None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:10.967278 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9398c-3906-483e-9331-7a1a0a1c3747 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:10.998148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f35e1e-cee2-4539-866f-07376b2ae39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:10.999007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f35e1e-cee2-4539-866f-07376b2ae39d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:10.999551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f35e1e-cee2-4539-866f-07376b2ae39d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:10.999840 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f35e1e-cee2-4539-866f-07376b2ae39d None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:11.000520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f35e1e-cee2-4539-866f-07376b2ae39d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:11.000819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f35e1e-cee2-4539-866f-07376b2ae39d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:11.002294 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f35e1e-cee2-4539-866f-07376b2ae39d None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:11.002774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b05dc9-8f05-42e2-a9eb-20634df24d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:11.003461 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b05dc9-8f05-42e2-a9eb-20634df24d97 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:11.003751 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b05dc9-8f05-42e2-a9eb-20634df24d97 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:11.004027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b05dc9-8f05-42e2-a9eb-20634df24d97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:11.010770 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b05dc9-8f05-42e2-a9eb-20634df24d97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:11.011956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 454/902] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 28 03:43:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:11.012300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b05dc9-8f05-42e2-a9eb-20634df24d97 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:11.012694 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f35e1e-cee2-4539-866f-07376b2ae39d None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:11.025070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-a7b05dc9-8f05-42e2-a9eb-20634df24d97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:11.025070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:11.025070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:11.025070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:11.025070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:11.025070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:11.025070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:11.025070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:11.025070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:11.025070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:11.025070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:11.025070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:11.025070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:43:11.025070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:43:11.025070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:43:11.026413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:43:11.026413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:11.026413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:11.026413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:11.026413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:11.026413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:11.026413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:11.026413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:11.026413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:11.026413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:11.026413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:11.026413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:11.026413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:11.026413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:11.026413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:11.026413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:11.026413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:11.027855 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:43:11.027855 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:43:11.027855 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:43:11.027855 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:43:11.027855 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:43:11.027855 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:43:11.027855 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:11.027855 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:11.027855 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 449/903] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:43:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:11.027855 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b05dc9-8f05-42e2-a9eb-20634df24d97 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:11.129963 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f35e1e-cee2-4539-866f-07376b2ae39d None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:11.136043 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b05dc9-8f05-42e2-a9eb-20634df24d97 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:11.166495 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654f6b8-309e-4139-9391-d58eb2cade3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:11.167193 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654f6b8-309e-4139-9391-d58eb2cade3a None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:11.167540 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654f6b8-309e-4139-9391-d58eb2cade3a None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:11.167819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654f6b8-309e-4139-9391-d58eb2cade3a None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:11.168497 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654f6b8-309e-4139-9391-d58eb2cade3a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:11.168798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654f6b8-309e-4139-9391-d58eb2cade3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:11.170164 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654f6b8-309e-4139-9391-d58eb2cade3a None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:11.175734 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 455/904] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:43:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:11.176509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654f6b8-309e-4139-9391-d58eb2cade3a None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:11.182402 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d0a12-e7d7-48c5-a4a6-3c131ca99bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:11.183244 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d0a12-e7d7-48c5-a4a6-3c131ca99bfd None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:11.183694 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d0a12-e7d7-48c5-a4a6-3c131ca99bfd None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:11.184134 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d0a12-e7d7-48c5-a4a6-3c131ca99bfd None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:11.185101 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:11.185489 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d0a12-e7d7-48c5-a4a6-3c131ca99bfd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:11.185924 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d0a12-e7d7-48c5-a4a6-3c131ca99bfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:11.188384 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d0a12-e7d7-48c5-a4a6-3c131ca99bfd None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:11.203353 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 450/905] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 28 03:43:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:11.203353 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d0a12-e7d7-48c5-a4a6-3c131ca99bfd None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:11.226896 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:11.307117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d0a12-e7d7-48c5-a4a6-3c131ca99bfd None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:11.332276 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654f6b8-309e-4139-9391-d58eb2cade3a None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:11.350125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb6611-f3f0-4be8-9737-ae78a4d5fcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:11.350751 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb6611-f3f0-4be8-9737-ae78a4d5fcd9 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:11.351032 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb6611-f3f0-4be8-9737-ae78a4d5fcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:11.351302 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb6611-f3f0-4be8-9737-ae78a4d5fcd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:11.352094 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb6611-f3f0-4be8-9737-ae78a4d5fcd9 None admin] RBAC: Adding query filter params (interface=public, service_id=2266f2d9d80e4dbdb1f28c04385e7e13, region_id=RegionOne) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:11.352398 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb6611-f3f0-4be8-9737-ae78a4d5fcd9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:11.353794 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb6611-f3f0-4be8-9737-ae78a4d5fcd9 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:11.362286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 451/906] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 28 03:43:11 2022] GET /identity/v3/endpoints?service_id=2266f2d9d80e4dbdb1f28c04385e7e13&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:11.368233 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb6611-f3f0-4be8-9737-ae78a4d5fcd9 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:11.380390 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382142e-e1e9-467c-8763-2e8ea90b2f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:11.380604 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382142e-e1e9-467c-8763-2e8ea90b2f26 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:11.380839 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382142e-e1e9-467c-8763-2e8ea90b2f26 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:11.381112 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382142e-e1e9-467c-8763-2e8ea90b2f26 None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:11.381867 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382142e-e1e9-467c-8763-2e8ea90b2f26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:11.382171 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382142e-e1e9-467c-8763-2e8ea90b2f26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:11.383634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382142e-e1e9-467c-8763-2e8ea90b2f26 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:11.396732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 456/907] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:43:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:11.402446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382142e-e1e9-467c-8763-2e8ea90b2f26 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:11.472105 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:11.491485 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:11.494496 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb6611-f3f0-4be8-9737-ae78a4d5fcd9 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:11.534575 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382142e-e1e9-467c-8763-2e8ea90b2f26 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:11.544448 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5501b-6050-4732-8677-dc8b513a57a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:11.545070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5501b-6050-4732-8677-dc8b513a57a8 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:11.545347 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5501b-6050-4732-8677-dc8b513a57a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:11.546220 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5501b-6050-4732-8677-dc8b513a57a8 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:11.547476 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5501b-6050-4732-8677-dc8b513a57a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:11.549284 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5501b-6050-4732-8677-dc8b513a57a8 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:11.557871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 452/908] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 28 03:43:11 2022] GET /identity/v3/services => generated 1268 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:43:11.578525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0530f84-ed0f-4194-92da-ed9d4797d831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:11.579172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0530f84-ed0f-4194-92da-ed9d4797d831 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:11.579486 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0530f84-ed0f-4194-92da-ed9d4797d831 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:11.579757 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0530f84-ed0f-4194-92da-ed9d4797d831 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:11.580576 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0530f84-ed0f-4194-92da-ed9d4797d831 None admin] RBAC: Adding query filter params (role.id=c06601c249ef4cad81ec53a2e55aba1e, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=420e2a81b66a470e8db624efd61fd1cd) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:11.580885 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0530f84-ed0f-4194-92da-ed9d4797d831 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:11.582389 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0530f84-ed0f-4194-92da-ed9d4797d831 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:11.589613 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 457/909] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:43:11 2022] GET /identity/v3/role_assignments?user.id=420e2a81b66a470e8db624efd61fd1cd&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=c06601c249ef4cad81ec53a2e55aba1e => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:12.575377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c801b6a-e18e-40ca-a032-8aac3800cb00 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:12.575921 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c801b6a-e18e-40ca-a032-8aac3800cb00 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:12.575921 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c801b6a-e18e-40ca-a032-8aac3800cb00 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:12.578402 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 453/910] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:12.583775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacbb19-d1d2-4b4e-be0c-cb385e33e12c None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:12.584178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacbb19-d1d2-4b4e-be0c-cb385e33e12c None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:12.584364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacbb19-d1d2-4b4e-be0c-cb385e33e12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:12.603035 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-faacbb19-d1d2-4b4e-be0c-cb385e33e12c None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:12.604263 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-faacbb19-d1d2-4b4e-be0c-cb385e33e12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:12.675725 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 458/911] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:12.699537 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c801b6a-e18e-40ca-a032-8aac3800cb00 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:12.821850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c801b6a-e18e-40ca-a032-8aac3800cb00 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:12.857376 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a00246-ca16-4886-a40d-e8beb262c61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:12.857944 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a00246-ca16-4886-a40d-e8beb262c61c None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:12.858848 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a00246-ca16-4886-a40d-e8beb262c61c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:12.859151 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a00246-ca16-4886-a40d-e8beb262c61c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:12.859918 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a00246-ca16-4886-a40d-e8beb262c61c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:12.861296 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a00246-ca16-4886-a40d-e8beb262c61c None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:12.870357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-67a00246-ca16-4886-a40d-e8beb262c61c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 03:43:12.870357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:12.870357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:43:12.870357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:43:12.870357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:43:12.870357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:43:12.870357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:43:12.870357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:12.870357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 03:43:12.870357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:12.870357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:12.870357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:12.870357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:12.870357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:12.870357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:12.870357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:12.872464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:12.872464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:12.872464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:12.872464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:12.872464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:12.872464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:12.872464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:12.872464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:43:12.872464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:43:12.872464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:43:12.872464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:43:12.872464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:12.872464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:12.872464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:12.872464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:12.872464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:12.874984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:12.874984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:12.874984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:12.874984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:12.874984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:12.874984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:12.874984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:12.874984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:12.874984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:12.874984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:12.874984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:12.874984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:43:12.874984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:12.874984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 03:43:12.874984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:12.876945 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 454/912] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Jul 28 03:43:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:12.880580 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacbb19-d1d2-4b4e-be0c-cb385e33e12c None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:12.945663 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:12.988423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacbb19-d1d2-4b4e-be0c-cb385e33e12c None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:13.023451 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3fdc7-fc0f-4d76-82b2-053d69ff49d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:13.024119 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3fdc7-fc0f-4d76-82b2-053d69ff49d9 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:13.024397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3fdc7-fc0f-4d76-82b2-053d69ff49d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:13.024669 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3fdc7-fc0f-4d76-82b2-053d69ff49d9 None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:13.025346 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3fdc7-fc0f-4d76-82b2-053d69ff49d9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:13.025647 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3fdc7-fc0f-4d76-82b2-053d69ff49d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:13.027016 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3fdc7-fc0f-4d76-82b2-053d69ff49d9 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:13.032826 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 459/913] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 28 03:43:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:13.038345 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a00246-ca16-4886-a40d-e8beb262c61c None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:13.050789 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:13.146059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a00246-ca16-4886-a40d-e8beb262c61c None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:13.181928 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68881a-9584-472a-942b-66ae4a8ae83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:13.182613 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68881a-9584-472a-942b-66ae4a8ae83c None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:13.182900 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68881a-9584-472a-942b-66ae4a8ae83c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:13.183227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68881a-9584-472a-942b-66ae4a8ae83c None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:13.183951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68881a-9584-472a-942b-66ae4a8ae83c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:13.184257 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68881a-9584-472a-942b-66ae4a8ae83c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:13.185634 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68881a-9584-472a-942b-66ae4a8ae83c None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:13.195432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 455/914] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 28 03:43:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:13.196943 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3fdc7-fc0f-4d76-82b2-053d69ff49d9 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:13.311297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3fdc7-fc0f-4d76-82b2-053d69ff49d9 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:13.324424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541d02a-a8c8-4d7f-8998-5963608d29cd None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:13.324424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541d02a-a8c8-4d7f-8998-5963608d29cd None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:13.324424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541d02a-a8c8-4d7f-8998-5963608d29cd None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:13.325253 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 456/915] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:13.331089 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e87997-3fa8-445c-a855-e31a9de87b0a None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:13.331682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e87997-3fa8-445c-a855-e31a9de87b0a None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:13.332201 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e87997-3fa8-445c-a855-e31a9de87b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:13.340095 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:13.348886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e058c-c82d-4584-b3a3-c276595dc3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:13.349519 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e058c-c82d-4584-b3a3-c276595dc3a4 None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:13.349798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e058c-c82d-4584-b3a3-c276595dc3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:13.350075 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e058c-c82d-4584-b3a3-c276595dc3a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:13.350805 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e058c-c82d-4584-b3a3-c276595dc3a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:13.356132 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e058c-c82d-4584-b3a3-c276595dc3a4 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:13.356243 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-85e87997-3fa8-445c-a855-e31a9de87b0a None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:13.356243 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-85e87997-3fa8-445c-a855-e31a9de87b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:13.425174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 457/916] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 03:43:13.448499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e87997-3fa8-445c-a855-e31a9de87b0a None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:13.453599 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 460/917] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 03:43:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:43:13.453721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:13.567961 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e87997-3fa8-445c-a855-e31a9de87b0a None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:13.619529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb3896-a55c-4916-a6f6-bdb2231c1dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:13.620948 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb3896-a55c-4916-a6f6-bdb2231c1dcb None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:13.621503 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb3896-a55c-4916-a6f6-bdb2231c1dcb None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:13.621957 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb3896-a55c-4916-a6f6-bdb2231c1dcb None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:13.622846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb3896-a55c-4916-a6f6-bdb2231c1dcb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:13.624670 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb3896-a55c-4916-a6f6-bdb2231c1dcb None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:13.673304 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f721b05-a400-4642-bc3c-7e0e9103314d None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:13.673817 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f721b05-a400-4642-bc3c-7e0e9103314d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:13.673933 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f721b05-a400-4642-bc3c-7e0e9103314d None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:13.679514 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 461/918] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:43:13.680794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39814b3b-00b6-46a4-93b2-ecd7fa84e0ca None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:13.681132 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39814b3b-00b6-46a4-93b2-ecd7fa84e0ca None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:13.681408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39814b3b-00b6-46a4-93b2-ecd7fa84e0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:13.700627 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-39814b3b-00b6-46a4-93b2-ecd7fa84e0ca None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:13.702903 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-39814b3b-00b6-46a4-93b2-ecd7fa84e0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:13.710468 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 458/919] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 28 03:43:13 2022] POST /identity/v3/services => generated 241 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:43:13.763621 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b1c1a-d070-4243-85b0-1fb88800376d None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:13.764340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b1c1a-d070-4243-85b0-1fb88800376d None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:13.764852 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b1c1a-d070-4243-85b0-1fb88800376d None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:13.768319 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 459/920] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:43:13.773659 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7f900-b8f7-49b5-b8ac-1a5b298b86c6 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:13.774332 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7f900-b8f7-49b5-b8ac-1a5b298b86c6 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:13.787939 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7f900-b8f7-49b5-b8ac-1a5b298b86c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:13.799375 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 462/921] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:13.813517 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-0cc7f900-b8f7-49b5-b8ac-1a5b298b86c6 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:13.815075 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0cc7f900-b8f7-49b5-b8ac-1a5b298b86c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:13.820446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39814b3b-00b6-46a4-93b2-ecd7fa84e0ca None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:13.888549 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:13.909224 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 460/922] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 03:43:13.935498 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7f900-b8f7-49b5-b8ac-1a5b298b86c6 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:13.945553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39814b3b-00b6-46a4-93b2-ecd7fa84e0ca None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:13.954520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:13.986625 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a845a-204f-44af-9645-75a98a16c6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:13.987608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a845a-204f-44af-9645-75a98a16c6e6 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:13.987895 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a845a-204f-44af-9645-75a98a16c6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:13.990009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a845a-204f-44af-9645-75a98a16c6e6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:14.000692 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a845a-204f-44af-9645-75a98a16c6e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:43:14.005882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-b54a845a-204f-44af-9645-75a98a16c6e6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 03:43:14.005882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:14.005882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:14.005882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:14.005882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:14.005882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:14.005882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:14.005882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:14.005882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:14.005882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:14.005882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:14.005882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:14.005882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:43:14.005882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:43:14.005882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:43:14.005882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:43:14.007005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:43:14.007005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:43:14.007005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:43:14.007005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:43:14.007005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:14.007005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:14.007005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:14.007005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:14.007005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:14.007005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:14.007005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:14.007005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:14.007005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:14.007005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:14.007005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:14.007005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:14.007980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:14.007980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:14.007980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:14.007980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:14.007980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:43:14.007980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:43:14.007980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:43:14.007980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:43:14.007980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:43:14.007980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:43:14.007980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 03:43:14.007980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:14.011442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 463/923] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 28 03:43:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:14.013350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a845a-204f-44af-9645-75a98a16c6e6 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:14.049958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7f900-b8f7-49b5-b8ac-1a5b298b86c6 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:14.091104 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee479e61-2e57-44a9-876f-ee991b01638f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:14.092270 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee479e61-2e57-44a9-876f-ee991b01638f None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:14.092847 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee479e61-2e57-44a9-876f-ee991b01638f None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:14.093265 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee479e61-2e57-44a9-876f-ee991b01638f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:14.094117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee479e61-2e57-44a9-876f-ee991b01638f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:14.095751 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee479e61-2e57-44a9-876f-ee991b01638f None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:14.106071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-ee479e61-2e57-44a9-876f-ee991b01638f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 03:43:14.106071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:14.106071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:43:14.106071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:43:14.106071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:43:14.106071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:43:14.106071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:43:14.106071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:14.106071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 03:43:14.106071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:14.106071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:14.106071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:14.106071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:14.106071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:14.106071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:14.106071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:14.106071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:14.107359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:14.107359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:14.107359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:14.107359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:14.107359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:14.107359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:14.107359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:43:14.107359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:43:14.107359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:43:14.107359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:43:14.107359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:14.107359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:14.107359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:14.107359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:14.107359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:14.107359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:14.108882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:14.108882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:14.108882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:14.108882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:14.108882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:14.108882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:14.108882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:14.108882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:14.108882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:14.108882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:14.108882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:43:14.108882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:14.108882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 03:43:14.108882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:14.111256 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 461/924] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:43:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:14.119139 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee479e61-2e57-44a9-876f-ee991b01638f None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:14.131259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a845a-204f-44af-9645-75a98a16c6e6 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:14.174677 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72043395-ac86-4517-9f7d-51638e63a409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:14.175704 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72043395-ac86-4517-9f7d-51638e63a409 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:14.176195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72043395-ac86-4517-9f7d-51638e63a409 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:14.176703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72043395-ac86-4517-9f7d-51638e63a409 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:14.177690 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72043395-ac86-4517-9f7d-51638e63a409 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:14.178203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72043395-ac86-4517-9f7d-51638e63a409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:14.179876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72043395-ac86-4517-9f7d-51638e63a409 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:14.193639 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:14.194535 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 464/925] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 28 03:43:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:14.195865 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72043395-ac86-4517-9f7d-51638e63a409 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:14.227683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:14.262594 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee479e61-2e57-44a9-876f-ee991b01638f None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:14.308566 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72043395-ac86-4517-9f7d-51638e63a409 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:14.311625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2051c2-46b5-4dd3-9bf5-812b86a67712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:14.313609 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2051c2-46b5-4dd3-9bf5-812b86a67712 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:14.314096 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2051c2-46b5-4dd3-9bf5-812b86a67712 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:14.314526 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2051c2-46b5-4dd3-9bf5-812b86a67712 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:14.315631 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2051c2-46b5-4dd3-9bf5-812b86a67712 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:14.316110 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2051c2-46b5-4dd3-9bf5-812b86a67712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:14.318527 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2051c2-46b5-4dd3-9bf5-812b86a67712 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:14.326076 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 462/926] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:43:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:14.331966 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2051c2-46b5-4dd3-9bf5-812b86a67712 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:14.357445 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc63599-9abe-4b51-b894-cfa5863c8b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:14.358981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc63599-9abe-4b51-b894-cfa5863c8b7e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:14.359682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc63599-9abe-4b51-b894-cfa5863c8b7e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:14.360175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc63599-9abe-4b51-b894-cfa5863c8b7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:14.376788 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc63599-9abe-4b51-b894-cfa5863c8b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:14.379281 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc63599-9abe-4b51-b894-cfa5863c8b7e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:14.397158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-7cc63599-9abe-4b51-b894-cfa5863c8b7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:14.397158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:14.397158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:14.397158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:14.397158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:14.397158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:14.397158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:14.397158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:14.397158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:14.397158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:14.397158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:14.397158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:14.397158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:43:14.397158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:43:14.397158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:43:14.398089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:43:14.398089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:14.398089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:14.398089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:14.398089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:14.398089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:14.398089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:14.398089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:14.398089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:14.398089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:14.398089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:14.398089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:14.398089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:14.398089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:14.398089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:14.398089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:14.398089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:14.398958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:43:14.398958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:43:14.398958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:14.398958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:14.398958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 465/927] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:14.404250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc63599-9abe-4b51-b894-cfa5863c8b7e None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:14.444381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2051c2-46b5-4dd3-9bf5-812b86a67712 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:14.468190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:14.488113 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e5349-b440-4bcc-add7-30e8fab209cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:14.488747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e5349-b440-4bcc-add7-30e8fab209cc None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:14.489034 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e5349-b440-4bcc-add7-30e8fab209cc None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:14.489311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e5349-b440-4bcc-add7-30e8fab209cc None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:14.490004 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e5349-b440-4bcc-add7-30e8fab209cc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:14.490311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e5349-b440-4bcc-add7-30e8fab209cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:14.491711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e5349-b440-4bcc-add7-30e8fab209cc None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:14.501561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 463/928] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 28 03:43:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:14.504132 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e5349-b440-4bcc-add7-30e8fab209cc None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:14.520263 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:14.540500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc63599-9abe-4b51-b894-cfa5863c8b7e None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:14.584698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337392ab-f1fc-470c-a3b6-ccaf8ac4b767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:14.585819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337392ab-f1fc-470c-a3b6-ccaf8ac4b767 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:14.586254 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337392ab-f1fc-470c-a3b6-ccaf8ac4b767 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:14.587106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337392ab-f1fc-470c-a3b6-ccaf8ac4b767 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:14.588264 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337392ab-f1fc-470c-a3b6-ccaf8ac4b767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:14.588723 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337392ab-f1fc-470c-a3b6-ccaf8ac4b767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:14.590261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337392ab-f1fc-470c-a3b6-ccaf8ac4b767 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:14.613361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 466/929] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:14.615267 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337392ab-f1fc-470c-a3b6-ccaf8ac4b767 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:14.633856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e5349-b440-4bcc-add7-30e8fab209cc None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:14.677606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa98ad-5740-4876-8f26-e7176e3fe074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:14.679035 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa98ad-5740-4876-8f26-e7176e3fe074 None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:14.679934 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa98ad-5740-4876-8f26-e7176e3fe074 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:14.680402 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa98ad-5740-4876-8f26-e7176e3fe074 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:14.681754 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa98ad-5740-4876-8f26-e7176e3fe074 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:14.684265 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa98ad-5740-4876-8f26-e7176e3fe074 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:14.743617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337392ab-f1fc-470c-a3b6-ccaf8ac4b767 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:14.786466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8af56-43b4-4fa6-96c1-b1f39cab1228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:14.787678 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8af56-43b4-4fa6-96c1-b1f39cab1228 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:14.787678 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8af56-43b4-4fa6-96c1-b1f39cab1228 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:14.787825 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8af56-43b4-4fa6-96c1-b1f39cab1228 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:14.796238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8af56-43b4-4fa6-96c1-b1f39cab1228 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:14.797709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8af56-43b4-4fa6-96c1-b1f39cab1228 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:14.801204 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:14.812089 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 464/930] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 03:43:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:43:14.813197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-2cc8af56-43b4-4fa6-96c1-b1f39cab1228 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 03:43:14.813197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:14.813197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:14.813197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:14.813197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:14.813197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:14.813197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:14.813197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:14.813197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:14.813197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:14.813197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:14.813197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:14.813197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:43:14.813197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:43:14.813197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:43:14.813197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:43:14.814151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:14.814151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:14.814151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:43:14.814151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:14.814151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:43:14.814151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:14.814151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:14.814151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:14.814151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:14.814151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:14.814151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:14.814151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:14.814151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:14.814151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:14.814151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:14.814151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:14.814151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:14.814151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:14.815774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:14.815774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:14.815774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:43:14.815774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:43:14.815774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:43:14.815774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:43:14.815774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:43:14.815774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:43:14.815774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 03:43:14.815774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:14.815774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 467/931] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 28 03:43:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:14.823286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa98ad-5740-4876-8f26-e7176e3fe074 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:14.869268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:14.959772 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa98ad-5740-4876-8f26-e7176e3fe074 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:14.997806 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3e118-adff-4b6d-905e-aeeb24c0dbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:14.998356 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3e118-adff-4b6d-905e-aeeb24c0dbb9 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:14.999258 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3e118-adff-4b6d-905e-aeeb24c0dbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:14.999561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3e118-adff-4b6d-905e-aeeb24c0dbb9 None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:15.000462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3e118-adff-4b6d-905e-aeeb24c0dbb9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:15.000771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3e118-adff-4b6d-905e-aeeb24c0dbb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:15.002262 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3e118-adff-4b6d-905e-aeeb24c0dbb9 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:15.021792 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 465/932] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 28 03:43:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:15.027997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8af56-43b4-4fa6-96c1-b1f39cab1228 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:15.140530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8af56-43b4-4fa6-96c1-b1f39cab1228 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:15.177101 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272f54c-52b5-4289-bbd0-771786d3de3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:15.178121 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272f54c-52b5-4289-bbd0-771786d3de3b None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:15.178602 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272f54c-52b5-4289-bbd0-771786d3de3b None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:15.179097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272f54c-52b5-4289-bbd0-771786d3de3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:15.190736 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272f54c-52b5-4289-bbd0-771786d3de3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:15.192548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272f54c-52b5-4289-bbd0-771786d3de3b None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:15.207530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-b272f54c-52b5-4289-bbd0-771786d3de3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:15.207530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:15.207530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:15.207530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:15.207530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:15.207530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:15.207530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:15.207530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:15.207530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:15.207530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:15.207530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:15.207530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:15.207530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:43:15.207530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:43:15.207530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:43:15.208518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:43:15.208518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:15.208518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:15.208518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:15.208518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:15.208518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:15.208518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:15.208518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:15.208518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:15.208518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:15.208518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:15.208518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:15.208518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:15.208518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:15.208518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:15.208518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:15.208518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:15.209384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:43:15.209384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:43:15.209384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:15.209384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:15.215721 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 468/933] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:15.218276 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3e118-adff-4b6d-905e-aeeb24c0dbb9 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:15.324026 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:15.334019 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3e118-adff-4b6d-905e-aeeb24c0dbb9 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:15.370848 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926fcbdf-cef3-484f-8c1a-ceb3ac58c217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:15.371506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fcbdf-cef3-484f-8c1a-ceb3ac58c217 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:15.371789 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fcbdf-cef3-484f-8c1a-ceb3ac58c217 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:15.372070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fcbdf-cef3-484f-8c1a-ceb3ac58c217 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:15.372766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fcbdf-cef3-484f-8c1a-ceb3ac58c217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:15.373071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fcbdf-cef3-484f-8c1a-ceb3ac58c217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:15.374506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fcbdf-cef3-484f-8c1a-ceb3ac58c217 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:15.386674 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 466/934] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:15.392757 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272f54c-52b5-4289-bbd0-771786d3de3b None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:15.452948 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:15.512283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272f54c-52b5-4289-bbd0-771786d3de3b None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:15.551037 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f437a60-554d-484c-ad41-d25d3fd2a7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:15.552168 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f437a60-554d-484c-ad41-d25d3fd2a7ee None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:15.552652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f437a60-554d-484c-ad41-d25d3fd2a7ee None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:15.553152 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f437a60-554d-484c-ad41-d25d3fd2a7ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:15.560706 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f437a60-554d-484c-ad41-d25d3fd2a7ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:15.563089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f437a60-554d-484c-ad41-d25d3fd2a7ee None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:15.576019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-8f437a60-554d-484c-ad41-d25d3fd2a7ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:15.576019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:15.576019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:15.576019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:15.576019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:15.576019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:15.576019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:15.576019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:15.576019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:15.576019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:15.576019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:15.576019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:15.576019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:43:15.576019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:43:15.576019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:43:15.577453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:43:15.577453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:15.577453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:15.577453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:15.577453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:15.577453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:15.577453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:15.577453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:15.577453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:15.577453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:15.577453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:15.577453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:15.577453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:15.577453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:15.577453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:15.577453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:15.577453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:15.578335 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:43:15.578335 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:43:15.578335 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:43:15.578335 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:43:15.578335 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:43:15.578335 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:43:15.578335 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:15.578335 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:15.585477 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 469/935] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:43:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:15.587109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926fcbdf-cef3-484f-8c1a-ceb3ac58c217 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:15.618996 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0adcfd-f53b-4713-b636-e09e9eb57175 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:15.619304 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0adcfd-f53b-4713-b636-e09e9eb57175 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:15.619587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0adcfd-f53b-4713-b636-e09e9eb57175 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:15.621212 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 470/936] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:15.626189 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e76d8c-340a-409d-9859-a9eac387814f None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:15.626472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e76d8c-340a-409d-9859-a9eac387814f None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:15.626746 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e76d8c-340a-409d-9859-a9eac387814f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:15.647798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-d9e76d8c-340a-409d-9859-a9eac387814f None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:15.649012 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d9e76d8c-340a-409d-9859-a9eac387814f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:15.707602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926fcbdf-cef3-484f-8c1a-ceb3ac58c217 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:15.744788 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc53bd-91a4-4812-8580-ce17b71887a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:15.745619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc53bd-91a4-4812-8580-ce17b71887a9 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:15.745947 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc53bd-91a4-4812-8580-ce17b71887a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:15.746227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc53bd-91a4-4812-8580-ce17b71887a9 None admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:15.746992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc53bd-91a4-4812-8580-ce17b71887a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:15.747298 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc53bd-91a4-4812-8580-ce17b71887a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:15.749568 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc53bd-91a4-4812-8580-ce17b71887a9 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:15.751471 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 471/937] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 03:43:15.766993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 467/938] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:43:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:15.772956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e76d8c-340a-409d-9859-a9eac387814f None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:15.784700 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc53bd-91a4-4812-8580-ce17b71887a9 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:15.807215 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:15.822533 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:15.882458 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e76d8c-340a-409d-9859-a9eac387814f None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:15.900659 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc53bd-91a4-4812-8580-ce17b71887a9 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:15.919037 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0010a2-eb9a-4acf-ae2a-bcf672cbac45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:15.919762 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0010a2-eb9a-4acf-ae2a-bcf672cbac45 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:15.920022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0010a2-eb9a-4acf-ae2a-bcf672cbac45 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:15.920293 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0010a2-eb9a-4acf-ae2a-bcf672cbac45 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:15.920992 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0010a2-eb9a-4acf-ae2a-bcf672cbac45 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:15.922877 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0010a2-eb9a-4acf-ae2a-bcf672cbac45 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:15.932292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-5e0010a2-eb9a-4acf-ae2a-bcf672cbac45 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 03:43:15.932292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:15.932292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:43:15.932292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:43:15.932292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:43:15.932292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:43:15.932292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:43:15.932292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:15.932292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 03:43:15.932292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:15.932292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:15.932292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:15.932292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:15.932292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:15.932292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:15.932292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:15.932292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:15.933337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:15.933337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:15.933337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:15.933337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:15.933337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:15.933337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:15.933337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:43:15.933337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:43:15.933337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:43:15.933337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:43:15.933337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:15.933337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:15.933337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:15.933337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:15.933337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:15.933337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:15.934207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:15.934207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:15.934207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:15.934207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:15.934207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:15.934207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:15.934207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:15.934207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:15.934207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:15.934207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:15.934207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:43:15.934207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:15.934207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 03:43:15.934207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:15.934207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 472/939] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:43:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:15.935029 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7441d25-8ee7-4d3c-a906-9685dce16379 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:15.935029 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7441d25-8ee7-4d3c-a906-9685dce16379 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:15.935748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7441d25-8ee7-4d3c-a906-9685dce16379 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:15.936957 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 473/940] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:15.942312 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ee009-4753-42db-bc9e-cd04a3467557 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:15.942597 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ee009-4753-42db-bc9e-cd04a3467557 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:15.942875 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ee009-4753-42db-bc9e-cd04a3467557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:15.946753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a17da-59c0-476f-a517-48c0e43c1d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:15.947550 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a17da-59c0-476f-a517-48c0e43c1d01 None admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:15.947832 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a17da-59c0-476f-a517-48c0e43c1d01 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:15.948103 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a17da-59c0-476f-a517-48c0e43c1d01 None admin] PATH_INFO: `/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/420e2a81b66a470e8db624efd61fd1cd/roles/c06601c249ef4cad81ec53a2e55aba1e` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:15.950533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a17da-59c0-476f-a517-48c0e43c1d01 None admin] RBAC: Authorizing `identity:create_grant(project_id=28b7995e83524b9293d1c6fc319e5a85, user_id=420e2a81b66a470e8db624efd61fd1cd, role_id=c06601c249ef4cad81ec53a2e55aba1e)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:15.952058 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a17da-59c0-476f-a517-48c0e43c1d01 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:15.961801 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-2b0ee009-4753-42db-bc9e-cd04a3467557 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:15.963394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-2b0ee009-4753-42db-bc9e-cd04a3467557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:16.023452 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 468/941] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:43:15 2022] PUT /identity/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/420e2a81b66a470e8db624efd61fd1cd/roles/c06601c249ef4cad81ec53a2e55aba1e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:43:16.024592 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a17da-59c0-476f-a517-48c0e43c1d01 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:16.045047 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 474/942] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 03:43:16.067662 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ee009-4753-42db-bc9e-cd04a3467557 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:16.112694 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:16.115781 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:16.152839 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a17da-59c0-476f-a517-48c0e43c1d01 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:16.193585 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7e671-d5aa-44e0-ab7b-174bfc3d51ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:16.194224 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7e671-d5aa-44e0-ab7b-174bfc3d51ed None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:16.194496 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7e671-d5aa-44e0-ab7b-174bfc3d51ed None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:16.194769 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7e671-d5aa-44e0-ab7b-174bfc3d51ed None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:16.196305 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7e671-d5aa-44e0-ab7b-174bfc3d51ed None admin] RBAC: Adding query filter params (name=compute) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:16.196620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7e671-d5aa-44e0-ab7b-174bfc3d51ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:16.198002 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7e671-d5aa-44e0-ab7b-174bfc3d51ed None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:16.205571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 469/943] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 28 03:43:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:16.214399 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ee009-4753-42db-bc9e-cd04a3467557 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:16.218132 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7e671-d5aa-44e0-ab7b-174bfc3d51ed None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:16.258327 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a8db5-57f5-4d3e-b78f-e7f2a9b0e107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:16.258983 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a8db5-57f5-4d3e-b78f-e7f2a9b0e107 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:16.259394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a8db5-57f5-4d3e-b78f-e7f2a9b0e107 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:16.259670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a8db5-57f5-4d3e-b78f-e7f2a9b0e107 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:16.260400 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a8db5-57f5-4d3e-b78f-e7f2a9b0e107 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:16.261843 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a8db5-57f5-4d3e-b78f-e7f2a9b0e107 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:16.272798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-733a8db5-57f5-4d3e-b78f-e7f2a9b0e107 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 03:43:16.272798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:16.272798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:43:16.272798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:43:16.272798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:43:16.272798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:43:16.272798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:43:16.272798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:16.272798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 03:43:16.272798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:16.272798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:16.272798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:16.272798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:16.272798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:16.272798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:16.272798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:16.272798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:16.273800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:16.273800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:16.273800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:16.273800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:16.273800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:16.273800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:16.273800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:43:16.273800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:43:16.273800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:43:16.273800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:43:16.273800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:16.273800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:16.273800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:16.273800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:16.273800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:16.273800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:16.275051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:16.275051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:16.275051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:16.275051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:16.275051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:16.275051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:16.275051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:16.275051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:16.275051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:16.275051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:16.275051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:43:16.275051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:16.275051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 03:43:16.275051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:16.275051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 475/944] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 28 03:43:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:16.281386 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a8db5-57f5-4d3e-b78f-e7f2a9b0e107 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:16.353395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7e671-d5aa-44e0-ab7b-174bfc3d51ed None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:16.393079 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:16.396317 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a8db5-57f5-4d3e-b78f-e7f2a9b0e107 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:16.408407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f020c7e-2474-4518-9d98-34d81ac7ad2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:16.408407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f020c7e-2474-4518-9d98-34d81ac7ad2c None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:16.408407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f020c7e-2474-4518-9d98-34d81ac7ad2c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:16.408407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f020c7e-2474-4518-9d98-34d81ac7ad2c None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:16.408824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f020c7e-2474-4518-9d98-34d81ac7ad2c None admin] RBAC: Adding query filter params (type=compute) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:16.408824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f020c7e-2474-4518-9d98-34d81ac7ad2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:16.409853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f020c7e-2474-4518-9d98-34d81ac7ad2c None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:16.411580 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:16.419505 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 470/945] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 28 03:43:16 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:16.444631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843dcd0-1e72-4610-a33b-7f216e4ff8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:16.445667 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843dcd0-1e72-4610-a33b-7f216e4ff8df None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:16.446143 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843dcd0-1e72-4610-a33b-7f216e4ff8df None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:16.446610 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843dcd0-1e72-4610-a33b-7f216e4ff8df None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:16.447577 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843dcd0-1e72-4610-a33b-7f216e4ff8df None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:16.448118 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843dcd0-1e72-4610-a33b-7f216e4ff8df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:16.450034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843dcd0-1e72-4610-a33b-7f216e4ff8df None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:16.457855 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 476/946] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 28 03:43:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:16.464888 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f020c7e-2474-4518-9d98-34d81ac7ad2c None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:16.586770 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f020c7e-2474-4518-9d98-34d81ac7ad2c None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:16.628129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cb332-d27f-4398-9a7c-f6d41cc46140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:16.629118 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cb332-d27f-4398-9a7c-f6d41cc46140 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:16.629613 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cb332-d27f-4398-9a7c-f6d41cc46140 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:16.630094 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cb332-d27f-4398-9a7c-f6d41cc46140 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:16.630972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cb332-d27f-4398-9a7c-f6d41cc46140 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:16.631566 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cb332-d27f-4398-9a7c-f6d41cc46140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:16.633217 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cb332-d27f-4398-9a7c-f6d41cc46140 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:16.639658 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 471/947] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 28 03:43:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:16.646091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843dcd0-1e72-4610-a33b-7f216e4ff8df None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:16.758274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843dcd0-1e72-4610-a33b-7f216e4ff8df None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:16.796939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae5ef8-3010-4d7f-a4e0-5a43aa6a0205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:16.797577 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae5ef8-3010-4d7f-a4e0-5a43aa6a0205 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:16.797857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae5ef8-3010-4d7f-a4e0-5a43aa6a0205 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:16.798130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae5ef8-3010-4d7f-a4e0-5a43aa6a0205 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:16.798961 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae5ef8-3010-4d7f-a4e0-5a43aa6a0205 None admin] RBAC: Adding query filter params (interface=public, service_id=c0241d65f98d4fc3b3ab6cb8a049d28b, region_id=RegionOne) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:16.799338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae5ef8-3010-4d7f-a4e0-5a43aa6a0205 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:16.800727 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae5ef8-3010-4d7f-a4e0-5a43aa6a0205 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:16.806753 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 477/948] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 28 03:43:16 2022] GET /identity/v3/endpoints?service_id=c0241d65f98d4fc3b3ab6cb8a049d28b&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:16.813161 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cb332-d27f-4398-9a7c-f6d41cc46140 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:16.886220 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:16.926766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cb332-d27f-4398-9a7c-f6d41cc46140 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:16.967670 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5694c25-bae8-4991-96d4-b90e25218eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:16.968253 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5694c25-bae8-4991-96d4-b90e25218eaa None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:16.968505 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5694c25-bae8-4991-96d4-b90e25218eaa None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:16.968777 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5694c25-bae8-4991-96d4-b90e25218eaa None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:16.969438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5694c25-bae8-4991-96d4-b90e25218eaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:16.970808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5694c25-bae8-4991-96d4-b90e25218eaa None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:16.977639 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 472/949] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 28 03:43:16 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:43:17.072790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60f1a8-2802-43ee-83e0-d0692d58bb15 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:17.073122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60f1a8-2802-43ee-83e0-d0692d58bb15 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:17.073345 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60f1a8-2802-43ee-83e0-d0692d58bb15 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:17.075025 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 478/950] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:17.080960 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8185e9d-d299-4513-9baf-0173bb169f75 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:17.081248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8185e9d-d299-4513-9baf-0173bb169f75 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:17.081525 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8185e9d-d299-4513-9baf-0173bb169f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:17.100576 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-d8185e9d-d299-4513-9baf-0173bb169f75 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:17.101798 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-d8185e9d-d299-4513-9baf-0173bb169f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:17.176685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 473/951] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:17.199393 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60f1a8-2802-43ee-83e0-d0692d58bb15 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:17.230955 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:17.309448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60f1a8-2802-43ee-83e0-d0692d58bb15 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:17.345043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c78644-437e-4398-a89f-3aac3086502b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:17.345595 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c78644-437e-4398-a89f-3aac3086502b None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:17.345875 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c78644-437e-4398-a89f-3aac3086502b None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:17.346144 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c78644-437e-4398-a89f-3aac3086502b None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:17.346843 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c78644-437e-4398-a89f-3aac3086502b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:17.348294 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c78644-437e-4398-a89f-3aac3086502b None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:17.350890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: WARNING keystone.server.flask.common [None req-a2c78644-437e-4398-a89f-3aac3086502b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 03:43:17.396129 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.sql.core [None req-a2c78644-437e-4398-a89f-3aac3086502b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 03:43:17.396129 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 03:43:17.396129 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [parameters: {'id': 'a5359b97afdd402692916fc90b0f82e4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 03:43:17.396129 dv-cinder-851279-1-smb devstack@keystone.service[86895]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86895) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 03:43:17.413232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-a2c78644-437e-4398-a89f-3aac3086502b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a5359b97afdd402692916fc90b0f82e4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a5359b97afdd402692916fc90b0f82e4. Jul 28 03:43:17.413232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:17.413232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 03:43:17.413232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 03:43:17.413232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 03:43:17.413232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 03:43:17.413232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 03:43:17.413232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 03:43:17.413232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 03:43:17.413232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application conn.query(q) Jul 28 03:43:17.413232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 03:43:17.413232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 03:43:17.413232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 03:43:17.414149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application result.read() Jul 28 03:43:17.414149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 03:43:17.414149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 03:43:17.414149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 03:43:17.414149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 03:43:17.414149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 03:43:17.414149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 03:43:17.414149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 03:43:17.414149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 03:43:17.414149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 03:43:17.414149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:17.414149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 03:43:17.414149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:17.414149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:17.414149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 03:43:17.414149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 03:43:17.414149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 28 03:43:17.414149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 28 03:43:17.415094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 03:43:17.415094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application next(self.gen) Jul 28 03:43:17.415094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 03:43:17.415094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application yield resource Jul 28 03:43:17.415094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 03:43:17.415094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application next(self.gen) Jul 28 03:43:17.415094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 03:43:17.415094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 03:43:17.415094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:43:17.415094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 03:43:17.415094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:43:17.415094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise self.value Jul 28 03:43:17.415094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 03:43:17.415094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 03:43:17.415094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 03:43:17.415094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application session.commit() Jul 28 03:43:17.415094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 03:43:17.416806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 03:43:17.416806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 03:43:17.416806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 03:43:17.416806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 03:43:17.416806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self.session.flush() Jul 28 03:43:17.416806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 03:43:17.416806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 03:43:17.416806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 03:43:17.416806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 03:43:17.416806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 03:43:17.416806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application compat.raise_( Jul 28 03:43:17.416806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 03:43:17.416806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception Jul 28 03:43:17.416806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 03:43:17.416806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 03:43:17.416806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 03:43:17.416806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 03:43:17.418934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 03:43:17.418934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 03:43:17.418934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 03:43:17.418934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 03:43:17.418934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 03:43:17.418934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 03:43:17.418934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 03:43:17.418934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 03:43:17.418934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 03:43:17.418934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 03:43:17.418934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 03:43:17.418934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 03:43:17.418934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 03:43:17.418934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 03:43:17.418934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 03:43:17.421608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 03:43:17.421608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 03:43:17.421608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception Jul 28 03:43:17.421608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 03:43:17.421608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 03:43:17.421608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 03:43:17.421608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 03:43:17.421608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 03:43:17.421608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 03:43:17.421608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 03:43:17.421608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application conn.query(q) Jul 28 03:43:17.421608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 03:43:17.421608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 03:43:17.421608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 03:43:17.421608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application result.read() Jul 28 03:43:17.421608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 03:43:17.421608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 03:43:17.423708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 03:43:17.423708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 03:43:17.423708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 03:43:17.423708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 03:43:17.423708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 03:43:17.423708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 03:43:17.423708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 03:43:17.423708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 03:43:17.423708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [parameters: {'id': 'a5359b97afdd402692916fc90b0f82e4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 03:43:17.423708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 03:43:17.423708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:17.423708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:17.423708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:17.423708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:17.423708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 28 03:43:17.425683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 28 03:43:17.425683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 03:43:17.425683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 03:43:17.425683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 28 03:43:17.425683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:17.425683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:17.425683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:17.425683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:17.425683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:17.425683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:17.425683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:17.425683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:17.425683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:17.425683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:17.425683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:17.425683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:17.425683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:17.427994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:17.427994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 28 03:43:17.427994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 28 03:43:17.427994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:17.427994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:17.427994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 28 03:43:17.427994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 28 03:43:17.427994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a5359b97afdd402692916fc90b0f82e4. Jul 28 03:43:17.427994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:17.427994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 479/952] 10.222.0.64 () {60 vars in 1140 bytes} [Thu Jul 28 03:43:17 2022] POST /identity/v3/projects => generated 262 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:17.429277 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8185e9d-d299-4513-9baf-0173bb169f75 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:17.482537 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:17.529405 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8185e9d-d299-4513-9baf-0173bb169f75 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:17.567510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f180c4d-0ee9-4916-abbb-173a36471313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:17.568427 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f180c4d-0ee9-4916-abbb-173a36471313 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:17.568861 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f180c4d-0ee9-4916-abbb-173a36471313 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:17.569352 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f180c4d-0ee9-4916-abbb-173a36471313 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:17.576621 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f180c4d-0ee9-4916-abbb-173a36471313 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:17.578825 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f180c4d-0ee9-4916-abbb-173a36471313 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:17.590912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-0f180c4d-0ee9-4916-abbb-173a36471313 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:17.590912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:17.590912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:17.590912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:17.590912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:17.590912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:17.590912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:17.590912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:17.590912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:17.590912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:17.590912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:17.590912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:17.590912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:43:17.590912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:43:17.590912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:43:17.592047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:43:17.592047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:17.592047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:17.592047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:17.592047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:17.592047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:17.592047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:17.592047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:17.592047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:17.592047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:17.592047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:17.592047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:17.592047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:17.592047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:17.592047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:17.592047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:17.592047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:17.593227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:43:17.593227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:43:17.593227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:43:17.593227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:43:17.593227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:43:17.593227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:43:17.593227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:17.593227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:17.595441 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 474/953] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:43:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:17.607354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c78644-437e-4398-a89f-3aac3086502b None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:17.694344 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:17.711605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c78644-437e-4398-a89f-3aac3086502b None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:17.747924 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f95370-af3e-4f3b-af8f-4c9f36e3d25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:17.749184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f95370-af3e-4f3b-af8f-4c9f36e3d25d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:17.749494 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f95370-af3e-4f3b-af8f-4c9f36e3d25d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:17.749975 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f95370-af3e-4f3b-af8f-4c9f36e3d25d None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:17.750713 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f95370-af3e-4f3b-af8f-4c9f36e3d25d None admin] RBAC: Adding query filter params (name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:17.751021 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f95370-af3e-4f3b-af8f-4c9f36e3d25d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:17.752714 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f95370-af3e-4f3b-af8f-4c9f36e3d25d None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:17.774223 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 480/954] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 28 03:43:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:18.188333 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a267f5e-9e21-4243-85fb-210eb9216ece None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:18.188887 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a267f5e-9e21-4243-85fb-210eb9216ece None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:18.188887 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a267f5e-9e21-4243-85fb-210eb9216ece None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:18.190512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 475/955] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:43:18.195928 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7d1d5-bb59-4ad5-b2a2-54ccbdbe6365 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:18.196217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7d1d5-bb59-4ad5-b2a2-54ccbdbe6365 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:18.196497 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7d1d5-bb59-4ad5-b2a2-54ccbdbe6365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:18.215985 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-d8f7d1d5-bb59-4ad5-b2a2-54ccbdbe6365 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:18.217536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d8f7d1d5-bb59-4ad5-b2a2-54ccbdbe6365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:18.288544 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 481/956] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:18.311644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a267f5e-9e21-4243-85fb-210eb9216ece None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:18.419300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a267f5e-9e21-4243-85fb-210eb9216ece None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:18.448013 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:18.455299 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07272b73-db6b-4abb-bdb7-5664a4d842dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:18.455979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07272b73-db6b-4abb-bdb7-5664a4d842dc None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:18.456391 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07272b73-db6b-4abb-bdb7-5664a4d842dc None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:18.456672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07272b73-db6b-4abb-bdb7-5664a4d842dc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:18.467887 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07272b73-db6b-4abb-bdb7-5664a4d842dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:43:18.473197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-07272b73-db6b-4abb-bdb7-5664a4d842dc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 03:43:18.473197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:18.473197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:18.473197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:18.473197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:18.473197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:18.473197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:18.473197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:18.473197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:18.473197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:18.473197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:18.473197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:18.473197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:43:18.473197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:43:18.473197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:43:18.473197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:43:18.474235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:43:18.474235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:43:18.474235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:43:18.474235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:43:18.474235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:18.474235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:18.474235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:18.474235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:18.474235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:18.474235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:18.474235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:18.474235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:18.474235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:18.474235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:18.474235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:18.474235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:18.475079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:18.475079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:18.475079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:18.475079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:18.475079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:43:18.475079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:43:18.475079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:43:18.475079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:43:18.475079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:43:18.475079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:43:18.475079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 03:43:18.475079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:18.475079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 476/957] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 28 03:43:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:18.480315 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7d1d5-bb59-4ad5-b2a2-54ccbdbe6365 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:18.559336 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:18.585080 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7d1d5-bb59-4ad5-b2a2-54ccbdbe6365 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:18.616949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8926a1-4826-4101-a1a1-918e5563b6d3 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:18.617582 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8926a1-4826-4101-a1a1-918e5563b6d3 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:18.618084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8926a1-4826-4101-a1a1-918e5563b6d3 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:18.619945 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 477/958] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:18.624618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0aa40-ff77-4b19-a673-5939b3bf954b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:18.624618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0aa40-ff77-4b19-a673-5939b3bf954b None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:18.624618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0aa40-ff77-4b19-a673-5939b3bf954b None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:18.624618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0aa40-ff77-4b19-a673-5939b3bf954b None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:18.625096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0aa40-ff77-4b19-a673-5939b3bf954b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:18.625096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0aa40-ff77-4b19-a673-5939b3bf954b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:18.625950 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0aa40-ff77-4b19-a673-5939b3bf954b None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:18.626938 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd7633-3bad-4baf-8f84-10148d61fd3c None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:18.627512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd7633-3bad-4baf-8f84-10148d61fd3c None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:18.628010 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd7633-3bad-4baf-8f84-10148d61fd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:18.635225 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 482/959] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 28 03:43:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:18.641431 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0aa40-ff77-4b19-a673-5939b3bf954b None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:18.646929 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-76cd7633-3bad-4baf-8f84-10148d61fd3c None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:18.648418 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-76cd7633-3bad-4baf-8f84-10148d61fd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:18.726658 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 478/960] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:18.746524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0aa40-ff77-4b19-a673-5939b3bf954b None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:18.750016 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd7633-3bad-4baf-8f84-10148d61fd3c None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:18.783091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca202b-e159-4f9f-b06b-324274b19046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:18.783829 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca202b-e159-4f9f-b06b-324274b19046 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:18.784109 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca202b-e159-4f9f-b06b-324274b19046 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:18.784383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca202b-e159-4f9f-b06b-324274b19046 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:18.789241 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:18.799843 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca202b-e159-4f9f-b06b-324274b19046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:18.802824 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca202b-e159-4f9f-b06b-324274b19046 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:18.822178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-beca202b-e159-4f9f-b06b-324274b19046 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:18.822178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:18.822178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:18.822178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:18.822178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:18.822178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:18.822178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:18.822178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:18.822178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:18.822178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:18.822178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:18.822178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:18.822178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:43:18.822178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:43:18.822178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:43:18.823107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:43:18.823107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:18.823107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:18.823107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:18.823107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:18.823107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:18.823107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:18.823107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:18.823107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:18.823107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:18.823107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:18.823107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:18.823107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:18.823107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:18.823107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:18.823107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:18.823107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:18.824070 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:43:18.824070 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:43:18.824070 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:18.824070 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:18.827721 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 483/961] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:18.834027 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca202b-e159-4f9f-b06b-324274b19046 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:18.883621 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd7633-3bad-4baf-8f84-10148d61fd3c None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:18.892506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:18.922283 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c066dbb-77e7-42a4-8483-aa0199938847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:18.922946 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c066dbb-77e7-42a4-8483-aa0199938847 None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:18.923247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c066dbb-77e7-42a4-8483-aa0199938847 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:18.923583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c066dbb-77e7-42a4-8483-aa0199938847 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:18.924275 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c066dbb-77e7-42a4-8483-aa0199938847 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:18.925773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c066dbb-77e7-42a4-8483-aa0199938847 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:18.959340 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca202b-e159-4f9f-b06b-324274b19046 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:18.997133 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2f685-f3f8-4886-8938-bae7e92447c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:18.997689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2f685-f3f8-4886-8938-bae7e92447c4 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:18.997970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2f685-f3f8-4886-8938-bae7e92447c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:18.998279 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2f685-f3f8-4886-8938-bae7e92447c4 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:18.999142 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2f685-f3f8-4886-8938-bae7e92447c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:18.999485 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2f685-f3f8-4886-8938-bae7e92447c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:19.000865 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2f685-f3f8-4886-8938-bae7e92447c4 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:19.013743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 484/962] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:19.019294 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2f685-f3f8-4886-8938-bae7e92447c4 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:19.026669 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 479/963] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 28 03:43:18 2022] POST /identity/v3/services => generated 242 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:43:19.086085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:19.148295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33dc94-7de0-4ca3-af29-6817c0b9a23e None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:19.148608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33dc94-7de0-4ca3-af29-6817c0b9a23e None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:19.148856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33dc94-7de0-4ca3-af29-6817c0b9a23e None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:19.149328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2f685-f3f8-4886-8938-bae7e92447c4 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:19.155188 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 480/964] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:43:19.157217 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613799a-5b74-41a4-9968-9f903b3ef098 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:19.157504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613799a-5b74-41a4-9968-9f903b3ef098 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:19.157783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613799a-5b74-41a4-9968-9f903b3ef098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:19.176869 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-4613799a-5b74-41a4-9968-9f903b3ef098 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:19.178468 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-4613799a-5b74-41a4-9968-9f903b3ef098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:19.208025 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3985cb6-eaed-42d2-9ad0-eb40d293237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:19.209492 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3985cb6-eaed-42d2-9ad0-eb40d293237e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:19.209976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3985cb6-eaed-42d2-9ad0-eb40d293237e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:19.210686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3985cb6-eaed-42d2-9ad0-eb40d293237e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:19.224253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3985cb6-eaed-42d2-9ad0-eb40d293237e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:19.225747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3985cb6-eaed-42d2-9ad0-eb40d293237e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:19.240590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-b3985cb6-eaed-42d2-9ad0-eb40d293237e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 03:43:19.240590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:19.240590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:19.240590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:19.240590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:19.240590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:19.240590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:19.240590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:19.240590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:19.240590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:19.240590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:19.240590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:19.240590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:43:19.240590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:43:19.240590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:43:19.240590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:43:19.241536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:19.241536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:19.241536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:43:19.241536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:19.241536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:43:19.241536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:19.241536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:19.241536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:19.241536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:19.241536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:19.241536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:19.241536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:19.241536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:19.241536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:19.241536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:19.241536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:19.241536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:19.241536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:19.242618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:19.242618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:19.242618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:43:19.242618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:43:19.242618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:43:19.242618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:43:19.242618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:43:19.242618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:43:19.242618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 03:43:19.242618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:19.242618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 485/965] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 28 03:43:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:19.247423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3985cb6-eaed-42d2-9ad0-eb40d293237e None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:19.263683 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 481/966] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:19.290140 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613799a-5b74-41a4-9968-9f903b3ef098 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:19.367123 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3985cb6-eaed-42d2-9ad0-eb40d293237e None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:19.369676 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:19.395210 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:19.401961 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613799a-5b74-41a4-9968-9f903b3ef098 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:19.408949 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae5406-460c-4f0e-9f2a-5a4ff23124db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:19.409613 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae5406-460c-4f0e-9f2a-5a4ff23124db None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:19.409898 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae5406-460c-4f0e-9f2a-5a4ff23124db None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:19.410176 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae5406-460c-4f0e-9f2a-5a4ff23124db None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:19.410983 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae5406-460c-4f0e-9f2a-5a4ff23124db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:19.411299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae5406-460c-4f0e-9f2a-5a4ff23124db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:19.412771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae5406-460c-4f0e-9f2a-5a4ff23124db None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:19.436771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 486/967] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 28 03:43:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:19.437922 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae5406-460c-4f0e-9f2a-5a4ff23124db None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:19.456482 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40586f-56cc-416d-a757-87d1a04a73d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:19.457410 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40586f-56cc-416d-a757-87d1a04a73d3 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:19.457761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40586f-56cc-416d-a757-87d1a04a73d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:19.458179 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40586f-56cc-416d-a757-87d1a04a73d3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:19.459051 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40586f-56cc-416d-a757-87d1a04a73d3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:19.460833 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40586f-56cc-416d-a757-87d1a04a73d3 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:19.473249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-4a40586f-56cc-416d-a757-87d1a04a73d3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 03:43:19.473249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:19.473249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:43:19.473249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:43:19.473249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:43:19.473249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:43:19.473249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:43:19.473249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:19.473249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 03:43:19.473249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:19.473249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:19.473249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:19.473249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:19.473249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:19.473249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:19.473249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:19.473249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:19.474574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:19.474574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:19.474574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:19.474574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:19.474574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:19.474574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:19.474574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:43:19.474574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:43:19.474574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:43:19.474574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:43:19.474574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:19.474574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:19.474574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:19.474574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:19.474574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:19.474574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:19.475734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:19.475734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:19.475734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:19.475734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:19.475734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:19.475734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:19.475734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:19.475734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:19.475734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:19.475734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:19.475734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:43:19.475734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:19.475734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 03:43:19.475734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:19.481925 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 482/968] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 28 03:43:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:19.484698 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40586f-56cc-416d-a757-87d1a04a73d3 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:19.560185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae5406-460c-4f0e-9f2a-5a4ff23124db None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:19.614798 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40586f-56cc-416d-a757-87d1a04a73d3 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:19.615665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb322e8c-acc0-4c03-b0c4-8e248c14887e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:19.616724 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb322e8c-acc0-4c03-b0c4-8e248c14887e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:19.617372 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb322e8c-acc0-4c03-b0c4-8e248c14887e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:19.618716 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb322e8c-acc0-4c03-b0c4-8e248c14887e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:19.652501 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94656be4-9ebd-4218-b755-91cd4f654e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:19.653284 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656be4-9ebd-4218-b755-91cd4f654e20 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:19.653927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656be4-9ebd-4218-b755-91cd4f654e20 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:19.654304 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656be4-9ebd-4218-b755-91cd4f654e20 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:19.655763 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94656be4-9ebd-4218-b755-91cd4f654e20 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:19.656061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94656be4-9ebd-4218-b755-91cd4f654e20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:19.657558 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94656be4-9ebd-4218-b755-91cd4f654e20 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:19.662573 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:19.668413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 483/969] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 28 03:43:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:19.669704 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94656be4-9ebd-4218-b755-91cd4f654e20 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:19.704641 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:19.709917 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb322e8c-acc0-4c03-b0c4-8e248c14887e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:19.711515 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb322e8c-acc0-4c03-b0c4-8e248c14887e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:19.810327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94656be4-9ebd-4218-b755-91cd4f654e20 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:19.823785 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 487/970] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:43:19 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 03:43:19.825489 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb322e8c-acc0-4c03-b0c4-8e248c14887e None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:19.864579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2298d3c-d203-4fb2-acea-3eda6a34002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:19.865586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2298d3c-d203-4fb2-acea-3eda6a34002f None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:19.866087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2298d3c-d203-4fb2-acea-3eda6a34002f None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:19.866584 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2298d3c-d203-4fb2-acea-3eda6a34002f None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:19.867938 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2298d3c-d203-4fb2-acea-3eda6a34002f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:19.868458 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2298d3c-d203-4fb2-acea-3eda6a34002f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:19.870403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2298d3c-d203-4fb2-acea-3eda6a34002f None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:19.883000 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 484/971] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 28 03:43:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:19.887374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2298d3c-d203-4fb2-acea-3eda6a34002f None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:19.896933 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:19.938096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb322e8c-acc0-4c03-b0c4-8e248c14887e None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:19.975632 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec327b-3cd0-4077-8fb2-0480d6af0043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:19.976102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec327b-3cd0-4077-8fb2-0480d6af0043 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:19.976381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec327b-3cd0-4077-8fb2-0480d6af0043 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:19.976653 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec327b-3cd0-4077-8fb2-0480d6af0043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:19.990853 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec327b-3cd0-4077-8fb2-0480d6af0043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:19.993004 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec327b-3cd0-4077-8fb2-0480d6af0043 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:20.006736 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:20.009661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-a9ec327b-3cd0-4077-8fb2-0480d6af0043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:20.009661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:20.009661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:20.009661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:20.009661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:20.009661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:20.009661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:20.009661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:20.009661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:20.009661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:20.009661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:20.009661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:20.009661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:43:20.009661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:43:20.009661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:43:20.010607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:43:20.010607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:20.010607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:20.010607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:20.010607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:20.010607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:20.010607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:20.010607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:20.010607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:20.010607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:20.010607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:20.010607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:20.010607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:20.010607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:20.010607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:20.010607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:20.010607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:20.012343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:43:20.012343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:43:20.012343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:20.012343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:20.012343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 488/972] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:20.012616 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de0296-8e74-46a4-bfa3-ac7a07cde791 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:20.012683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de0296-8e74-46a4-bfa3-ac7a07cde791 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:20.013063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de0296-8e74-46a4-bfa3-ac7a07cde791 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:20.015352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 489/973] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:20.020321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f29fb9-c6f5-4396-b671-a91b42fba770 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:20.020795 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f29fb9-c6f5-4396-b671-a91b42fba770 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:20.021293 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f29fb9-c6f5-4396-b671-a91b42fba770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:20.027226 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2298d3c-d203-4fb2-acea-3eda6a34002f None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:20.040341 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-e7f29fb9-c6f5-4396-b671-a91b42fba770 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:20.041611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e7f29fb9-c6f5-4396-b671-a91b42fba770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:20.069018 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff44ef3-402e-46ba-9456-8e840b57f3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:20.069571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff44ef3-402e-46ba-9456-8e840b57f3ce None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:20.069915 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff44ef3-402e-46ba-9456-8e840b57f3ce None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:20.070119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff44ef3-402e-46ba-9456-8e840b57f3ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:20.070868 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff44ef3-402e-46ba-9456-8e840b57f3ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:20.072248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff44ef3-402e-46ba-9456-8e840b57f3ce None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:20.112610 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 490/974] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:20.113460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f29fb9-c6f5-4396-b671-a91b42fba770 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:20.159215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:20.175494 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 485/975] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 03:43:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:43:20.176428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff44ef3-402e-46ba-9456-8e840b57f3ce None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:20.222261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f29fb9-c6f5-4396-b671-a91b42fba770 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:20.280544 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba7df5-3679-4966-8649-75518f5c20d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:20.281204 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba7df5-3679-4966-8649-75518f5c20d5 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:20.281555 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba7df5-3679-4966-8649-75518f5c20d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:20.281832 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba7df5-3679-4966-8649-75518f5c20d5 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:20.282618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba7df5-3679-4966-8649-75518f5c20d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:20.282933 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba7df5-3679-4966-8649-75518f5c20d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:20.284513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba7df5-3679-4966-8649-75518f5c20d5 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:20.303517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 491/976] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:20.310351 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba7df5-3679-4966-8649-75518f5c20d5 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:20.339647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff44ef3-402e-46ba-9456-8e840b57f3ce None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:20.386969 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88f6f0-d89b-40a5-bfe2-f5a91a8ee965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:20.388043 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88f6f0-d89b-40a5-bfe2-f5a91a8ee965 None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:20.388327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88f6f0-d89b-40a5-bfe2-f5a91a8ee965 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:20.388604 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88f6f0-d89b-40a5-bfe2-f5a91a8ee965 None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:20.389858 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88f6f0-d89b-40a5-bfe2-f5a91a8ee965 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:20.391841 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88f6f0-d89b-40a5-bfe2-f5a91a8ee965 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:20.394696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: WARNING keystone.server.flask.common [None req-fd88f6f0-d89b-40a5-bfe2-f5a91a8ee965 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 03:43:20.431259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:20.434745 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba7df5-3679-4966-8649-75518f5c20d5 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:20.451428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.sql.core [None req-fd88f6f0-d89b-40a5-bfe2-f5a91a8ee965 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 03:43:20.451428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 03:43:20.451428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [parameters: {'user_id': '21f41dad95a0440d89c6d4c9d970159b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 03:43:20.451428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86894) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 03:43:20.461733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-fd88f6f0-d89b-40a5-bfe2-f5a91a8ee965 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 03:43:20.461733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:20.461733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 03:43:20.461733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 03:43:20.461733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 03:43:20.461733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 03:43:20.461733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 03:43:20.461733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 03:43:20.461733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 03:43:20.461733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application conn.query(q) Jul 28 03:43:20.461733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 03:43:20.461733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 03:43:20.461733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 03:43:20.461733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application result.read() Jul 28 03:43:20.461733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 03:43:20.464824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 03:43:20.464824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 03:43:20.464824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 03:43:20.464824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 03:43:20.464824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 03:43:20.464824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 03:43:20.464824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 03:43:20.464824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 03:43:20.464824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:20.464824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 03:43:20.464824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:20.464824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:20.464824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 03:43:20.464824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 03:43:20.464824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 28 03:43:20.464824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 28 03:43:20.464824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 03:43:20.464824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application next(self.gen) Jul 28 03:43:20.465799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 03:43:20.465799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application yield resource Jul 28 03:43:20.465799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 03:43:20.465799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application next(self.gen) Jul 28 03:43:20.465799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 03:43:20.465799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 03:43:20.465799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:43:20.465799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 03:43:20.465799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:43:20.465799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise self.value Jul 28 03:43:20.465799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 03:43:20.465799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 03:43:20.465799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 03:43:20.465799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application session.commit() Jul 28 03:43:20.465799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 03:43:20.465799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 03:43:20.465799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 03:43:20.466715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 03:43:20.466715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 03:43:20.466715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self.session.flush() Jul 28 03:43:20.466715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 03:43:20.466715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 03:43:20.466715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 03:43:20.466715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 03:43:20.466715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 03:43:20.466715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application compat.raise_( Jul 28 03:43:20.466715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 03:43:20.466715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception Jul 28 03:43:20.466715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 03:43:20.466715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 03:43:20.466715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 03:43:20.466715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 03:43:20.466715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 03:43:20.466715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 03:43:20.467693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 03:43:20.467693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 03:43:20.467693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 03:43:20.467693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 28 03:43:20.467693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 03:43:20.467693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 03:43:20.467693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 03:43:20.467693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 03:43:20.467693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 03:43:20.467693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 03:43:20.467693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 03:43:20.467693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 03:43:20.467693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 03:43:20.467693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 03:43:20.467693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 03:43:20.467693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception Jul 28 03:43:20.468644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 03:43:20.468644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 03:43:20.468644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 03:43:20.468644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 03:43:20.468644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 03:43:20.468644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 03:43:20.468644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 03:43:20.468644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application conn.query(q) Jul 28 03:43:20.468644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 03:43:20.468644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 03:43:20.468644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 03:43:20.468644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application result.read() Jul 28 03:43:20.468644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 03:43:20.468644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 03:43:20.468644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 03:43:20.468644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 03:43:20.469481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 03:43:20.469481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 03:43:20.469481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 03:43:20.469481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 03:43:20.469481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 03:43:20.469481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 03:43:20.469481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [parameters: {'user_id': '21f41dad95a0440d89c6d4c9d970159b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 03:43:20.469481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 03:43:20.469481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:20.469481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:20.469481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:20.469481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:20.469481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:20.469481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:20.469481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:20.475647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:20.475647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:20.475647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:20.475647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:20.475647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:20.475647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:20.475647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:20.475647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 28 03:43:20.475647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 28 03:43:20.475647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:20.475647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:20.475647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:43:20.475647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:20.475647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:43:20.475647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:20.475647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 28 03:43:20.475647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 28 03:43:20.477913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 28 03:43:20.477913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 28 03:43:20.477913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 03:43:20.477913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 03:43:20.477913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 03:43:20.477913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:20.477913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 486/977] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Jul 28 03:43:20 2022] POST /identity/v3/users => generated 160 bytes in 288 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:20.478995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3c424-a30c-40b0-aaab-92806201ee15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:20.478995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3c424-a30c-40b0-aaab-92806201ee15 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:20.478995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3c424-a30c-40b0-aaab-92806201ee15 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:20.478995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3c424-a30c-40b0-aaab-92806201ee15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:20.484192 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88f6f0-d89b-40a5-bfe2-f5a91a8ee965 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:20.486340 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3c424-a30c-40b0-aaab-92806201ee15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:20.487954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3c424-a30c-40b0-aaab-92806201ee15 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:20.494091 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:20.502151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-dfd3c424-a30c-40b0-aaab-92806201ee15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:20.502151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:20.502151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:20.502151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:20.502151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:20.502151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:20.502151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:20.502151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:20.502151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:20.502151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:20.502151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:20.502151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:20.502151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:43:20.502151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:43:20.502151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:43:20.503106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:43:20.503106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:20.503106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:20.503106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:20.503106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:20.503106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:20.503106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:20.503106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:20.503106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:20.503106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:20.503106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:20.503106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:20.503106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:20.503106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:20.503106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:20.503106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:20.503106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:20.504756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:43:20.504756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:43:20.504756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:43:20.504756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:43:20.504756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:43:20.504756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:43:20.504756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:20.504756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:20.504756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 492/978] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:43:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:20.509133 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3c424-a30c-40b0-aaab-92806201ee15 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:20.614598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88f6f0-d89b-40a5-bfe2-f5a91a8ee965 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:20.628272 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3c424-a30c-40b0-aaab-92806201ee15 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:20.651722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b3a86-b8f1-4eea-8892-baffb702e446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:20.652418 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b3a86-b8f1-4eea-8892-baffb702e446 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:20.652652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b3a86-b8f1-4eea-8892-baffb702e446 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:20.652927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b3a86-b8f1-4eea-8892-baffb702e446 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:20.661749 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b3a86-b8f1-4eea-8892-baffb702e446 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:20.663274 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b3a86-b8f1-4eea-8892-baffb702e446 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:20.674156 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715e313-689d-4489-9928-acb151b4c0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:20.675112 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715e313-689d-4489-9928-acb151b4c0b5 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:20.675490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-591b3a86-b8f1-4eea-8892-baffb702e446 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 03:43:20.675490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:20.675490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:20.675490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:20.675490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:20.675490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:20.675490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:20.675490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:20.675490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:20.675490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:20.675490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:20.675490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:20.675490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:43:20.675490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:43:20.675490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:43:20.675490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:43:20.676395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:20.676395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:20.676395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:43:20.676395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:20.676395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:43:20.676395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:20.676395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:20.676395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:20.676395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:20.676395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:20.676395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:20.676395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:20.676395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:20.676395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:20.676395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:20.676395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:20.676395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:20.676395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:20.677316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:20.677316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:20.677316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:43:20.677316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:43:20.677316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:43:20.677316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:43:20.677316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:43:20.677316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:43:20.677316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 03:43:20.677316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:20.678616 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715e313-689d-4489-9928-acb151b4c0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:20.679088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715e313-689d-4489-9928-acb151b4c0b5 None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:20.680085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715e313-689d-4489-9928-acb151b4c0b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:20.680602 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715e313-689d-4489-9928-acb151b4c0b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:20.681717 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 487/979] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:43:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:20.682597 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b3a86-b8f1-4eea-8892-baffb702e446 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:20.683207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715e313-689d-4489-9928-acb151b4c0b5 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:20.703545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 493/980] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:43:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:20.704651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715e313-689d-4489-9928-acb151b4c0b5 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:20.728603 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:20.784760 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:20.824778 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b3a86-b8f1-4eea-8892-baffb702e446 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:20.825282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715e313-689d-4489-9928-acb151b4c0b5 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:20.862352 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37c5f7-8362-4401-9b7d-a62fcbaa2ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:20.863069 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37c5f7-8362-4401-9b7d-a62fcbaa2ba7 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:20.863621 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37c5f7-8362-4401-9b7d-a62fcbaa2ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:20.863732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37c5f7-8362-4401-9b7d-a62fcbaa2ba7 None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:20.864514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37c5f7-8362-4401-9b7d-a62fcbaa2ba7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:20.864859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37c5f7-8362-4401-9b7d-a62fcbaa2ba7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:20.866308 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37c5f7-8362-4401-9b7d-a62fcbaa2ba7 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:20.872399 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdd9f0-ab55-49cf-b803-f1d9a2172fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:20.873269 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd9f0-ab55-49cf-b803-f1d9a2172fdd None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:20.873825 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd9f0-ab55-49cf-b803-f1d9a2172fdd None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:20.874304 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd9f0-ab55-49cf-b803-f1d9a2172fdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:20.875293 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdd9f0-ab55-49cf-b803-f1d9a2172fdd None admin] RBAC: Adding query filter params (role.id=c06601c249ef4cad81ec53a2e55aba1e, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=420e2a81b66a470e8db624efd61fd1cd) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:20.875850 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdd9f0-ab55-49cf-b803-f1d9a2172fdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:20.878317 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdd9f0-ab55-49cf-b803-f1d9a2172fdd None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:20.885744 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 494/981] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:43:20 2022] GET /identity/v3/role_assignments?user.id=420e2a81b66a470e8db624efd61fd1cd&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=c06601c249ef4cad81ec53a2e55aba1e => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:20.910066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 488/982] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 28 03:43:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:21.243998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5fd45-30e6-4e17-8d4b-aeba2a8445ec None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:21.244343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5fd45-30e6-4e17-8d4b-aeba2a8445ec None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:21.244447 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5fd45-30e6-4e17-8d4b-aeba2a8445ec None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:21.245862 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 495/983] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:21.251801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80156814-24d8-4ef5-9177-0c4016400705 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:21.252095 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80156814-24d8-4ef5-9177-0c4016400705 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:21.252374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80156814-24d8-4ef5-9177-0c4016400705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:21.271551 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-80156814-24d8-4ef5-9177-0c4016400705 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:21.273060 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-80156814-24d8-4ef5-9177-0c4016400705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:21.345212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 489/984] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:21.367091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5fd45-30e6-4e17-8d4b-aeba2a8445ec None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:21.458829 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:21.475777 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5fd45-30e6-4e17-8d4b-aeba2a8445ec None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:21.510943 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ef220-c0fd-4a05-a644-45a3ca633e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:21.511537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ef220-c0fd-4a05-a644-45a3ca633e87 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:21.511820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ef220-c0fd-4a05-a644-45a3ca633e87 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:21.512093 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ef220-c0fd-4a05-a644-45a3ca633e87 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:21.512716 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ef220-c0fd-4a05-a644-45a3ca633e87 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:21.514161 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ef220-c0fd-4a05-a644-45a3ca633e87 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:21.523051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-348ef220-c0fd-4a05-a644-45a3ca633e87 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 03:43:21.523051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:21.523051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:43:21.523051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:43:21.523051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:43:21.523051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:43:21.523051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:43:21.523051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:21.523051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 03:43:21.523051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:21.523051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:21.523051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:21.523051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:21.523051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:21.523051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:21.523051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:21.523051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:21.524048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:21.524048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:21.524048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:21.524048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:21.524048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:21.524048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:21.524048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:43:21.524048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:43:21.524048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:43:21.524048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:43:21.524048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:21.524048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:21.524048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:21.524048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:21.524048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:21.524048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:21.525007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:21.525007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:21.525007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:21.525007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:21.525007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:21.525007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:21.525007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:21.525007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:21.525007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:21.525007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:21.525007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:43:21.525007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:21.525007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 03:43:21.525007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:21.526671 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 496/985] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:43:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:21.530703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80156814-24d8-4ef5-9177-0c4016400705 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:21.588396 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:21.632954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80156814-24d8-4ef5-9177-0c4016400705 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:21.668783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3387c-bb9c-46f4-af51-babd2dba919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:21.669412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3387c-bb9c-46f4-af51-babd2dba919e None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:21.669691 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3387c-bb9c-46f4-af51-babd2dba919e None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:21.669962 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3387c-bb9c-46f4-af51-babd2dba919e None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:21.670963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3387c-bb9c-46f4-af51-babd2dba919e None admin] RBAC: Adding query filter params (name=compute) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:21.671268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3387c-bb9c-46f4-af51-babd2dba919e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:21.672679 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3387c-bb9c-46f4-af51-babd2dba919e None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:21.678852 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 490/986] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 28 03:43:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:21.683604 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ef220-c0fd-4a05-a644-45a3ca633e87 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:21.796945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ef220-c0fd-4a05-a644-45a3ca633e87 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:21.832654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081450a4-c157-4135-8036-3d73f65d6990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:21.833269 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081450a4-c157-4135-8036-3d73f65d6990 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:21.833534 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081450a4-c157-4135-8036-3d73f65d6990 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:21.833804 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081450a4-c157-4135-8036-3d73f65d6990 None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:21.834476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081450a4-c157-4135-8036-3d73f65d6990 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:21.834773 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081450a4-c157-4135-8036-3d73f65d6990 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:21.836156 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081450a4-c157-4135-8036-3d73f65d6990 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:21.846633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 497/987] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 28 03:43:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:21.847908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3387c-bb9c-46f4-af51-babd2dba919e None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:21.955104 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3387c-bb9c-46f4-af51-babd2dba919e None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:21.972986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:21.990614 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb605a8-3448-438e-8c34-9ab55c8f0094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:21.991241 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb605a8-3448-438e-8c34-9ab55c8f0094 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:21.991550 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb605a8-3448-438e-8c34-9ab55c8f0094 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:21.991823 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb605a8-3448-438e-8c34-9ab55c8f0094 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:21.992580 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb605a8-3448-438e-8c34-9ab55c8f0094 None admin] RBAC: Adding query filter params (interface=public, service_id=3b5a25bc84b043f9b35f613939210eb5, region_id=RegionOne) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:21.992884 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb605a8-3448-438e-8c34-9ab55c8f0094 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:21.994317 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb605a8-3448-438e-8c34-9ab55c8f0094 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:22.004411 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 491/988] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 28 03:43:21 2022] GET /identity/v3/endpoints?service_id=3b5a25bc84b043f9b35f613939210eb5&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:22.006004 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081450a4-c157-4135-8036-3d73f65d6990 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:22.023298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:22.118518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081450a4-c157-4135-8036-3d73f65d6990 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:22.155135 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70dbba-041f-4765-aa08-03526428b0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:22.156058 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70dbba-041f-4765-aa08-03526428b0b4 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:22.156485 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70dbba-041f-4765-aa08-03526428b0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:22.156917 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70dbba-041f-4765-aa08-03526428b0b4 None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:22.157717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70dbba-041f-4765-aa08-03526428b0b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:22.159305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70dbba-041f-4765-aa08-03526428b0b4 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:22.171532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 498/989] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 28 03:43:22 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:43:22.319139 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742554b-c73a-40dc-a1ef-ac304861def6 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:22.319482 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742554b-c73a-40dc-a1ef-ac304861def6 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:22.319743 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742554b-c73a-40dc-a1ef-ac304861def6 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:22.321317 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 492/990] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:22.327190 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4368dd-4f37-4183-9510-210e03311f64 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:22.327563 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4368dd-4f37-4183-9510-210e03311f64 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:22.327845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4368dd-4f37-4183-9510-210e03311f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:22.347893 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-3c4368dd-4f37-4183-9510-210e03311f64 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:22.349103 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-3c4368dd-4f37-4183-9510-210e03311f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:22.423476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 499/991] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:22.444043 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742554b-c73a-40dc-a1ef-ac304861def6 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:22.550491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742554b-c73a-40dc-a1ef-ac304861def6 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:22.586439 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf44ae-e031-45ab-a088-5af5ee0044c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:22.587066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf44ae-e031-45ab-a088-5af5ee0044c0 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:22.587372 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf44ae-e031-45ab-a088-5af5ee0044c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:22.587648 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf44ae-e031-45ab-a088-5af5ee0044c0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:22.588276 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf44ae-e031-45ab-a088-5af5ee0044c0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:22.589657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf44ae-e031-45ab-a088-5af5ee0044c0 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:22.598685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-3ebf44ae-e031-45ab-a088-5af5ee0044c0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 03:43:22.598685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:22.598685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:43:22.598685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:43:22.598685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:43:22.598685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:43:22.598685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:43:22.598685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:22.598685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 03:43:22.598685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:22.598685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:22.598685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:22.598685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:22.598685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:22.598685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:22.598685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:22.598685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:22.600050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:22.600050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:22.600050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:22.600050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:22.600050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:22.600050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:22.600050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:43:22.600050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:43:22.600050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:43:22.600050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:43:22.600050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:22.600050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:22.600050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:22.600050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:22.600050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:22.600050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:22.605942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:22.605942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:22.605942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:22.605942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:22.605942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:22.605942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:22.605942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:22.605942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:22.605942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:22.605942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:22.605942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:43:22.605942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:22.605942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 03:43:22.605942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:22.605942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 493/992] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 28 03:43:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:22.608900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4368dd-4f37-4183-9510-210e03311f64 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:22.617111 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:22.714612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4368dd-4f37-4183-9510-210e03311f64 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:22.749541 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d6dcb-d75c-4262-b633-5a085827cef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:22.750249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d6dcb-d75c-4262-b633-5a085827cef6 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:22.750523 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d6dcb-d75c-4262-b633-5a085827cef6 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:22.750786 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d6dcb-d75c-4262-b633-5a085827cef6 None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:22.753299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d6dcb-d75c-4262-b633-5a085827cef6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:22.753299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d6dcb-d75c-4262-b633-5a085827cef6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:22.753299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d6dcb-d75c-4262-b633-5a085827cef6 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:22.762693 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 500/993] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 28 03:43:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:22.764689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf44ae-e031-45ab-a088-5af5ee0044c0 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:22.816171 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:22.870585 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf44ae-e031-45ab-a088-5af5ee0044c0 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:22.907155 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e10dd2-30f0-477c-b023-b227df567ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:22.907802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e10dd2-30f0-477c-b023-b227df567ca6 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:22.908090 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e10dd2-30f0-477c-b023-b227df567ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:22.908369 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e10dd2-30f0-477c-b023-b227df567ca6 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:22.909062 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e10dd2-30f0-477c-b023-b227df567ca6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:22.909369 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e10dd2-30f0-477c-b023-b227df567ca6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:22.910738 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e10dd2-30f0-477c-b023-b227df567ca6 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:22.916081 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 494/994] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 28 03:43:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:22.922312 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d6dcb-d75c-4262-b633-5a085827cef6 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:22.994999 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:23.005804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984f7ed-e02f-434c-8fef-acd978abbf67 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:23.006095 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984f7ed-e02f-434c-8fef-acd978abbf67 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:23.006376 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984f7ed-e02f-434c-8fef-acd978abbf67 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:23.007780 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 495/995] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:43:23.012966 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50eda11-479f-40bc-a4aa-21c647a2f1b8 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:23.013252 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50eda11-479f-40bc-a4aa-21c647a2f1b8 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:23.013524 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50eda11-479f-40bc-a4aa-21c647a2f1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:23.027296 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d6dcb-d75c-4262-b633-5a085827cef6 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:23.033355 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-b50eda11-479f-40bc-a4aa-21c647a2f1b8 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:23.034545 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b50eda11-479f-40bc-a4aa-21c647a2f1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:23.066577 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af2ac1-edf4-4930-a082-a1089c40fb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:23.067769 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af2ac1-edf4-4930-a082-a1089c40fb31 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:23.068332 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af2ac1-edf4-4930-a082-a1089c40fb31 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:23.068680 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af2ac1-edf4-4930-a082-a1089c40fb31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:23.071145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af2ac1-edf4-4930-a082-a1089c40fb31 None admin] RBAC: Adding query filter params (interface=admin, service_id=c0241d65f98d4fc3b3ab6cb8a049d28b, region_id=RegionOne) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:23.071145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af2ac1-edf4-4930-a082-a1089c40fb31 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:23.071443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af2ac1-edf4-4930-a082-a1089c40fb31 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:23.077656 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 501/996] 10.222.0.64 () {56 vars in 1249 bytes} [Thu Jul 28 03:43:22 2022] GET /identity/v3/endpoints?service_id=c0241d65f98d4fc3b3ab6cb8a049d28b&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:23.082920 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af2ac1-edf4-4930-a082-a1089c40fb31 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:23.109911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 496/997] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 03:43:23.132092 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50eda11-479f-40bc-a4aa-21c647a2f1b8 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:23.178580 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:23.193984 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af2ac1-edf4-4930-a082-a1089c40fb31 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:23.230493 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a39575-2075-4fda-94bf-81507a2d0a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:23.231118 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a39575-2075-4fda-94bf-81507a2d0a79 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:23.231429 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a39575-2075-4fda-94bf-81507a2d0a79 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:23.231806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a39575-2075-4fda-94bf-81507a2d0a79 None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:23.232356 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a39575-2075-4fda-94bf-81507a2d0a79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:23.234340 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a39575-2075-4fda-94bf-81507a2d0a79 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:23.236065 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:23.239864 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50eda11-479f-40bc-a4aa-21c647a2f1b8 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:23.242146 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 502/998] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 28 03:43:23 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:43:23.281682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46c78b-2450-4800-976e-4fa83354213a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:23.282324 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46c78b-2450-4800-976e-4fa83354213a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:23.282614 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46c78b-2450-4800-976e-4fa83354213a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:23.282890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46c78b-2450-4800-976e-4fa83354213a None admin] PATH_INFO: `/v3/services/image` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:23.283568 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46c78b-2450-4800-976e-4fa83354213a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:23.284998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46c78b-2450-4800-976e-4fa83354213a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:23.294949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-fa46c78b-2450-4800-976e-4fa83354213a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 03:43:23.294949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:23.294949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:43:23.294949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:43:23.294949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:43:23.294949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:43:23.294949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:43:23.294949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:23.294949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 03:43:23.294949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:23.294949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:23.294949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:23.294949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:23.294949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:23.294949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:23.294949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:23.294949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:23.296958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:23.296958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:23.296958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:23.296958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:23.296958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:23.296958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:23.296958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:43:23.296958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:43:23.296958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:43:23.296958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:43:23.296958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:23.296958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:23.296958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:23.296958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:23.296958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:23.296958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:23.297822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:23.297822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:23.297822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:23.297822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:23.297822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:23.297822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:23.297822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:23.297822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:23.297822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:23.297822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:23.297822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:43:23.297822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:23.297822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 03:43:23.297822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:23.297822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 497/999] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Jul 28 03:43:23 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:23.306220 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a39575-2075-4fda-94bf-81507a2d0a79 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:23.421239 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a39575-2075-4fda-94bf-81507a2d0a79 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:23.457719 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e31d8d-7a61-4799-b51d-18bd1638eb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:23.458344 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e31d8d-7a61-4799-b51d-18bd1638eb6c None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:23.458620 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e31d8d-7a61-4799-b51d-18bd1638eb6c None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:23.458889 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e31d8d-7a61-4799-b51d-18bd1638eb6c None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:23.459588 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e31d8d-7a61-4799-b51d-18bd1638eb6c None admin] RBAC: Adding query filter params (name=image) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:23.459934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e31d8d-7a61-4799-b51d-18bd1638eb6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:23.461357 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e31d8d-7a61-4799-b51d-18bd1638eb6c None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:23.467562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 503/1000] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:23.473295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46c78b-2450-4800-976e-4fa83354213a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:23.579223 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46c78b-2450-4800-976e-4fa83354213a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:23.582488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:23.621539 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c4b7a-e4f7-4858-8b0c-77d5b654a396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:23.622691 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c4b7a-e4f7-4858-8b0c-77d5b654a396 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:23.623882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c4b7a-e4f7-4858-8b0c-77d5b654a396 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:23.624419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c4b7a-e4f7-4858-8b0c-77d5b654a396 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:23.625620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c4b7a-e4f7-4858-8b0c-77d5b654a396 None admin] RBAC: Adding query filter params (type=image) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:23.625919 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c4b7a-e4f7-4858-8b0c-77d5b654a396 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:23.627380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c4b7a-e4f7-4858-8b0c-77d5b654a396 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:23.632322 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 498/1001] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:24.219288 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71f0a5-ec4a-4514-b3f0-767bb4470f4a None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:24.219864 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71f0a5-ec4a-4514-b3f0-767bb4470f4a None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:24.219864 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71f0a5-ec4a-4514-b3f0-767bb4470f4a None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:24.221397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 504/1002] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:24.226241 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a8d4a-1d89-441d-a20a-c03bd1d65e79 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:24.226534 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a8d4a-1d89-441d-a20a-c03bd1d65e79 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:24.226813 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a8d4a-1d89-441d-a20a-c03bd1d65e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:24.244848 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-189a8d4a-1d89-441d-a20a-c03bd1d65e79 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:24.246047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-189a8d4a-1d89-441d-a20a-c03bd1d65e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:24.316713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 499/1003] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:24.339467 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71f0a5-ec4a-4514-b3f0-767bb4470f4a None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:24.407170 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:24.449400 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71f0a5-ec4a-4514-b3f0-767bb4470f4a None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:24.484523 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b109a-cb4f-42f8-a29e-2b3f4a928db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:24.485104 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b109a-cb4f-42f8-a29e-2b3f4a928db6 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:24.485466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b109a-cb4f-42f8-a29e-2b3f4a928db6 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:24.485656 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b109a-cb4f-42f8-a29e-2b3f4a928db6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:24.486280 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b109a-cb4f-42f8-a29e-2b3f4a928db6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:24.487673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b109a-cb4f-42f8-a29e-2b3f4a928db6 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:24.496460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-e15b109a-cb4f-42f8-a29e-2b3f4a928db6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 03:43:24.496460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:24.496460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:43:24.496460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:43:24.496460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:43:24.496460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:43:24.496460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:43:24.496460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:24.496460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 03:43:24.496460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:24.496460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:24.496460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:24.496460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:24.496460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:24.496460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:24.496460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:24.496460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:24.497438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:24.497438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:24.497438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:24.497438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:24.497438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:24.497438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:24.497438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:43:24.497438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:43:24.497438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:43:24.497438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:43:24.497438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:24.497438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:24.497438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:24.497438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:24.497438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:24.497438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:24.498461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:24.498461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:24.498461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:24.498461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:24.498461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:24.498461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:24.498461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:24.498461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:24.498461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:24.498461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:24.498461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:43:24.498461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:24.498461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 03:43:24.498461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:24.506513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 505/1004] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:43:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:24.506647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a8d4a-1d89-441d-a20a-c03bd1d65e79 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:24.604412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:24.608718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a8d4a-1d89-441d-a20a-c03bd1d65e79 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:24.643450 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3a9ec-ee7e-4bb4-b7e2-567d732c3610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:24.644125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3a9ec-ee7e-4bb4-b7e2-567d732c3610 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:24.644408 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3a9ec-ee7e-4bb4-b7e2-567d732c3610 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:24.644676 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3a9ec-ee7e-4bb4-b7e2-567d732c3610 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:24.645420 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3a9ec-ee7e-4bb4-b7e2-567d732c3610 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:24.645727 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3a9ec-ee7e-4bb4-b7e2-567d732c3610 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:24.647093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3a9ec-ee7e-4bb4-b7e2-567d732c3610 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:24.652370 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 500/1005] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 28 03:43:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:24.658568 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b109a-cb4f-42f8-a29e-2b3f4a928db6 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:24.762584 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b109a-cb4f-42f8-a29e-2b3f4a928db6 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:24.793195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:24.802044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdaa25-a5eb-450b-9517-90136ae1d98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:24.802680 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdaa25-a5eb-450b-9517-90136ae1d98f None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:24.806881 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdaa25-a5eb-450b-9517-90136ae1d98f None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:24.806881 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdaa25-a5eb-450b-9517-90136ae1d98f None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:24.806881 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdaa25-a5eb-450b-9517-90136ae1d98f None admin] RBAC: Adding query filter params (type=compute) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:24.806881 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdaa25-a5eb-450b-9517-90136ae1d98f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:24.806881 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdaa25-a5eb-450b-9517-90136ae1d98f None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:24.816359 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 506/1006] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 28 03:43:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:24.818058 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3a9ec-ee7e-4bb4-b7e2-567d732c3610 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:24.923446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3a9ec-ee7e-4bb4-b7e2-567d732c3610 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:24.958446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da1d1d-50fb-48fc-8001-16c66a7af031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:24.959071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da1d1d-50fb-48fc-8001-16c66a7af031 None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:24.959375 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da1d1d-50fb-48fc-8001-16c66a7af031 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:24.959655 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da1d1d-50fb-48fc-8001-16c66a7af031 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:24.960370 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da1d1d-50fb-48fc-8001-16c66a7af031 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:24.961736 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da1d1d-50fb-48fc-8001-16c66a7af031 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:25.052126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 501/1007] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 03:43:24 2022] POST /identity/v3/endpoints => generated 334 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:43:25.275764 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa27f3-87b1-4b3e-8d69-e507c0e22375 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:25.276611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa27f3-87b1-4b3e-8d69-e507c0e22375 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:25.276884 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa27f3-87b1-4b3e-8d69-e507c0e22375 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:25.278586 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 507/1008] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:25.284087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c400282-dace-4441-8f2f-2fbd39db0eb6 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:25.284372 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c400282-dace-4441-8f2f-2fbd39db0eb6 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:25.284644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c400282-dace-4441-8f2f-2fbd39db0eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:25.305634 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-6c400282-dace-4441-8f2f-2fbd39db0eb6 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:25.307175 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-6c400282-dace-4441-8f2f-2fbd39db0eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:25.322281 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:25.386510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 502/1009] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:25 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:25.410652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa27f3-87b1-4b3e-8d69-e507c0e22375 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:25.516518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa27f3-87b1-4b3e-8d69-e507c0e22375 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:25.555627 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee841c-3c3d-432f-92a7-45a4d2ef2084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:25.556334 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee841c-3c3d-432f-92a7-45a4d2ef2084 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:25.556548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee841c-3c3d-432f-92a7-45a4d2ef2084 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:25.556811 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee841c-3c3d-432f-92a7-45a4d2ef2084 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:25.557444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee841c-3c3d-432f-92a7-45a4d2ef2084 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:25.558805 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee841c-3c3d-432f-92a7-45a4d2ef2084 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:25.569998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-5bee841c-3c3d-432f-92a7-45a4d2ef2084 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 03:43:25.569998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:25.569998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:43:25.569998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:43:25.569998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:43:25.569998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:43:25.569998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:43:25.569998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:25.569998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 03:43:25.569998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:25.569998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:25.569998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:25.569998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:25.569998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:25.569998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:25.569998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:25.569998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:25.571023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:25.571023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:25.571023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:25.571023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:25.571023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:25.571023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:25.571023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:43:25.571023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:43:25.571023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:43:25.571023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:43:25.571023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:25.571023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:25.571023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:25.571023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:25.571023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:25.571023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:25.572329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:25.572329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:25.572329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:25.572329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:25.572329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:25.572329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:25.572329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:25.572329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:25.572329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:25.572329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:25.572329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:43:25.572329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:25.572329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 03:43:25.572329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:25.575412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 508/1010] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 28 03:43:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:25.578324 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c400282-dace-4441-8f2f-2fbd39db0eb6 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:25.672540 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c635236-6f6c-49b2-9a51-877d779b9943 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:25.673418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c635236-6f6c-49b2-9a51-877d779b9943 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:25.673703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c635236-6f6c-49b2-9a51-877d779b9943 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:25.675205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 509/1011] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:25.679948 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83940c-9d26-48a6-9068-657501a954f2 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:25.680238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83940c-9d26-48a6-9068-657501a954f2 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:25.680516 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83940c-9d26-48a6-9068-657501a954f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:25.685055 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c400282-dace-4441-8f2f-2fbd39db0eb6 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:25.703703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-da83940c-9d26-48a6-9068-657501a954f2 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:25.704814 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-da83940c-9d26-48a6-9068-657501a954f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:25.721574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7c108-48a1-4c1e-893f-117cf9da5ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:25.722206 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7c108-48a1-4c1e-893f-117cf9da5ddf None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:25.722544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7c108-48a1-4c1e-893f-117cf9da5ddf None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:25.722818 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7c108-48a1-4c1e-893f-117cf9da5ddf None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:25.723569 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7c108-48a1-4c1e-893f-117cf9da5ddf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:25.723872 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7c108-48a1-4c1e-893f-117cf9da5ddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:25.725236 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7c108-48a1-4c1e-893f-117cf9da5ddf None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:25.730506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 503/1012] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 28 03:43:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:25.736134 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7c108-48a1-4c1e-893f-117cf9da5ddf None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:25.746996 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:25.758480 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:25.779000 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 510/1013] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:25 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 03:43:25.802508 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83940c-9d26-48a6-9068-657501a954f2 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:25.855305 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7c108-48a1-4c1e-893f-117cf9da5ddf None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:25.894244 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99301341-b184-4722-a291-5de5c30fb36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:25.895514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99301341-b184-4722-a291-5de5c30fb36b None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:25.896215 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99301341-b184-4722-a291-5de5c30fb36b None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:25.896676 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99301341-b184-4722-a291-5de5c30fb36b None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:25.897738 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99301341-b184-4722-a291-5de5c30fb36b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:25.898512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99301341-b184-4722-a291-5de5c30fb36b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:25.900062 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99301341-b184-4722-a291-5de5c30fb36b None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:25.908459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 504/1014] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 28 03:43:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:25.913362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99301341-b184-4722-a291-5de5c30fb36b None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:25.914085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83940c-9d26-48a6-9068-657501a954f2 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:25.954388 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3a74d-a154-47eb-8d79-cb9d89af25ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:25.955347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3a74d-a154-47eb-8d79-cb9d89af25ab None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:25.955826 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3a74d-a154-47eb-8d79-cb9d89af25ab None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:25.956107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3a74d-a154-47eb-8d79-cb9d89af25ab None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:25.956809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3a74d-a154-47eb-8d79-cb9d89af25ab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:25.958254 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3a74d-a154-47eb-8d79-cb9d89af25ab None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:25.993744 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:26.022751 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99301341-b184-4722-a291-5de5c30fb36b None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:26.064014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6290fa-458b-408c-a951-ef4cca8981b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:26.069885 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6290fa-458b-408c-a951-ef4cca8981b0 None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:26.069885 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6290fa-458b-408c-a951-ef4cca8981b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:26.069885 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6290fa-458b-408c-a951-ef4cca8981b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:26.069885 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6290fa-458b-408c-a951-ef4cca8981b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:26.070295 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 511/1015] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 28 03:43:25 2022] POST /identity/v3/services => generated 242 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:43:26.070404 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6290fa-458b-408c-a951-ef4cca8981b0 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:26.168867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 505/1016] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 03:43:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:43:27.258385 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9393427-8515-4be4-b0cf-588f34599979 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:27.258939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9393427-8515-4be4-b0cf-588f34599979 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:27.258939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9393427-8515-4be4-b0cf-588f34599979 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:27.260462 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 512/1017] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:27.265950 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e110b25-31c3-40f0-8754-2dd2ffd7b0cc None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:27.266358 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e110b25-31c3-40f0-8754-2dd2ffd7b0cc None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:27.266518 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e110b25-31c3-40f0-8754-2dd2ffd7b0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:27.285975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-5e110b25-31c3-40f0-8754-2dd2ffd7b0cc None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:27.287181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-5e110b25-31c3-40f0-8754-2dd2ffd7b0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:27.364836 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 506/1018] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:27.388463 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9393427-8515-4be4-b0cf-588f34599979 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:27.437933 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:27.493403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9393427-8515-4be4-b0cf-588f34599979 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:27.527825 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decce367-41f6-4216-a87d-ad8955e5e22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:27.528654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decce367-41f6-4216-a87d-ad8955e5e22b None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:27.528933 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decce367-41f6-4216-a87d-ad8955e5e22b None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:27.529204 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decce367-41f6-4216-a87d-ad8955e5e22b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:27.540084 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decce367-41f6-4216-a87d-ad8955e5e22b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:43:27.545842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-decce367-41f6-4216-a87d-ad8955e5e22b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 03:43:27.545842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:27.545842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:27.545842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:27.545842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:27.545842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:27.545842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:27.545842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:27.545842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:27.545842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:27.545842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:27.545842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:27.545842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:43:27.545842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:43:27.545842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:43:27.545842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:43:27.546743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:43:27.546743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:43:27.546743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:43:27.546743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:43:27.546743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:27.546743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:27.546743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:27.546743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:27.546743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:27.546743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:27.546743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:27.546743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:27.546743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:27.546743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:27.546743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:27.546743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:27.552529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:27.552529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:27.552529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:27.552529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:27.552529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:43:27.552529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:43:27.552529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:43:27.552529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:43:27.552529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:43:27.552529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:43:27.552529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 03:43:27.552529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:27.552529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 513/1019] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 28 03:43:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:27.554303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e110b25-31c3-40f0-8754-2dd2ffd7b0cc None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:27.618635 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:27.661906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e110b25-31c3-40f0-8754-2dd2ffd7b0cc None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:27.697215 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268931e4-e46e-47f2-b2c1-b56e747fed89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:27.697841 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268931e4-e46e-47f2-b2c1-b56e747fed89 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:27.698123 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268931e4-e46e-47f2-b2c1-b56e747fed89 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:27.698397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268931e4-e46e-47f2-b2c1-b56e747fed89 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:27.699118 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268931e4-e46e-47f2-b2c1-b56e747fed89 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:27.699446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268931e4-e46e-47f2-b2c1-b56e747fed89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:27.700810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268931e4-e46e-47f2-b2c1-b56e747fed89 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:27.714223 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 507/1020] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 28 03:43:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:27.715816 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decce367-41f6-4216-a87d-ad8955e5e22b None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:27.851927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decce367-41f6-4216-a87d-ad8955e5e22b None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:27.854273 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:27.886976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4bb6a-e77e-4f3c-8277-d51c557855c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:27.887672 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4bb6a-e77e-4f3c-8277-d51c557855c0 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:27.887957 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4bb6a-e77e-4f3c-8277-d51c557855c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:27.888235 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4bb6a-e77e-4f3c-8277-d51c557855c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:27.899762 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4bb6a-e77e-4f3c-8277-d51c557855c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:27.901456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4bb6a-e77e-4f3c-8277-d51c557855c0 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:27.916799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-b1c4bb6a-e77e-4f3c-8277-d51c557855c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:27.916799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:27.916799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:27.916799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:27.916799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:27.916799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:27.916799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:27.916799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:27.916799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:27.916799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:27.916799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:27.916799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:27.916799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:43:27.916799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:43:27.916799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:43:27.917742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:43:27.917742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:27.917742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:27.917742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:27.917742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:27.917742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:27.917742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:27.917742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:27.917742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:27.917742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:27.917742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:27.917742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:27.917742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:27.917742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:27.917742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:27.917742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:27.917742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:27.924135 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:43:27.924135 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:43:27.924135 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:27.924135 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:27.924135 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 514/1021] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:27.925896 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268931e4-e46e-47f2-b2c1-b56e747fed89 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:28.033139 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268931e4-e46e-47f2-b2c1-b56e747fed89 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:28.054326 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:28.069442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f71a99-c50b-4c61-b0b4-43dd86f9f8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:28.070074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f71a99-c50b-4c61-b0b4-43dd86f9f8cc None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:28.070359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f71a99-c50b-4c61-b0b4-43dd86f9f8cc None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:28.070656 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f71a99-c50b-4c61-b0b4-43dd86f9f8cc None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:28.071359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f71a99-c50b-4c61-b0b4-43dd86f9f8cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:28.071670 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f71a99-c50b-4c61-b0b4-43dd86f9f8cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:28.073046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f71a99-c50b-4c61-b0b4-43dd86f9f8cc None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:28.086158 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 508/1022] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:28.092550 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4bb6a-e77e-4f3c-8277-d51c557855c0 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:28.131535 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fb729-ce39-44a0-96ff-22ea0d3c3c15 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:28.131866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fb729-ce39-44a0-96ff-22ea0d3c3c15 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:28.132100 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fb729-ce39-44a0-96ff-22ea0d3c3c15 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:28.133597 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 509/1023] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:28.138310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1d7a8-5589-43bb-8c3b-22d20220c1d8 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:28.138593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1d7a8-5589-43bb-8c3b-22d20220c1d8 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:28.139034 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1d7a8-5589-43bb-8c3b-22d20220c1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:28.158033 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-5ae1d7a8-5589-43bb-8c3b-22d20220c1d8 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:28.159213 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-5ae1d7a8-5589-43bb-8c3b-22d20220c1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:28.198775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4bb6a-e77e-4f3c-8277-d51c557855c0 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:28.228669 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 510/1024] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 03:43:28.238711 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e94a3-39e3-40fb-b344-d2b71fabf5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:28.239401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e94a3-39e3-40fb-b344-d2b71fabf5fb None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:28.239686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e94a3-39e3-40fb-b344-d2b71fabf5fb None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:28.240028 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e94a3-39e3-40fb-b344-d2b71fabf5fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:28.248109 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e94a3-39e3-40fb-b344-d2b71fabf5fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:28.250162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e94a3-39e3-40fb-b344-d2b71fabf5fb None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:28.251812 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1d7a8-5589-43bb-8c3b-22d20220c1d8 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:28.262117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-4f2e94a3-39e3-40fb-b344-d2b71fabf5fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:43:28.262117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:28.262117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:28.262117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:28.262117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:28.262117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:28.262117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:28.262117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:28.262117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:28.262117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:28.262117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:28.262117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:28.262117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:43:28.262117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:43:28.262117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:43:28.262117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:43:28.263772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:28.263772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:28.263772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:43:28.263772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:28.263772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:43:28.263772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:28.263772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:28.263772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:28.263772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:28.263772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:28.263772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:28.263772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:28.263772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:28.263772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:28.263772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:28.263772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:28.263772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:28.263772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:28.264794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:28.264794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:28.264794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:43:28.264794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:43:28.264794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:43:28.264794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:43:28.264794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:43:28.264794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:43:28.264794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:43:28.264794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:28.264794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 515/1025] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 28 03:43:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:28.269437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e94a3-39e3-40fb-b344-d2b71fabf5fb None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:28.289799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:28.356177 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1d7a8-5589-43bb-8c3b-22d20220c1d8 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:28.367118 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:28.370913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e94a3-39e3-40fb-b344-d2b71fabf5fb None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:28.390539 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e3a2f-5adb-45f4-985b-27ecabc0d39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:28.391184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e3a2f-5adb-45f4-985b-27ecabc0d39a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:28.391493 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e3a2f-5adb-45f4-985b-27ecabc0d39a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:28.391774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e3a2f-5adb-45f4-985b-27ecabc0d39a None admin] PATH_INFO: `/v3/services/image` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:28.392403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e3a2f-5adb-45f4-985b-27ecabc0d39a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:28.393769 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e3a2f-5adb-45f4-985b-27ecabc0d39a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:28.403335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-b09e3a2f-5adb-45f4-985b-27ecabc0d39a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 03:43:28.403335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:28.403335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:43:28.403335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:43:28.403335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:43:28.403335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:43:28.403335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:43:28.403335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:28.403335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 03:43:28.403335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:28.403335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:28.403335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:28.403335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:28.403335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:28.403335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:28.403335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:28.403335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:28.404481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:28.404481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:28.404481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:28.404481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:28.404481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:28.404481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:28.404481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:43:28.404481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:43:28.404481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:43:28.404481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:43:28.404481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:28.404481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:28.404481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:28.404481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:28.404481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:28.404481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:28.405681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:28.405681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:28.405681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:28.405681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:28.405681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:28.405681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:28.405681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:28.405681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:28.405681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:28.405681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:28.405681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:43:28.405681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:28.405681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 03:43:28.405681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:28.409198 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242c171-2cdd-43e2-8075-04cbc31f20c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:28.409540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 511/1026] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Jul 28 03:43:28 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:28.409829 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242c171-2cdd-43e2-8075-04cbc31f20c0 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:28.410252 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242c171-2cdd-43e2-8075-04cbc31f20c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:28.410535 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242c171-2cdd-43e2-8075-04cbc31f20c0 None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:28.410816 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b5c0d-b7b7-46a5-83a7-2f2f2e332e35 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:28.411102 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b5c0d-b7b7-46a5-83a7-2f2f2e332e35 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:28.411360 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242c171-2cdd-43e2-8075-04cbc31f20c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:28.411454 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b5c0d-b7b7-46a5-83a7-2f2f2e332e35 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:28.411676 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242c171-2cdd-43e2-8075-04cbc31f20c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:28.412661 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 512/1027] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:28.413114 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242c171-2cdd-43e2-8075-04cbc31f20c0 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:28.413339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b5c0d-b7b7-46a5-83a7-2f2f2e332e35 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:28.431812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 516/1028] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 28 03:43:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:28.433032 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff0620-5681-4082-81c8-9dc212ae20a5 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:28.433320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff0620-5681-4082-81c8-9dc212ae20a5 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:28.433592 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff0620-5681-4082-81c8-9dc212ae20a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:28.451512 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-f6ff0620-5681-4082-81c8-9dc212ae20a5 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:28.452841 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f6ff0620-5681-4082-81c8-9dc212ae20a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:28.515400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b5c0d-b7b7-46a5-83a7-2f2f2e332e35 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:28.518339 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 517/1029] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:28.519235 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff0620-5681-4082-81c8-9dc212ae20a5 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:28.522198 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:28.557391 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d298c37-69d7-482b-b1a5-b3e882efb1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:28.558027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d298c37-69d7-482b-b1a5-b3e882efb1ed None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:28.558346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d298c37-69d7-482b-b1a5-b3e882efb1ed None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:28.558620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d298c37-69d7-482b-b1a5-b3e882efb1ed None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:28.559295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d298c37-69d7-482b-b1a5-b3e882efb1ed None admin] RBAC: Adding query filter params (name=image) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:28.559613 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d298c37-69d7-482b-b1a5-b3e882efb1ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:28.561643 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d298c37-69d7-482b-b1a5-b3e882efb1ed None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:28.567235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 513/1030] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:28.568026 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d298c37-69d7-482b-b1a5-b3e882efb1ed None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:28.610070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:28.620481 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff0620-5681-4082-81c8-9dc212ae20a5 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:28.655209 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f305895-5b98-4c4b-a038-340ceed0b32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:28.655867 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f305895-5b98-4c4b-a038-340ceed0b32c None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:28.656142 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f305895-5b98-4c4b-a038-340ceed0b32c None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:28.656415 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f305895-5b98-4c4b-a038-340ceed0b32c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:28.670814 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d298c37-69d7-482b-b1a5-b3e882efb1ed None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:28.705307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606affc-cbce-4521-9eaf-262e515283bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:28.705949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606affc-cbce-4521-9eaf-262e515283bb None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:28.706232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606affc-cbce-4521-9eaf-262e515283bb None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:28.706506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606affc-cbce-4521-9eaf-262e515283bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:28.707690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606affc-cbce-4521-9eaf-262e515283bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:28.709123 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606affc-cbce-4521-9eaf-262e515283bb None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:28.710719 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 514/1031] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:28.711498 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606affc-cbce-4521-9eaf-262e515283bb None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:28.727746 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f305895-5b98-4c4b-a038-340ceed0b32c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:28.729212 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f305895-5b98-4c4b-a038-340ceed0b32c None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:28.731789 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:28.856361 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606affc-cbce-4521-9eaf-262e515283bb None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:28.864503 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 518/1032] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:43:28 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:43:28.864503 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f305895-5b98-4c4b-a038-340ceed0b32c None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:28.871188 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:28.898839 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3f50a-a7ae-478b-9a6a-d86b42bde7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:28.899488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3f50a-a7ae-478b-9a6a-d86b42bde7eb None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:28.899773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3f50a-a7ae-478b-9a6a-d86b42bde7eb None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:28.900048 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3f50a-a7ae-478b-9a6a-d86b42bde7eb None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:28.900725 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3f50a-a7ae-478b-9a6a-d86b42bde7eb None admin] RBAC: Adding query filter params (type=image) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:28.901030 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3f50a-a7ae-478b-9a6a-d86b42bde7eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:28.902388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3f50a-a7ae-478b-9a6a-d86b42bde7eb None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:28.908097 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 515/1033] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:28.908892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3f50a-a7ae-478b-9a6a-d86b42bde7eb None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:28.964457 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f305895-5b98-4c4b-a038-340ceed0b32c None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:28.966813 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:28.999397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb1499-3e7c-45c5-a06c-fbb68eac38e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:29.000020 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb1499-3e7c-45c5-a06c-fbb68eac38e8 None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:29.000298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb1499-3e7c-45c5-a06c-fbb68eac38e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:29.000574 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb1499-3e7c-45c5-a06c-fbb68eac38e8 None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:29.001254 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb1499-3e7c-45c5-a06c-fbb68eac38e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:29.002711 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb1499-3e7c-45c5-a06c-fbb68eac38e8 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:29.011544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3f50a-a7ae-478b-9a6a-d86b42bde7eb None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:29.046498 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516eec3-cec5-4478-b447-512cbd77d7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:29.047137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516eec3-cec5-4478-b447-512cbd77d7e4 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:29.047445 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516eec3-cec5-4478-b447-512cbd77d7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:29.047719 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516eec3-cec5-4478-b447-512cbd77d7e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:29.057380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516eec3-cec5-4478-b447-512cbd77d7e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:29.058829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516eec3-cec5-4478-b447-512cbd77d7e4 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:29.073615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-7516eec3-cec5-4478-b447-512cbd77d7e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:29.073615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:29.073615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:29.073615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:29.073615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:29.073615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:29.073615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:29.073615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:29.073615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:29.073615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:29.073615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:29.073615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:29.073615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:43:29.073615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:43:29.073615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:43:29.087982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:43:29.087982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:29.087982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:29.087982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:29.087982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:29.087982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:29.087982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:29.087982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:29.087982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:29.087982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:29.087982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:29.087982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:29.087982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:29.087982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:29.087982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:29.087982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:29.087982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:29.089101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:43:29.089101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:43:29.089101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:29.089101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:29.089101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 516/1034] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:29.089101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516eec3-cec5-4478-b447-512cbd77d7e4 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:29.100695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:29.124222 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 519/1035] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 28 03:43:28 2022] POST /identity/v3/projects => generated 311 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:43:29.124222 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb1499-3e7c-45c5-a06c-fbb68eac38e8 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:29.189964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516eec3-cec5-4478-b447-512cbd77d7e4 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:29.230023 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbefe0-3d8a-46c0-9464-5036d2d3e4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:29.230671 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbefe0-3d8a-46c0-9464-5036d2d3e4f7 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:29.230998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbefe0-3d8a-46c0-9464-5036d2d3e4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:29.231231 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbefe0-3d8a-46c0-9464-5036d2d3e4f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:29.232043 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbefe0-3d8a-46c0-9464-5036d2d3e4f7 None admin] RBAC: Adding query filter params (interface=public, service_id=4ba093535b8f41edacbbd66beb7f8ead, region_id=RegionOne) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:29.233031 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbefe0-3d8a-46c0-9464-5036d2d3e4f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:29.234452 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbefe0-3d8a-46c0-9464-5036d2d3e4f7 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:29.235679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb1499-3e7c-45c5-a06c-fbb68eac38e8 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:29.245827 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 517/1036] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 28 03:43:29 2022] GET /identity/v3/endpoints?service_id=4ba093535b8f41edacbbd66beb7f8ead&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:29.246797 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbefe0-3d8a-46c0-9464-5036d2d3e4f7 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:29.279355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9107d-8ace-452f-ae54-895cba5bdec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:29.280433 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9107d-8ace-452f-ae54-895cba5bdec6 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:29.280433 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9107d-8ace-452f-ae54-895cba5bdec6 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:29.280749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9107d-8ace-452f-ae54-895cba5bdec6 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:29.281395 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9107d-8ace-452f-ae54-895cba5bdec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:29.281703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9107d-8ace-452f-ae54-895cba5bdec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:29.283141 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9107d-8ace-452f-ae54-895cba5bdec6 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:29.304345 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 520/1037] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:29.310206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9107d-8ace-452f-ae54-895cba5bdec6 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:29.333101 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:29.357336 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:29.372857 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbefe0-3d8a-46c0-9464-5036d2d3e4f7 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:29.409069 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63368b63-0ee1-44fd-ad48-4f147bddf2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:29.409678 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63368b63-0ee1-44fd-ad48-4f147bddf2fe None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:29.409965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63368b63-0ee1-44fd-ad48-4f147bddf2fe None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:29.410241 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63368b63-0ee1-44fd-ad48-4f147bddf2fe None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:29.410899 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63368b63-0ee1-44fd-ad48-4f147bddf2fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:29.412358 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63368b63-0ee1-44fd-ad48-4f147bddf2fe None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:29.419366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 518/1038] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 28 03:43:29 2022] GET /identity/v3/services => generated 1957 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 03:43:29.429435 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9107d-8ace-452f-ae54-895cba5bdec6 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:29.472024 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a361e-c944-4d04-ab2c-946e1317b9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:29.472871 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a361e-c944-4d04-ab2c-946e1317b9f5 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:29.473249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a361e-c944-4d04-ab2c-946e1317b9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:29.473617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a361e-c944-4d04-ab2c-946e1317b9f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:29.481635 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a361e-c944-4d04-ab2c-946e1317b9f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:29.485171 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a361e-c944-4d04-ab2c-946e1317b9f5 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:29.497970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-916a361e-c944-4d04-ab2c-946e1317b9f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:29.497970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:29.497970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:29.497970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:29.497970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:29.497970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:29.497970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:29.497970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:29.497970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:29.497970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:29.497970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:29.497970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:29.497970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:43:29.497970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:43:29.497970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:43:29.499651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:43:29.499651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:29.499651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:29.499651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:29.499651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:29.499651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:29.499651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:29.499651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:29.499651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:29.499651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:29.499651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:29.499651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:29.499651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:29.499651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:29.499651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:29.499651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:29.499651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:29.500685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:43:29.500685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:43:29.500685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:43:29.500685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:43:29.500685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:43:29.500685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:43:29.500685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:29.500685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:29.506571 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 521/1039] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:43:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:29.507185 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63368b63-0ee1-44fd-ad48-4f147bddf2fe None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:29.619794 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63368b63-0ee1-44fd-ad48-4f147bddf2fe None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:29.656581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a93b5-ba78-4747-8832-0d091f684769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:29.657206 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a93b5-ba78-4747-8832-0d091f684769 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:29.657491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a93b5-ba78-4747-8832-0d091f684769 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:29.657768 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a93b5-ba78-4747-8832-0d091f684769 None admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:29.658517 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a93b5-ba78-4747-8832-0d091f684769 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:29.658824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a93b5-ba78-4747-8832-0d091f684769 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:29.660335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a93b5-ba78-4747-8832-0d091f684769 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:29.673125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 519/1040] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:43:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:29.679137 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a361e-c944-4d04-ab2c-946e1317b9f5 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:29.761716 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:29.791779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a361e-c944-4d04-ab2c-946e1317b9f5 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:29.829556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26594dc-02e9-4da7-9cf8-5ff466ea1e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:29.830252 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26594dc-02e9-4da7-9cf8-5ff466ea1e08 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:29.830529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26594dc-02e9-4da7-9cf8-5ff466ea1e08 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:29.830796 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26594dc-02e9-4da7-9cf8-5ff466ea1e08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:29.831602 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26594dc-02e9-4da7-9cf8-5ff466ea1e08 None admin] RBAC: Adding query filter params (role.id=c06601c249ef4cad81ec53a2e55aba1e, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=5133abf4c32a45b0b2188f71496c572b) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:29.831904 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26594dc-02e9-4da7-9cf8-5ff466ea1e08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:29.833346 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26594dc-02e9-4da7-9cf8-5ff466ea1e08 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:29.847363 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 522/1041] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:43:29 2022] GET /identity/v3/role_assignments?user.id=5133abf4c32a45b0b2188f71496c572b&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=c06601c249ef4cad81ec53a2e55aba1e => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:31.206511 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a5025-352f-4dfb-a763-ba9c10b53b19 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:31.207050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a5025-352f-4dfb-a763-ba9c10b53b19 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:31.207050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a5025-352f-4dfb-a763-ba9c10b53b19 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:31.208540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 520/1042] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:31.213696 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b7855-5373-425e-a74a-8813ab6fe757 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:31.214084 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b7855-5373-425e-a74a-8813ab6fe757 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:31.214262 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b7855-5373-425e-a74a-8813ab6fe757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:31.233016 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-fa0b7855-5373-425e-a74a-8813ab6fe757 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:31.234326 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-fa0b7855-5373-425e-a74a-8813ab6fe757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:31.303601 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 523/1043] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:31.328258 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a5025-352f-4dfb-a763-ba9c10b53b19 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:31.341501 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:31.439425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a5025-352f-4dfb-a763-ba9c10b53b19 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:31.444231 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7b187-8410-4959-8070-72180bd3b937 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:31.444594 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7b187-8410-4959-8070-72180bd3b937 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:31.444869 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7b187-8410-4959-8070-72180bd3b937 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:31.446272 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 524/1044] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:31.451341 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf4585-755f-4892-b2b5-64febb849e19 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:31.451634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf4585-755f-4892-b2b5-64febb849e19 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:31.451910 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf4585-755f-4892-b2b5-64febb849e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:31.470062 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-cfcf4585-755f-4892-b2b5-64febb849e19 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:31.471158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-cfcf4585-755f-4892-b2b5-64febb849e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:31.484028 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62558f-476c-469c-bda3-c3d2aa3247cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:31.484916 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62558f-476c-469c-bda3-c3d2aa3247cc None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:31.485593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62558f-476c-469c-bda3-c3d2aa3247cc None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:31.486029 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62558f-476c-469c-bda3-c3d2aa3247cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:31.487350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62558f-476c-469c-bda3-c3d2aa3247cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:31.488918 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62558f-476c-469c-bda3-c3d2aa3247cc None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:31.491024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 521/1045] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:31.496360 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62558f-476c-469c-bda3-c3d2aa3247cc None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:31.549777 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:31.555363 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 525/1046] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 03:43:31.577124 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf4585-755f-4892-b2b5-64febb849e19 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:31.582256 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:31.603940 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62558f-476c-469c-bda3-c3d2aa3247cc None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:31.643559 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1e9d1-f21b-48d4-bc78-9a71fee9a581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:31.644227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1e9d1-f21b-48d4-bc78-9a71fee9a581 None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:31.644501 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1e9d1-f21b-48d4-bc78-9a71fee9a581 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:31.644779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1e9d1-f21b-48d4-bc78-9a71fee9a581 None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:31.645469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1e9d1-f21b-48d4-bc78-9a71fee9a581 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:31.646899 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1e9d1-f21b-48d4-bc78-9a71fee9a581 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:31.688239 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf4585-755f-4892-b2b5-64febb849e19 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:31.723094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a577b61-e9f8-429c-8364-d5b8e0fda793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:31.723705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a577b61-e9f8-429c-8364-d5b8e0fda793 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:31.723988 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a577b61-e9f8-429c-8364-d5b8e0fda793 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:31.724261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a577b61-e9f8-429c-8364-d5b8e0fda793 None admin] PATH_INFO: `/v3/services/image` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:31.724885 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a577b61-e9f8-429c-8364-d5b8e0fda793 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:31.726256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a577b61-e9f8-429c-8364-d5b8e0fda793 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:31.735747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-6a577b61-e9f8-429c-8364-d5b8e0fda793 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 03:43:31.735747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:31.735747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:43:31.735747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:43:31.735747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:43:31.735747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:43:31.735747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:43:31.735747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:31.735747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 03:43:31.735747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:31.735747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:43:31.735747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:31.735747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:31.735747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:31.735747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:31.735747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:31.735747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:31.738094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:31.738094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:31.738094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:31.738094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:31.738094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:31.738094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:31.738094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:43:31.738094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:43:31.738094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:43:31.738094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:43:31.738094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:31.738094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:31.738094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:31.738094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:31.738094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:31.738094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:31.739125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:31.739125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:31.739125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:31.739125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:31.739125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:31.739125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:31.739125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:31.739125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:31.739125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:31.739125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:31.739125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:43:31.739125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:43:31.739125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 03:43:31.739125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:31.739125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 526/1047] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Jul 28 03:43:31 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:31.742770 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a577b61-e9f8-429c-8364-d5b8e0fda793 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:31.783870 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 522/1048] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 28 03:43:31 2022] POST /identity/v3/users => generated 285 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:43:31.821906 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:31.860252 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05901c23-a119-429f-8689-31bcfffb9c5e None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:31.860542 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05901c23-a119-429f-8689-31bcfffb9c5e None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:31.860818 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05901c23-a119-429f-8689-31bcfffb9c5e None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:31.862436 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 523/1049] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:43:31.866687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a577b61-e9f8-429c-8364-d5b8e0fda793 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:31.868079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cc2ca-1f53-4207-be2d-ad638ef38674 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:31.868372 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cc2ca-1f53-4207-be2d-ad638ef38674 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:31.868662 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cc2ca-1f53-4207-be2d-ad638ef38674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:31.889440 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-434cc2ca-1f53-4207-be2d-ad638ef38674 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:31.890709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-434cc2ca-1f53-4207-be2d-ad638ef38674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:31.907251 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3e190-b530-477b-8167-f3f472fa37a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:31.907939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3e190-b530-477b-8167-f3f472fa37a6 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:31.908225 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3e190-b530-477b-8167-f3f472fa37a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:31.908502 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3e190-b530-477b-8167-f3f472fa37a6 None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:31.909233 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3e190-b530-477b-8167-f3f472fa37a6 None admin] RBAC: Adding query filter params (name=image) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:31.909542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3e190-b530-477b-8167-f3f472fa37a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:31.911209 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3e190-b530-477b-8167-f3f472fa37a6 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:31.918258 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 527/1050] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:31.924267 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3e190-b530-477b-8167-f3f472fa37a6 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:31.970568 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 524/1051] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 03:43:31.994714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434cc2ca-1f53-4207-be2d-ad638ef38674 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:32.044443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3e190-b530-477b-8167-f3f472fa37a6 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:32.072131 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:32.079682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:32.089689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ba007-e34f-4a44-a2eb-8176ca360b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:32.090643 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ba007-e34f-4a44-a2eb-8176ca360b63 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:32.091077 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ba007-e34f-4a44-a2eb-8176ca360b63 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:32.091549 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ba007-e34f-4a44-a2eb-8176ca360b63 None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:32.092890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ba007-e34f-4a44-a2eb-8176ca360b63 None admin] RBAC: Adding query filter params (type=image) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:32.093202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ba007-e34f-4a44-a2eb-8176ca360b63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:32.095133 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ba007-e34f-4a44-a2eb-8176ca360b63 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:32.105261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 528/1052] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:32.106442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ba007-e34f-4a44-a2eb-8176ca360b63 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:32.113874 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434cc2ca-1f53-4207-be2d-ad638ef38674 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:32.151383 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a04a8-2fa4-4e6e-b462-c9ba722b69cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:32.152039 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a04a8-2fa4-4e6e-b462-c9ba722b69cd None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:32.152327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a04a8-2fa4-4e6e-b462-c9ba722b69cd None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:32.153200 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a04a8-2fa4-4e6e-b462-c9ba722b69cd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:32.164631 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a04a8-2fa4-4e6e-b462-c9ba722b69cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:43:32.169684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-a84a04a8-2fa4-4e6e-b462-c9ba722b69cd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 03:43:32.169684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:32.169684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:32.169684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:32.169684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:32.169684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:32.169684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:32.169684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:32.169684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:32.169684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:32.169684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:32.169684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:32.169684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:43:32.169684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:43:32.169684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:43:32.169684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:43:32.170926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:43:32.170926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:43:32.170926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:43:32.170926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:43:32.170926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:32.170926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:32.170926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:32.170926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:32.170926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:32.170926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:32.170926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:32.170926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:32.170926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:32.170926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:32.170926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:32.170926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:32.171893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:32.171893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:32.171893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:32.171893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:32.171893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:43:32.171893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:43:32.171893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:43:32.171893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:43:32.171893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:43:32.171893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:43:32.171893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 03:43:32.171893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:32.171893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 525/1053] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 28 03:43:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:32.177343 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a04a8-2fa4-4e6e-b462-c9ba722b69cd None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:32.222319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ba007-e34f-4a44-a2eb-8176ca360b63 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:32.258188 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433d080-0f57-4089-8804-1225b3abc0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:32.258862 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433d080-0f57-4089-8804-1225b3abc0d4 None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:32.259147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433d080-0f57-4089-8804-1225b3abc0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:32.259454 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433d080-0f57-4089-8804-1225b3abc0d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:32.260172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433d080-0f57-4089-8804-1225b3abc0d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:32.261680 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433d080-0f57-4089-8804-1225b3abc0d4 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:32.287378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a04a8-2fa4-4e6e-b462-c9ba722b69cd None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:32.311998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:32.322355 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db28f5-2d74-4815-8ff4-f598de80f19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:32.323034 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db28f5-2d74-4815-8ff4-f598de80f19d None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:32.323335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db28f5-2d74-4815-8ff4-f598de80f19d None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:32.323617 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db28f5-2d74-4815-8ff4-f598de80f19d None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:32.324334 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db28f5-2d74-4815-8ff4-f598de80f19d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:32.324635 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db28f5-2d74-4815-8ff4-f598de80f19d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:32.325996 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db28f5-2d74-4815-8ff4-f598de80f19d None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:32.335173 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 526/1054] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 28 03:43:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:32.340652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db28f5-2d74-4815-8ff4-f598de80f19d None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:32.350022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 529/1055] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 03:43:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:43:32.457519 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db28f5-2d74-4815-8ff4-f598de80f19d None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:32.503074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04cf25-d0a1-4e9e-a998-cc6014fe33e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:32.504053 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04cf25-d0a1-4e9e-a998-cc6014fe33e6 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:32.504053 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04cf25-d0a1-4e9e-a998-cc6014fe33e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:32.504336 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04cf25-d0a1-4e9e-a998-cc6014fe33e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:32.515673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04cf25-d0a1-4e9e-a998-cc6014fe33e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:32.517083 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04cf25-d0a1-4e9e-a998-cc6014fe33e6 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:32.535771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-cb04cf25-d0a1-4e9e-a998-cc6014fe33e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:32.535771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:32.535771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:32.535771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:32.535771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:32.535771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:32.535771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:32.535771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:32.535771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:32.535771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:32.535771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:32.535771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:32.535771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:43:32.535771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:43:32.535771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:43:32.536892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:43:32.536892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:32.536892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:32.536892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:32.536892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:32.536892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:32.536892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:32.536892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:32.536892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:32.536892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:32.536892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:32.536892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:32.536892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:32.536892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:32.536892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:32.536892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:32.536892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:32.538001 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:43:32.538001 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:43:32.538001 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:32.538001 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:32.538001 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 527/1056] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:32.544325 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433d080-0f57-4089-8804-1225b3abc0d4 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:32.598475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:32.654750 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433d080-0f57-4089-8804-1225b3abc0d4 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:32.689347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3e302-5460-4dea-9883-da02e0055f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:32.689985 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3e302-5460-4dea-9883-da02e0055f6c None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:32.690274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3e302-5460-4dea-9883-da02e0055f6c None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:32.690551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3e302-5460-4dea-9883-da02e0055f6c None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:32.691252 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3e302-5460-4dea-9883-da02e0055f6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:32.691588 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3e302-5460-4dea-9883-da02e0055f6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:32.692962 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3e302-5460-4dea-9883-da02e0055f6c None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:32.710088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 530/1057] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:32.711783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04cf25-d0a1-4e9e-a998-cc6014fe33e6 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:32.749216 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:32.826179 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04cf25-d0a1-4e9e-a998-cc6014fe33e6 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:32.862597 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e9af4-fe89-4b97-87ba-0ea281b3ca3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:32.863254 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e9af4-fe89-4b97-87ba-0ea281b3ca3e None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:32.863629 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e9af4-fe89-4b97-87ba-0ea281b3ca3e None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:32.863912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e9af4-fe89-4b97-87ba-0ea281b3ca3e None admin] PATH_INFO: `/v3/users/nova` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:32.871582 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e9af4-fe89-4b97-87ba-0ea281b3ca3e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:32.873735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e9af4-fe89-4b97-87ba-0ea281b3ca3e None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:32.884981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-163e9af4-fe89-4b97-87ba-0ea281b3ca3e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:43:32.884981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:32.884981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:32.884981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:32.884981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:32.884981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:32.884981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:32.884981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:32.884981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:32.884981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:32.884981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:32.884981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:32.884981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:43:32.884981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:43:32.884981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:43:32.884981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:43:32.885971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:32.885971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:32.885971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:43:32.885971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:32.885971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:43:32.885971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:32.885971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:32.885971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:32.885971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:32.885971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:32.885971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:32.885971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:32.885971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:32.885971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:32.885971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:32.885971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:32.885971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:32.885971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:32.886942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:32.886942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:32.886942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:43:32.886942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:43:32.886942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:43:32.886942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:43:32.886942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:43:32.886942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:43:32.886942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:43:32.886942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:32.890918 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 528/1058] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 28 03:43:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:32.892577 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3e302-5460-4dea-9883-da02e0055f6c None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:33.000130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3e302-5460-4dea-9883-da02e0055f6c None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:33.010650 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:33.036331 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f9991-7702-4059-b93e-bd0042a2aeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:33.036819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f9991-7702-4059-b93e-bd0042a2aeec None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:33.037136 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f9991-7702-4059-b93e-bd0042a2aeec None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:33.037413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f9991-7702-4059-b93e-bd0042a2aeec None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:33.038212 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f9991-7702-4059-b93e-bd0042a2aeec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:33.038514 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f9991-7702-4059-b93e-bd0042a2aeec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:33.039980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f9991-7702-4059-b93e-bd0042a2aeec None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:33.068998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 531/1059] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 28 03:43:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:33.070892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e9af4-fe89-4b97-87ba-0ea281b3ca3e None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:33.169780 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:33.177422 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e9af4-fe89-4b97-87ba-0ea281b3ca3e None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:33.211501 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d72a4-d4d5-497a-ab78-144b98e480d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:33.212254 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d72a4-d4d5-497a-ab78-144b98e480d6 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:33.212556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d72a4-d4d5-497a-ab78-144b98e480d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:33.212814 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d72a4-d4d5-497a-ab78-144b98e480d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:33.223310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d72a4-d4d5-497a-ab78-144b98e480d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:33.224771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d72a4-d4d5-497a-ab78-144b98e480d6 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:33.239927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-ad2d72a4-d4d5-497a-ab78-144b98e480d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:33.239927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:33.239927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:33.239927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:33.239927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:33.239927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:33.239927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:33.239927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:33.239927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:33.239927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:33.239927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:33.239927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:33.239927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:43:33.239927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:43:33.239927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:43:33.240800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:43:33.240800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:33.240800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:33.240800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:33.240800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:33.240800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:33.240800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:33.240800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:33.240800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:33.240800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:33.240800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:33.240800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:33.240800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:33.240800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:33.240800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:33.240800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:33.240800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:33.248972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:43:33.248972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:43:33.248972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:33.248972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:33.248972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 529/1060] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:33.249268 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f9991-7702-4059-b93e-bd0042a2aeec None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:33.352465 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f9991-7702-4059-b93e-bd0042a2aeec None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:33.386407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a38c4-ff4e-4623-93ad-840e11716aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:33.387028 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a38c4-ff4e-4623-93ad-840e11716aef None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:33.387307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a38c4-ff4e-4623-93ad-840e11716aef None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:33.387607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a38c4-ff4e-4623-93ad-840e11716aef None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:33.388299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a38c4-ff4e-4623-93ad-840e11716aef None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:33.389221 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a38c4-ff4e-4623-93ad-840e11716aef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:33.390913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a38c4-ff4e-4623-93ad-840e11716aef None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:33.407422 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 532/1061] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:33.409187 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d72a4-d4d5-497a-ab78-144b98e480d6 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:33.523040 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d72a4-d4d5-497a-ab78-144b98e480d6 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:33.557923 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd4ddf-a926-4b0e-8707-8d7ee598ffc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:33.558570 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd4ddf-a926-4b0e-8707-8d7ee598ffc9 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:33.558856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd4ddf-a926-4b0e-8707-8d7ee598ffc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:33.559135 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd4ddf-a926-4b0e-8707-8d7ee598ffc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:33.566542 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd4ddf-a926-4b0e-8707-8d7ee598ffc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:33.568077 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd4ddf-a926-4b0e-8707-8d7ee598ffc9 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:33.580167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-92fd4ddf-a926-4b0e-8707-8d7ee598ffc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:33.580167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:33.580167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:33.580167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:33.580167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:33.580167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:33.580167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:33.580167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:33.580167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:33.580167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:33.580167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:33.580167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:33.580167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:43:33.580167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:43:33.580167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:43:33.581099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:43:33.581099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:33.581099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:33.581099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:33.581099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:33.581099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:33.581099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:33.581099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:33.581099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:33.581099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:33.581099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:33.581099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:33.581099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:33.581099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:33.581099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:33.581099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:33.581099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:33.581965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:43:33.581965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:43:33.581965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:43:33.581965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:43:33.581965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:43:33.581965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:43:33.581965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:33.581965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:33.583647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 530/1062] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:43:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:33.587295 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a38c4-ff4e-4623-93ad-840e11716aef None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:33.616705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:33.692545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a38c4-ff4e-4623-93ad-840e11716aef None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:33.726345 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc36e0-cd7a-432d-b14b-f848c68c0129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:33.726979 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc36e0-cd7a-432d-b14b-f848c68c0129 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:33.727263 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc36e0-cd7a-432d-b14b-f848c68c0129 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:33.727569 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc36e0-cd7a-432d-b14b-f848c68c0129 None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:33.728322 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc36e0-cd7a-432d-b14b-f848c68c0129 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:33.728632 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc36e0-cd7a-432d-b14b-f848c68c0129 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:33.730075 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc36e0-cd7a-432d-b14b-f848c68c0129 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:33.747167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 533/1063] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:43:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:33.749921 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd4ddf-a926-4b0e-8707-8d7ee598ffc9 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:33.759839 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:33.863223 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd4ddf-a926-4b0e-8707-8d7ee598ffc9 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:33.897138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d9c84-dc79-44e9-8f41-3531da78aff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:33.897847 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d9c84-dc79-44e9-8f41-3531da78aff3 None admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:33.898131 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d9c84-dc79-44e9-8f41-3531da78aff3 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:33.898407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d9c84-dc79-44e9-8f41-3531da78aff3 None admin] PATH_INFO: `/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/5133abf4c32a45b0b2188f71496c572b/roles/c06601c249ef4cad81ec53a2e55aba1e` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:33.900652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d9c84-dc79-44e9-8f41-3531da78aff3 None admin] RBAC: Authorizing `identity:create_grant(project_id=28b7995e83524b9293d1c6fc319e5a85, user_id=5133abf4c32a45b0b2188f71496c572b, role_id=c06601c249ef4cad81ec53a2e55aba1e)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:33.902232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d9c84-dc79-44e9-8f41-3531da78aff3 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:33.904049 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53fdd7-546c-42cf-840c-7101b7a7a276 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:33.904924 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53fdd7-546c-42cf-840c-7101b7a7a276 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:33.905280 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53fdd7-546c-42cf-840c-7101b7a7a276 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:33.906793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 534/1064] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:43:33.911582 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5c828-3f9d-4bf8-95a1-cc4f36f4b9ba None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:33.911838 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5c828-3f9d-4bf8-95a1-cc4f36f4b9ba None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:33.912111 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5c828-3f9d-4bf8-95a1-cc4f36f4b9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:33.930367 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-2fd5c828-3f9d-4bf8-95a1-cc4f36f4b9ba None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:33.931609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-2fd5c828-3f9d-4bf8-95a1-cc4f36f4b9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:33.985273 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 531/1065] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:43:33 2022] PUT /identity/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/5133abf4c32a45b0b2188f71496c572b/roles/c06601c249ef4cad81ec53a2e55aba1e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:43:34.018451 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 535/1066] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 03:43:34.042342 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d9c84-dc79-44e9-8f41-3531da78aff3 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:34.122185 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:34.166661 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d9c84-dc79-44e9-8f41-3531da78aff3 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:34.203264 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe63bfc-87e0-4b89-88cd-dd68a84e209c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:34.203935 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe63bfc-87e0-4b89-88cd-dd68a84e209c None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:34.204215 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe63bfc-87e0-4b89-88cd-dd68a84e209c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:34.204487 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe63bfc-87e0-4b89-88cd-dd68a84e209c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:34.214683 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe63bfc-87e0-4b89-88cd-dd68a84e209c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:43:34.221488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-4fe63bfc-87e0-4b89-88cd-dd68a84e209c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:43:34.221488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:34.221488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:34.221488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:34.221488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:34.221488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:34.221488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:34.221488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:34.221488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:34.221488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:34.221488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:34.221488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:34.221488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:43:34.221488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:43:34.221488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:43:34.221488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:43:34.222447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:43:34.222447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:43:34.222447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:43:34.222447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:43:34.222447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:34.222447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:34.222447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:34.222447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:34.222447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:34.222447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:34.222447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:34.222447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:34.222447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:34.222447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:34.222447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:34.222447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:34.223745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:34.223745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:34.223745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:34.223745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:34.223745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:43:34.223745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:43:34.223745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:43:34.223745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:43:34.223745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:43:34.223745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:43:34.223745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:43:34.223745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:34.223745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 532/1067] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:43:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:34.228928 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5c828-3f9d-4bf8-95a1-cc4f36f4b9ba None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:34.246531 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:34.332475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5c828-3f9d-4bf8-95a1-cc4f36f4b9ba None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:34.373705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd120659-85e7-4ec9-a056-e618241ce678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:34.374340 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd120659-85e7-4ec9-a056-e618241ce678 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:34.374621 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd120659-85e7-4ec9-a056-e618241ce678 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:34.374898 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd120659-85e7-4ec9-a056-e618241ce678 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:34.375698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd120659-85e7-4ec9-a056-e618241ce678 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:34.376011 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd120659-85e7-4ec9-a056-e618241ce678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:34.377386 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd120659-85e7-4ec9-a056-e618241ce678 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:34.385989 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 536/1068] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:43:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:34.392274 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe63bfc-87e0-4b89-88cd-dd68a84e209c None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:34.441263 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d5d5b-d4e0-41c5-b42a-b930ee6ce37c None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:34.441470 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d5d5b-d4e0-41c5-b42a-b930ee6ce37c None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:34.441749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d5d5b-d4e0-41c5-b42a-b930ee6ce37c None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:34.443111 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 537/1069] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:43:34.448352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da29f13-9042-4d2d-8c01-1d7404055f2f None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:34.448649 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da29f13-9042-4d2d-8c01-1d7404055f2f None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:34.448916 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da29f13-9042-4d2d-8c01-1d7404055f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:34.468611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-4da29f13-9042-4d2d-8c01-1d7404055f2f None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:34.469814 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-4da29f13-9042-4d2d-8c01-1d7404055f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:34.502409 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe63bfc-87e0-4b89-88cd-dd68a84e209c None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:34.529798 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:34.539202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 538/1070] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 03:43:34.539470 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b533c5-de5d-463d-8e8c-3fb9cae971ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:34.539948 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b533c5-de5d-463d-8e8c-3fb9cae971ef None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:34.540231 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b533c5-de5d-463d-8e8c-3fb9cae971ef None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:34.540510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b533c5-de5d-463d-8e8c-3fb9cae971ef None admin] PATH_INFO: `/v3/users/ff2df671359b47a1a45358bc8b966138` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:34.554529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b533c5-de5d-463d-8e8c-3fb9cae971ef None admin] RBAC: Authorizing `identity:get_user(user_id=ff2df671359b47a1a45358bc8b966138)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:34.556009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b533c5-de5d-463d-8e8c-3fb9cae971ef None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:34.563535 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 533/1071] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:43:34 2022] GET /identity/v3/users/ff2df671359b47a1a45358bc8b966138 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:34.563679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da29f13-9042-4d2d-8c01-1d7404055f2f None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:34.565892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b533c5-de5d-463d-8e8c-3fb9cae971ef None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:34.573620 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:34.674322 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da29f13-9042-4d2d-8c01-1d7404055f2f None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:34.675985 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b533c5-de5d-463d-8e8c-3fb9cae971ef None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:34.710609 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd627f5-b1e9-4b97-ba0e-9d6723646bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:34.711152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd627f5-b1e9-4b97-ba0e-9d6723646bec None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:34.711461 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd627f5-b1e9-4b97-ba0e-9d6723646bec None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:34.711732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd627f5-b1e9-4b97-ba0e-9d6723646bec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:34.720887 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856fd0b-43a4-44c0-b051-35e4eadae362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:34.722011 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856fd0b-43a4-44c0-b051-35e4eadae362 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:34.722416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856fd0b-43a4-44c0-b051-35e4eadae362 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:34.722696 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856fd0b-43a4-44c0-b051-35e4eadae362 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:34.768512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:34.795625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd627f5-b1e9-4b97-ba0e-9d6723646bec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:34.797160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd627f5-b1e9-4b97-ba0e-9d6723646bec None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:34.807914 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856fd0b-43a4-44c0-b051-35e4eadae362 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:34.809381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856fd0b-43a4-44c0-b051-35e4eadae362 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:34.820138 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:34.910487 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 534/1072] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:43:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 03:43:34.916516 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd627f5-b1e9-4b97-ba0e-9d6723646bec None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:34.921049 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 539/1073] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:43:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:43:34.926653 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856fd0b-43a4-44c0-b051-35e4eadae362 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:35.015722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:35.035362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd627f5-b1e9-4b97-ba0e-9d6723646bec None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:35.039203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856fd0b-43a4-44c0-b051-35e4eadae362 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:35.050959 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:35.076362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b04fa-cc04-49d1-aa34-776a1d187796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:35.076631 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec070f6-93f6-4c4b-b1c5-11d503adb92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:35.077026 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b04fa-cc04-49d1-aa34-776a1d187796 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:35.077162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec070f6-93f6-4c4b-b1c5-11d503adb92e None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:35.077373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b04fa-cc04-49d1-aa34-776a1d187796 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:35.077469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec070f6-93f6-4c4b-b1c5-11d503adb92e None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:35.077613 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b04fa-cc04-49d1-aa34-776a1d187796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:35.077703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec070f6-93f6-4c4b-b1c5-11d503adb92e None admin] PATH_INFO: `/v3/projects/ad65f3cfc4d64bd1ad302921911da7ad` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:35.078770 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec070f6-93f6-4c4b-b1c5-11d503adb92e None admin] RBAC: Authorizing `identity:get_project(project_id=ad65f3cfc4d64bd1ad302921911da7ad)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:35.080302 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec070f6-93f6-4c4b-b1c5-11d503adb92e None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:35.086947 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 535/1074] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:43:34 2022] GET /identity/v3/projects/ad65f3cfc4d64bd1ad302921911da7ad => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:35.088097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b04fa-cc04-49d1-aa34-776a1d187796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:35.088283 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec070f6-93f6-4c4b-b1c5-11d503adb92e None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:35.089538 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b04fa-cc04-49d1-aa34-776a1d187796 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:35.107157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-b84b04fa-cc04-49d1-aa34-776a1d187796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:35.107157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:35.107157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:35.107157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:35.107157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:35.107157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:35.107157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:35.107157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:35.107157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:35.107157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:35.107157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:35.107157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:35.107157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:43:35.107157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:43:35.107157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:43:35.108830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:43:35.108830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:35.108830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:35.108830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:35.108830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:35.108830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:35.108830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:35.108830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:35.108830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:35.108830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:35.108830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:35.108830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:35.108830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:35.108830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:35.108830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:35.108830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:35.108830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:35.109733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:43:35.109733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:43:35.109733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:35.109733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:35.114298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 540/1075] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:35.115269 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b04fa-cc04-49d1-aa34-776a1d187796 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:35.200467 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec070f6-93f6-4c4b-b1c5-11d503adb92e None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:35.225729 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b04fa-cc04-49d1-aa34-776a1d187796 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:35.237889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af909d9b-6a5e-49c7-aceb-fc31f48c09e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:35.238512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af909d9b-6a5e-49c7-aceb-fc31f48c09e1 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:35.238793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af909d9b-6a5e-49c7-aceb-fc31f48c09e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:35.239068 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af909d9b-6a5e-49c7-aceb-fc31f48c09e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:35.239896 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af909d9b-6a5e-49c7-aceb-fc31f48c09e1 None admin] RBAC: Adding query filter params (role.id=8a5766c4aef44773834941d1bdbd1e98, scope.project.id=ad65f3cfc4d64bd1ad302921911da7ad, user.id=ff2df671359b47a1a45358bc8b966138) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:35.240248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af909d9b-6a5e-49c7-aceb-fc31f48c09e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:35.241663 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af909d9b-6a5e-49c7-aceb-fc31f48c09e1 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:35.247117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 536/1076] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:43:35 2022] GET /identity/v3/role_assignments?user.id=ff2df671359b47a1a45358bc8b966138&scope.project.id=ad65f3cfc4d64bd1ad302921911da7ad&role.id=8a5766c4aef44773834941d1bdbd1e98 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:35.262142 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c806a0a-3cbc-4d43-bcdc-860bdc886129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:35.263113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c806a0a-3cbc-4d43-bcdc-860bdc886129 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:35.264199 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c806a0a-3cbc-4d43-bcdc-860bdc886129 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:35.264785 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c806a0a-3cbc-4d43-bcdc-860bdc886129 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:35.265698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c806a0a-3cbc-4d43-bcdc-860bdc886129 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:35.266269 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c806a0a-3cbc-4d43-bcdc-860bdc886129 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:35.267904 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c806a0a-3cbc-4d43-bcdc-860bdc886129 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:35.282803 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 541/1077] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:36.038526 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccca744-b2c8-44e2-8f73-0ebfb007505c None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:36.039025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccca744-b2c8-44e2-8f73-0ebfb007505c None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:36.039025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccca744-b2c8-44e2-8f73-0ebfb007505c None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:36.040379 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 537/1078] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:36.045609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baa1c5-d3b7-4fc1-8f15-66a31ec00e43 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:36.046012 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baa1c5-d3b7-4fc1-8f15-66a31ec00e43 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:36.046153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baa1c5-d3b7-4fc1-8f15-66a31ec00e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:36.065715 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-17baa1c5-d3b7-4fc1-8f15-66a31ec00e43 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:36.066916 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-17baa1c5-d3b7-4fc1-8f15-66a31ec00e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:36.081757 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:36.134103 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 542/1079] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:36.158188 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccca744-b2c8-44e2-8f73-0ebfb007505c None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:36.176857 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:36.261340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccca744-b2c8-44e2-8f73-0ebfb007505c None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:36.295763 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425dd62-613b-425d-a1f8-9b548603d14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:36.296401 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425dd62-613b-425d-a1f8-9b548603d14a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:36.296682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425dd62-613b-425d-a1f8-9b548603d14a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:36.296952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425dd62-613b-425d-a1f8-9b548603d14a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:36.307187 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425dd62-613b-425d-a1f8-9b548603d14a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:43:36.313190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-f425dd62-613b-425d-a1f8-9b548603d14a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 03:43:36.313190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:36.313190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:36.313190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:36.313190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:36.313190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:36.313190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:36.313190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:36.313190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:36.313190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:36.313190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:36.313190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:36.313190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:43:36.313190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:43:36.313190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:43:36.313190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:43:36.314126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:43:36.314126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:43:36.314126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:43:36.314126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:43:36.314126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:36.314126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:36.314126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:36.314126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:36.314126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:36.314126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:36.314126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:36.314126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:36.314126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:36.314126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:36.314126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:36.314126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:36.314976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:36.314976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:36.314976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:36.314976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:36.314976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:43:36.314976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:43:36.314976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:43:36.314976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:43:36.314976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:43:36.314976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:43:36.314976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 03:43:36.314976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:36.314976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 538/1080] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 28 03:43:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:36.320660 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baa1c5-d3b7-4fc1-8f15-66a31ec00e43 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:36.424049 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baa1c5-d3b7-4fc1-8f15-66a31ec00e43 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:36.459165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca875a-a180-452f-b85f-0021d38c010b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:36.459814 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca875a-a180-452f-b85f-0021d38c010b None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:36.460097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca875a-a180-452f-b85f-0021d38c010b None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:36.460370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca875a-a180-452f-b85f-0021d38c010b None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:36.461084 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca875a-a180-452f-b85f-0021d38c010b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:36.461390 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca875a-a180-452f-b85f-0021d38c010b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:36.462765 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca875a-a180-452f-b85f-0021d38c010b None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:36.471338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 543/1081] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 28 03:43:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:36.477057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425dd62-613b-425d-a1f8-9b548603d14a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:36.554209 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:36.577881 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425dd62-613b-425d-a1f8-9b548603d14a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:36.612015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5e8e7-1f78-4bcf-8720-662ae653a40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:36.612658 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5e8e7-1f78-4bcf-8720-662ae653a40c None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:36.612944 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5e8e7-1f78-4bcf-8720-662ae653a40c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:36.613223 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5e8e7-1f78-4bcf-8720-662ae653a40c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:36.623211 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5e8e7-1f78-4bcf-8720-662ae653a40c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:36.624687 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb5e8e7-1f78-4bcf-8720-662ae653a40c None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:36.639889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-efb5e8e7-1f78-4bcf-8720-662ae653a40c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:36.639889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:36.639889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:36.639889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:36.639889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:36.639889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:36.639889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:36.639889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:36.639889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:36.639889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:36.639889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:36.639889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:36.639889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:43:36.639889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:43:36.639889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:43:36.640941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:43:36.640941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:36.640941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:36.640941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:36.640941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:36.640941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:36.640941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:36.640941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:36.640941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:36.640941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:36.640941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:36.640941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:36.640941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:36.640941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:36.640941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:36.640941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:36.640941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:36.641869 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:43:36.641869 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:43:36.641869 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:36.641869 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:36.641869 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 539/1082] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:36.646807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca875a-a180-452f-b85f-0021d38c010b None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:36.664055 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:36.750762 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca875a-a180-452f-b85f-0021d38c010b None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:36.784808 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1096219-07ec-4d13-9a7f-c4d1c50924ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:36.785542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1096219-07ec-4d13-9a7f-c4d1c50924ee None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:36.785826 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1096219-07ec-4d13-9a7f-c4d1c50924ee None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:36.786119 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1096219-07ec-4d13-9a7f-c4d1c50924ee None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:36.786812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1096219-07ec-4d13-9a7f-c4d1c50924ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:36.787113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1096219-07ec-4d13-9a7f-c4d1c50924ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:36.788567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1096219-07ec-4d13-9a7f-c4d1c50924ee None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:36.801232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 544/1083] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:36.807029 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5e8e7-1f78-4bcf-8720-662ae653a40c None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:36.906066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5e8e7-1f78-4bcf-8720-662ae653a40c None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:36.932278 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:36.940128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb6455-1f12-4af9-9e4c-506d63452256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:36.940805 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb6455-1f12-4af9-9e4c-506d63452256 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:36.941081 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb6455-1f12-4af9-9e4c-506d63452256 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:36.941353 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb6455-1f12-4af9-9e4c-506d63452256 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:36.950208 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb6455-1f12-4af9-9e4c-506d63452256 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:36.951825 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb6455-1f12-4af9-9e4c-506d63452256 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:36.964528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-c6cb6455-1f12-4af9-9e4c-506d63452256 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:43:36.964528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:36.964528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:36.964528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:36.964528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:36.964528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:36.964528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:36.964528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:36.964528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:36.964528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:36.964528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:36.964528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:36.964528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:43:36.964528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:43:36.964528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:43:36.964528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:43:36.965804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:36.965804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:36.965804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:43:36.965804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:36.965804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:43:36.965804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:43:36.965804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:36.965804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:36.965804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:36.965804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:36.965804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:36.965804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:36.965804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:36.965804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:36.965804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:36.965804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:36.965804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:36.965804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:36.967279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:36.967279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:36.967279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:43:36.967279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:43:36.967279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:43:36.967279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:43:36.967279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:43:36.967279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:43:36.967279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 03:43:36.967279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:36.967862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 540/1084] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 28 03:43:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:36.972263 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1096219-07ec-4d13-9a7f-c4d1c50924ee None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:37.043359 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:37.072682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1096219-07ec-4d13-9a7f-c4d1c50924ee None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:37.107742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c46e0f-6a67-4e88-ba52-c8baddd2fb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:37.108361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c46e0f-6a67-4e88-ba52-c8baddd2fb64 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:37.108646 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c46e0f-6a67-4e88-ba52-c8baddd2fb64 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:37.108925 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c46e0f-6a67-4e88-ba52-c8baddd2fb64 None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:37.109718 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c46e0f-6a67-4e88-ba52-c8baddd2fb64 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:37.110023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c46e0f-6a67-4e88-ba52-c8baddd2fb64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:37.111475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c46e0f-6a67-4e88-ba52-c8baddd2fb64 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:37.129378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 545/1085] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 28 03:43:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:37.135110 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb6455-1f12-4af9-9e4c-506d63452256 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:37.237155 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb6455-1f12-4af9-9e4c-506d63452256 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:37.270901 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58042add-06bf-4b1b-93b0-4bf82d62caf8 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:37.271186 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58042add-06bf-4b1b-93b0-4bf82d62caf8 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:37.271351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65b593-de6b-40e6-bb17-863697ab2573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:37.271488 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58042add-06bf-4b1b-93b0-4bf82d62caf8 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:37.272114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65b593-de6b-40e6-bb17-863697ab2573 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:37.272395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65b593-de6b-40e6-bb17-863697ab2573 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:37.272669 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65b593-de6b-40e6-bb17-863697ab2573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:37.272858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 546/1086] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:37.278100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b793f-3aef-41f3-b89d-337a7117759a None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:37.278389 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b793f-3aef-41f3-b89d-337a7117759a None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:37.278668 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b793f-3aef-41f3-b89d-337a7117759a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:37.298842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-ff5b793f-3aef-41f3-b89d-337a7117759a None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:37.300167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ff5b793f-3aef-41f3-b89d-337a7117759a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:37.336456 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:37.349201 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65b593-de6b-40e6-bb17-863697ab2573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:37.350674 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65b593-de6b-40e6-bb17-863697ab2573 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:37.377176 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 547/1087] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 03:43:37.399891 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b793f-3aef-41f3-b89d-337a7117759a None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:37.447693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 541/1088] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:43:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:43:37.454255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65b593-de6b-40e6-bb17-863697ab2573 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:37.458698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:37.498327 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b793f-3aef-41f3-b89d-337a7117759a None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:37.536206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416e9d8-08ea-4273-ab27-04152f4d5c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:37.536852 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416e9d8-08ea-4273-ab27-04152f4d5c08 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:37.537150 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416e9d8-08ea-4273-ab27-04152f4d5c08 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:37.537401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416e9d8-08ea-4273-ab27-04152f4d5c08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:37.542146 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:37.547857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416e9d8-08ea-4273-ab27-04152f4d5c08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:43:37.552697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-7416e9d8-08ea-4273-ab27-04152f4d5c08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:43:37.552697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:37.552697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:37.552697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:37.552697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:37.552697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:37.552697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:37.552697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:37.552697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:37.552697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:37.552697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:37.552697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:37.552697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:43:37.552697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:43:37.552697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:43:37.552697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:43:37.557319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:43:37.557319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:43:37.557319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:43:37.557319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:43:37.557319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:37.557319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:37.557319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:37.557319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:37.557319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:37.557319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:37.557319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:37.557319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:37.557319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:37.557319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:37.557319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:37.557319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:37.558282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:37.558282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:37.558282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:37.558282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:37.558282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:43:37.558282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:43:37.558282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:43:37.558282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:43:37.558282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:43:37.558282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:43:37.558282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:43:37.558282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:43:37.558282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 548/1089] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:43:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:37.559025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65b593-de6b-40e6-bb17-863697ab2573 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:37.561292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416e9d8-08ea-4273-ab27-04152f4d5c08 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:37.590228 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48c0b1-d1b8-4924-8d5d-c56a158a0e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:37.590795 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48c0b1-d1b8-4924-8d5d-c56a158a0e9d None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:37.591074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48c0b1-d1b8-4924-8d5d-c56a158a0e9d None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:37.591389 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48c0b1-d1b8-4924-8d5d-c56a158a0e9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:37.601535 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48c0b1-d1b8-4924-8d5d-c56a158a0e9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:37.603022 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48c0b1-d1b8-4924-8d5d-c56a158a0e9d None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:37.618908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-4c48c0b1-d1b8-4924-8d5d-c56a158a0e9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:37.618908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:37.618908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:37.618908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:37.618908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:37.618908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:37.618908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:37.618908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:37.618908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:37.618908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:37.618908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:37.618908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:37.618908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:43:37.618908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:43:37.618908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:43:37.620057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:43:37.620057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:37.620057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:37.620057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:37.620057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:37.620057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:37.620057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:37.620057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:37.620057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:37.620057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:37.620057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:37.620057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:37.620057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:37.620057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:37.620057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:37.620057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:37.620057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:37.621129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:43:37.621129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:43:37.621129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:43:37.621129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:37.621129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 542/1090] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:37.626455 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48c0b1-d1b8-4924-8d5d-c56a158a0e9d None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:37.667269 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416e9d8-08ea-4273-ab27-04152f4d5c08 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:37.688788 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:37.703545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b48c5-a738-46e1-82e2-565c1fa7d681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:37.704170 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b48c5-a738-46e1-82e2-565c1fa7d681 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:37.705062 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b48c5-a738-46e1-82e2-565c1fa7d681 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:37.705062 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b48c5-a738-46e1-82e2-565c1fa7d681 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:37.705395 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b48c5-a738-46e1-82e2-565c1fa7d681 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:37.705698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b48c5-a738-46e1-82e2-565c1fa7d681 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:37.707066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b48c5-a738-46e1-82e2-565c1fa7d681 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:37.719935 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 549/1091] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:43:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:37.722139 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b48c5-a738-46e1-82e2-565c1fa7d681 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:37.729571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48c0b1-d1b8-4924-8d5d-c56a158a0e9d None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:37.764109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86cdb7-8423-4361-a298-82e6131bce04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:37.764727 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86cdb7-8423-4361-a298-82e6131bce04 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:37.765009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86cdb7-8423-4361-a298-82e6131bce04 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:37.765289 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86cdb7-8423-4361-a298-82e6131bce04 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:37.765986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86cdb7-8423-4361-a298-82e6131bce04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:37.766288 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86cdb7-8423-4361-a298-82e6131bce04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:37.767737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86cdb7-8423-4361-a298-82e6131bce04 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:37.777063 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:37.783131 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 543/1092] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:37.788702 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86cdb7-8423-4361-a298-82e6131bce04 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:37.836505 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b48c5-a738-46e1-82e2-565c1fa7d681 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:37.870350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dd062-a32f-4741-b79e-f68b52d17e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:37.870929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dd062-a32f-4741-b79e-f68b52d17e1d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:37.871209 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dd062-a32f-4741-b79e-f68b52d17e1d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:37.871518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dd062-a32f-4741-b79e-f68b52d17e1d None admin] PATH_INFO: `/v3/users/ff2df671359b47a1a45358bc8b966138` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:37.873257 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dd062-a32f-4741-b79e-f68b52d17e1d None admin] RBAC: Authorizing `identity:get_user(user_id=ff2df671359b47a1a45358bc8b966138)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:37.874771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dd062-a32f-4741-b79e-f68b52d17e1d None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:37.876429 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 550/1093] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:43:37 2022] GET /identity/v3/users/ff2df671359b47a1a45358bc8b966138 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:37.882271 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dd062-a32f-4741-b79e-f68b52d17e1d None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:37.889733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86cdb7-8423-4361-a298-82e6131bce04 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:37.924726 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01008ad-8c4a-4559-bd21-7b2c3b79f470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:37.925375 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01008ad-8c4a-4559-bd21-7b2c3b79f470 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:37.925704 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01008ad-8c4a-4559-bd21-7b2c3b79f470 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:37.925941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01008ad-8c4a-4559-bd21-7b2c3b79f470 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:37.932377 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:37.932570 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01008ad-8c4a-4559-bd21-7b2c3b79f470 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:37.934012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01008ad-8c4a-4559-bd21-7b2c3b79f470 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:37.945931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-b01008ad-8c4a-4559-bd21-7b2c3b79f470 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:37.945931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:37.945931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:37.945931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:37.945931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:37.945931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:37.945931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:37.945931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:37.945931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:37.945931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:37.945931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:37.945931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:37.945931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:43:37.945931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:43:37.945931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:43:37.947138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:43:37.947138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:37.947138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:37.947138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:37.947138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:37.947138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:37.947138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:37.947138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:37.947138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:37.947138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:37.947138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:37.947138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:37.947138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:37.947138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:37.947138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:37.947138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:37.947138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:37.948066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:43:37.948066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:43:37.948066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:43:37.948066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:43:37.948066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:43:37.948066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:43:37.948066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:43:37.948066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:37.948066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 544/1094] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:43:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:43:37.953476 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01008ad-8c4a-4559-bd21-7b2c3b79f470 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:37.983535 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dd062-a32f-4741-b79e-f68b52d17e1d None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:38.010587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:38.016912 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815665c0-9af1-4d55-84fe-b8352c02addd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:38.017570 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815665c0-9af1-4d55-84fe-b8352c02addd None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:38.017849 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815665c0-9af1-4d55-84fe-b8352c02addd None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:38.031059 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815665c0-9af1-4d55-84fe-b8352c02addd None admin] PATH_INFO: `/v3/projects/ad65f3cfc4d64bd1ad302921911da7ad` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:38.031059 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815665c0-9af1-4d55-84fe-b8352c02addd None admin] RBAC: Authorizing `identity:get_project(project_id=ad65f3cfc4d64bd1ad302921911da7ad)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:38.031059 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815665c0-9af1-4d55-84fe-b8352c02addd None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:38.031059 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 551/1095] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:43:37 2022] GET /identity/v3/projects/ad65f3cfc4d64bd1ad302921911da7ad => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:38.031059 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815665c0-9af1-4d55-84fe-b8352c02addd None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:38.056430 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01008ad-8c4a-4559-bd21-7b2c3b79f470 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:38.094125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e067432-557d-447c-bce6-a40f9c449ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:38.094740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e067432-557d-447c-bce6-a40f9c449ab5 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:38.095025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e067432-557d-447c-bce6-a40f9c449ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:38.095292 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e067432-557d-447c-bce6-a40f9c449ab5 None admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:38.096069 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e067432-557d-447c-bce6-a40f9c449ab5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:38.096371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e067432-557d-447c-bce6-a40f9c449ab5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:38.097912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e067432-557d-447c-bce6-a40f9c449ab5 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:38.110277 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 545/1096] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:43:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:38.116228 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e067432-557d-447c-bce6-a40f9c449ab5 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:38.130736 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815665c0-9af1-4d55-84fe-b8352c02addd None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:38.147336 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:38.164563 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c842d9-2d28-482f-9e67-7005377a43a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:38.165239 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c842d9-2d28-482f-9e67-7005377a43a7 None admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:38.165514 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c842d9-2d28-482f-9e67-7005377a43a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:38.165789 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c842d9-2d28-482f-9e67-7005377a43a7 None admin] PATH_INFO: `/v3/projects/ad65f3cfc4d64bd1ad302921911da7ad/users/ff2df671359b47a1a45358bc8b966138/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:38.167773 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c842d9-2d28-482f-9e67-7005377a43a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad65f3cfc4d64bd1ad302921911da7ad, user_id=ff2df671359b47a1a45358bc8b966138, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:38.169220 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c842d9-2d28-482f-9e67-7005377a43a7 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:38.216105 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e067432-557d-447c-bce6-a40f9c449ab5 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:38.236379 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:38.250088 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4fc39-b3e5-4ecf-9283-faa80adb2385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:38.250697 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4fc39-b3e5-4ecf-9283-faa80adb2385 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:38.250981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4fc39-b3e5-4ecf-9283-faa80adb2385 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:38.251258 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4fc39-b3e5-4ecf-9283-faa80adb2385 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:38.252077 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4fc39-b3e5-4ecf-9283-faa80adb2385 None admin] RBAC: Adding query filter params (role.id=c06601c249ef4cad81ec53a2e55aba1e, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=5133abf4c32a45b0b2188f71496c572b) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:38.252386 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4fc39-b3e5-4ecf-9283-faa80adb2385 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:38.253816 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4fc39-b3e5-4ecf-9283-faa80adb2385 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:38.259673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 546/1097] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:43:38 2022] GET /identity/v3/role_assignments?user.id=5133abf4c32a45b0b2188f71496c572b&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=c06601c249ef4cad81ec53a2e55aba1e => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:38.273752 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 552/1098] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:43:38 2022] PUT /identity/v3/projects/ad65f3cfc4d64bd1ad302921911da7ad/users/ff2df671359b47a1a45358bc8b966138/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 03:43:40.291784 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e1b8b-5ff3-4c7c-8437-1ba6cdc8ca1d None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:40.292338 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e1b8b-5ff3-4c7c-8437-1ba6cdc8ca1d None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:40.292338 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e1b8b-5ff3-4c7c-8437-1ba6cdc8ca1d None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:40.293665 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 547/1099] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:40.299382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a52ca5-9cfe-4825-b384-b613f7608b2f None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:40.299847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a52ca5-9cfe-4825-b384-b613f7608b2f None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:40.299944 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a52ca5-9cfe-4825-b384-b613f7608b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:40.318289 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-e4a52ca5-9cfe-4825-b384-b613f7608b2f None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:40.319524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e4a52ca5-9cfe-4825-b384-b613f7608b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:40.385133 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 553/1100] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:40.410019 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e1b8b-5ff3-4c7c-8437-1ba6cdc8ca1d None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:40.508389 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e1b8b-5ff3-4c7c-8437-1ba6cdc8ca1d None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:40.542005 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffc25e-2bed-4c40-b5c5-f0f3be8202fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:40.542571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffc25e-2bed-4c40-b5c5-f0f3be8202fd None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:40.542855 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffc25e-2bed-4c40-b5c5-f0f3be8202fd None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:40.543130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffc25e-2bed-4c40-b5c5-f0f3be8202fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:40.553358 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffc25e-2bed-4c40-b5c5-f0f3be8202fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:43:40.558145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-d6ffc25e-2bed-4c40-b5c5-f0f3be8202fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:43:40.558145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:43:40.558145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:43:40.558145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:43:40.558145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:43:40.558145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:43:40.558145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:43:40.558145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:43:40.558145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:43:40.558145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:43:40.558145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:43:40.558145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:43:40.558145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:43:40.558145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:43:40.558145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:43:40.558145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:43:40.559400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:43:40.559400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:43:40.559400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:43:40.559400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:43:40.559400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:43:40.559400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:43:40.559400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:43:40.559400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:43:40.559400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:43:40.559400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:43:40.559400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:43:40.559400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:43:40.559400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:43:40.559400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:43:40.559400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:43:40.559400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:43:40.561137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:43:40.561137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:43:40.561137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:43:40.561137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:43:40.561137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:43:40.561137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:43:40.561137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:43:40.561137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:43:40.561137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:43:40.561137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:43:40.561137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:43:40.561137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:43:40.561137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 548/1101] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:43:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:43:40.566425 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a52ca5-9cfe-4825-b384-b613f7608b2f None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:40.663092 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a52ca5-9cfe-4825-b384-b613f7608b2f None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:40.672854 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:40.697296 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4b03f-c0e7-4147-aafd-d579466fb23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:40.697919 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4b03f-c0e7-4147-aafd-d579466fb23e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:40.698199 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4b03f-c0e7-4147-aafd-d579466fb23e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:40.698472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4b03f-c0e7-4147-aafd-d579466fb23e None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:40.699187 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4b03f-c0e7-4147-aafd-d579466fb23e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:40.699517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4b03f-c0e7-4147-aafd-d579466fb23e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:40.701027 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4b03f-c0e7-4147-aafd-d579466fb23e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:40.709756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 554/1102] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:43:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:40.715907 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffc25e-2bed-4c40-b5c5-f0f3be8202fd None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:40.761205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:40.956078 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffc25e-2bed-4c40-b5c5-f0f3be8202fd None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:40.990089 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c39de0-062f-4d8f-b252-87cffbb90a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:40.990714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c39de0-062f-4d8f-b252-87cffbb90a63 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:40.990998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c39de0-062f-4d8f-b252-87cffbb90a63 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:40.991274 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c39de0-062f-4d8f-b252-87cffbb90a63 None admin] PATH_INFO: `/v3/users/ff2df671359b47a1a45358bc8b966138` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:40.992489 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c39de0-062f-4d8f-b252-87cffbb90a63 None admin] RBAC: Authorizing `identity:get_user(user_id=ff2df671359b47a1a45358bc8b966138)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:40.993932 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c39de0-062f-4d8f-b252-87cffbb90a63 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:40.995558 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 549/1103] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:43:40 2022] GET /identity/v3/users/ff2df671359b47a1a45358bc8b966138 => generated 285 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:41.002231 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4b03f-c0e7-4147-aafd-d579466fb23e None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:41.102219 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4b03f-c0e7-4147-aafd-d579466fb23e None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:41.135203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12adc30-e8eb-4a22-a18a-8ff184390e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:41.135869 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12adc30-e8eb-4a22-a18a-8ff184390e90 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:41.136147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12adc30-e8eb-4a22-a18a-8ff184390e90 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:41.136419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12adc30-e8eb-4a22-a18a-8ff184390e90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:41.173878 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:41.202229 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12adc30-e8eb-4a22-a18a-8ff184390e90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:41.203739 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12adc30-e8eb-4a22-a18a-8ff184390e90 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:41.300121 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 555/1104] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:43:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:43:41.306148 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c39de0-062f-4d8f-b252-87cffbb90a63 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:41.406023 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c39de0-062f-4d8f-b252-87cffbb90a63 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:41.418578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:41.439447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39d56d-7c4c-4385-a988-feb6ea599de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:41.440165 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39d56d-7c4c-4385-a988-feb6ea599de6 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:41.440536 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39d56d-7c4c-4385-a988-feb6ea599de6 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:41.440811 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39d56d-7c4c-4385-a988-feb6ea599de6 None admin] PATH_INFO: `/v3/projects/ad65f3cfc4d64bd1ad302921911da7ad` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:41.441949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39d56d-7c4c-4385-a988-feb6ea599de6 None admin] RBAC: Authorizing `identity:get_project(project_id=ad65f3cfc4d64bd1ad302921911da7ad)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:41.443896 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39d56d-7c4c-4385-a988-feb6ea599de6 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:41.445551 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 550/1105] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:43:41 2022] GET /identity/v3/projects/ad65f3cfc4d64bd1ad302921911da7ad => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:41.452383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12adc30-e8eb-4a22-a18a-8ff184390e90 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:41.518530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:41.546939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12adc30-e8eb-4a22-a18a-8ff184390e90 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:41.581861 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c444a7-f77b-4d45-a942-471cb9cd5d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:41.582413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c444a7-f77b-4d45-a942-471cb9cd5d0d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:41.582689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c444a7-f77b-4d45-a942-471cb9cd5d0d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:41.582958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c444a7-f77b-4d45-a942-471cb9cd5d0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:41.583776 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c444a7-f77b-4d45-a942-471cb9cd5d0d None admin] RBAC: Adding query filter params (role.id=8a5766c4aef44773834941d1bdbd1e98, scope.project.id=ad65f3cfc4d64bd1ad302921911da7ad, user.id=ff2df671359b47a1a45358bc8b966138) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:41.584083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c444a7-f77b-4d45-a942-471cb9cd5d0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:41.585504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c444a7-f77b-4d45-a942-471cb9cd5d0d None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:41.591932 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 556/1106] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:43:41 2022] GET /identity/v3/role_assignments?user.id=ff2df671359b47a1a45358bc8b966138&scope.project.id=ad65f3cfc4d64bd1ad302921911da7ad&role.id=8a5766c4aef44773834941d1bdbd1e98 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:43.627890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656674a5-81e5-4cb8-b171-7ecfab1fe4a3 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:43.628426 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656674a5-81e5-4cb8-b171-7ecfab1fe4a3 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:43.628426 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656674a5-81e5-4cb8-b171-7ecfab1fe4a3 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:43.629773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 551/1107] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:43.635070 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9fe6e-3c42-4616-8185-97c2dc1aba6c None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:43.635472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9fe6e-3c42-4616-8185-97c2dc1aba6c None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:43.635672 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9fe6e-3c42-4616-8185-97c2dc1aba6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:43.654106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-69e9fe6e-3c42-4616-8185-97c2dc1aba6c None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:43.655527 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-69e9fe6e-3c42-4616-8185-97c2dc1aba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:43.722143 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 557/1108] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:43.746483 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656674a5-81e5-4cb8-b171-7ecfab1fe4a3 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:43.847914 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656674a5-81e5-4cb8-b171-7ecfab1fe4a3 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:43.881970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6479a9e-a604-43f0-9e26-321b3dcd26a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:43.882536 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6479a9e-a604-43f0-9e26-321b3dcd26a2 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:43.882846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6479a9e-a604-43f0-9e26-321b3dcd26a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:43.883133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6479a9e-a604-43f0-9e26-321b3dcd26a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:43.884307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6479a9e-a604-43f0-9e26-321b3dcd26a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:43.885738 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6479a9e-a604-43f0-9e26-321b3dcd26a2 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:43.887345 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 552/1109] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:43.894086 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9fe6e-3c42-4616-8185-97c2dc1aba6c None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:43.954283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:43.990066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9fe6e-3c42-4616-8185-97c2dc1aba6c None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:44.023022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf4e59-4812-4f36-8665-c60a0eb75da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:44.023664 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf4e59-4812-4f36-8665-c60a0eb75da0 None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:44.023941 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf4e59-4812-4f36-8665-c60a0eb75da0 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:44.024211 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf4e59-4812-4f36-8665-c60a0eb75da0 None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:44.024939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf4e59-4812-4f36-8665-c60a0eb75da0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:44.026365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf4e59-4812-4f36-8665-c60a0eb75da0 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:44.167141 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 558/1110] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 28 03:43:43 2022] POST /identity/v3/users => generated 286 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:43:46.237355 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7265fc8-dfd8-4d55-9055-5f19f636267f None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:46.237909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7265fc8-dfd8-4d55-9055-5f19f636267f None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:46.237909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7265fc8-dfd8-4d55-9055-5f19f636267f None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:46.239238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 553/1111] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:46.244462 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b8d5a-9517-49bb-9514-231f435b971d None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:46.244840 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b8d5a-9517-49bb-9514-231f435b971d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:46.245020 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b8d5a-9517-49bb-9514-231f435b971d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:46.263215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-974b8d5a-9517-49bb-9514-231f435b971d None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:46.264442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-974b8d5a-9517-49bb-9514-231f435b971d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:46.328930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 559/1112] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:46.351682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7265fc8-dfd8-4d55-9055-5f19f636267f None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:46.400774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:46.451448 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7265fc8-dfd8-4d55-9055-5f19f636267f None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:46.484795 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b19d93-521a-469c-bd61-4e425c10c1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:46.485432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b19d93-521a-469c-bd61-4e425c10c1cd None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:46.485716 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b19d93-521a-469c-bd61-4e425c10c1cd None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:46.485997 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b19d93-521a-469c-bd61-4e425c10c1cd None admin] PATH_INFO: `/v3/roles/81c955f5702546679605b5484602ae69` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:46.487524 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b19d93-521a-469c-bd61-4e425c10c1cd None admin] RBAC: Authorizing `identity:get_role(role_id=81c955f5702546679605b5484602ae69)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:46.488842 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b19d93-521a-469c-bd61-4e425c10c1cd None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:46.490190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 554/1113] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:43:46 2022] GET /identity/v3/roles/81c955f5702546679605b5484602ae69 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:46.496128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b8d5a-9517-49bb-9514-231f435b971d None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:46.545125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:46.592766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b8d5a-9517-49bb-9514-231f435b971d None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:46.625571 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e0b6a-a1e7-48d3-ba1b-38db3c326f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:46.626203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e0b6a-a1e7-48d3-ba1b-38db3c326f34 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:46.626484 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e0b6a-a1e7-48d3-ba1b-38db3c326f34 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:46.626760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e0b6a-a1e7-48d3-ba1b-38db3c326f34 None admin] PATH_INFO: `/v3/users/9c7076767e9b417b838bb2d34f04e81f` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:46.640226 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e0b6a-a1e7-48d3-ba1b-38db3c326f34 None admin] RBAC: Authorizing `identity:get_user(user_id=9c7076767e9b417b838bb2d34f04e81f)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:46.641668 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e0b6a-a1e7-48d3-ba1b-38db3c326f34 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:46.643301 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 560/1114] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:43:46 2022] GET /identity/v3/users/9c7076767e9b417b838bb2d34f04e81f => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:46.649044 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b19d93-521a-469c-bd61-4e425c10c1cd None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:46.752638 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b19d93-521a-469c-bd61-4e425c10c1cd None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:46.763945 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:46.782054 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a8e80-1b72-48ac-8a5d-2557f2f1c1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:46.782686 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a8e80-1b72-48ac-8a5d-2557f2f1c1a2 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:46.782969 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a8e80-1b72-48ac-8a5d-2557f2f1c1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:46.783646 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a8e80-1b72-48ac-8a5d-2557f2f1c1a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:46.850375 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a8e80-1b72-48ac-8a5d-2557f2f1c1a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:46.851927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a8e80-1b72-48ac-8a5d-2557f2f1c1a2 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:47.014979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 555/1115] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:43:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:43:47.020874 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e0b6a-a1e7-48d3-ba1b-38db3c326f34 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:47.122428 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e0b6a-a1e7-48d3-ba1b-38db3c326f34 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:47.131483 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:47.156280 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6745e-05c9-4dd5-bc36-ecc227434df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:47.156922 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6745e-05c9-4dd5-bc36-ecc227434df5 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:47.157233 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6745e-05c9-4dd5-bc36-ecc227434df5 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:47.157505 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6745e-05c9-4dd5-bc36-ecc227434df5 None admin] PATH_INFO: `/v3/projects/ad65f3cfc4d64bd1ad302921911da7ad` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:47.158663 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6745e-05c9-4dd5-bc36-ecc227434df5 None admin] RBAC: Authorizing `identity:get_project(project_id=ad65f3cfc4d64bd1ad302921911da7ad)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:47.160115 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6745e-05c9-4dd5-bc36-ecc227434df5 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:47.161775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 561/1116] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:43:47 2022] GET /identity/v3/projects/ad65f3cfc4d64bd1ad302921911da7ad => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:47.168030 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a8e80-1b72-48ac-8a5d-2557f2f1c1a2 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:47.184769 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:47.264198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a8e80-1b72-48ac-8a5d-2557f2f1c1a2 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:47.298036 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ac091-3ff1-4d8d-92bb-65a6ffa27b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:47.298650 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ac091-3ff1-4d8d-92bb-65a6ffa27b7c None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:47.298928 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ac091-3ff1-4d8d-92bb-65a6ffa27b7c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:47.299199 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ac091-3ff1-4d8d-92bb-65a6ffa27b7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:47.300002 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ac091-3ff1-4d8d-92bb-65a6ffa27b7c None admin] RBAC: Adding query filter params (role.id=81c955f5702546679605b5484602ae69, scope.project.id=ad65f3cfc4d64bd1ad302921911da7ad, user.id=9c7076767e9b417b838bb2d34f04e81f) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:47.300308 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ac091-3ff1-4d8d-92bb-65a6ffa27b7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:47.301720 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ac091-3ff1-4d8d-92bb-65a6ffa27b7c None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:47.307035 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 556/1117] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:43:47 2022] GET /identity/v3/role_assignments?user.id=9c7076767e9b417b838bb2d34f04e81f&scope.project.id=ad65f3cfc4d64bd1ad302921911da7ad&role.id=81c955f5702546679605b5484602ae69 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:49.289585 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daf548-ba3d-407a-a69f-839b4407cfea None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:49.290137 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daf548-ba3d-407a-a69f-839b4407cfea None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:49.290137 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daf548-ba3d-407a-a69f-839b4407cfea None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:49.291575 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 562/1118] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:49.297283 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0a1aa-f56f-4a69-b205-d9f5fc9e8dd4 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:49.297709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0a1aa-f56f-4a69-b205-d9f5fc9e8dd4 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:49.297837 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0a1aa-f56f-4a69-b205-d9f5fc9e8dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:49.316268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-2fd0a1aa-f56f-4a69-b205-d9f5fc9e8dd4 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:49.317469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-2fd0a1aa-f56f-4a69-b205-d9f5fc9e8dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:49.382295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 557/1119] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:49.404669 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daf548-ba3d-407a-a69f-839b4407cfea None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:49.506784 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daf548-ba3d-407a-a69f-839b4407cfea None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:49.540201 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bf5d4-aed7-4680-a0a9-08f1e67e0559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:49.540766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bf5d4-aed7-4680-a0a9-08f1e67e0559 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:49.541042 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bf5d4-aed7-4680-a0a9-08f1e67e0559 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:49.541313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bf5d4-aed7-4680-a0a9-08f1e67e0559 None admin] PATH_INFO: `/v3/roles/81c955f5702546679605b5484602ae69` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:49.542817 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bf5d4-aed7-4680-a0a9-08f1e67e0559 None admin] RBAC: Authorizing `identity:get_role(role_id=81c955f5702546679605b5484602ae69)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:49.544922 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bf5d4-aed7-4680-a0a9-08f1e67e0559 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:49.546511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 563/1120] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:43:49 2022] GET /identity/v3/roles/81c955f5702546679605b5484602ae69 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:49.552407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0a1aa-f56f-4a69-b205-d9f5fc9e8dd4 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:49.564580 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:49.649011 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0a1aa-f56f-4a69-b205-d9f5fc9e8dd4 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:49.683764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92361fba-a228-40cc-98c1-c3ec4accf1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:49.684407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92361fba-a228-40cc-98c1-c3ec4accf1ae None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:49.684689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92361fba-a228-40cc-98c1-c3ec4accf1ae None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:49.685927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92361fba-a228-40cc-98c1-c3ec4accf1ae None admin] PATH_INFO: `/v3/users/9c7076767e9b417b838bb2d34f04e81f` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:49.687109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92361fba-a228-40cc-98c1-c3ec4accf1ae None admin] RBAC: Authorizing `identity:get_user(user_id=9c7076767e9b417b838bb2d34f04e81f)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:49.688574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92361fba-a228-40cc-98c1-c3ec4accf1ae None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:49.690198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 558/1121] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:43:49 2022] GET /identity/v3/users/9c7076767e9b417b838bb2d34f04e81f => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:49.696101 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bf5d4-aed7-4680-a0a9-08f1e67e0559 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:49.742620 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:49.795824 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bf5d4-aed7-4680-a0a9-08f1e67e0559 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:49.828827 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4443df5-d7a4-44cf-80f0-9d9f0fa63341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:49.829478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4443df5-d7a4-44cf-80f0-9d9f0fa63341 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:49.829754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4443df5-d7a4-44cf-80f0-9d9f0fa63341 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:49.830028 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4443df5-d7a4-44cf-80f0-9d9f0fa63341 None admin] PATH_INFO: `/v3/projects/ad65f3cfc4d64bd1ad302921911da7ad` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:49.831183 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4443df5-d7a4-44cf-80f0-9d9f0fa63341 None admin] RBAC: Authorizing `identity:get_project(project_id=ad65f3cfc4d64bd1ad302921911da7ad)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:49.832650 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4443df5-d7a4-44cf-80f0-9d9f0fa63341 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:49.834351 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 564/1122] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:43:49 2022] GET /identity/v3/projects/ad65f3cfc4d64bd1ad302921911da7ad => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:49.840442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92361fba-a228-40cc-98c1-c3ec4accf1ae None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:49.921010 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:49.941897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92361fba-a228-40cc-98c1-c3ec4accf1ae None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:49.976538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65fb02-d8ad-41a8-8483-deaea625c38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:49.977206 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65fb02-d8ad-41a8-8483-deaea625c38e None admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:49.977488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65fb02-d8ad-41a8-8483-deaea625c38e None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:49.977765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65fb02-d8ad-41a8-8483-deaea625c38e None admin] PATH_INFO: `/v3/projects/ad65f3cfc4d64bd1ad302921911da7ad/users/9c7076767e9b417b838bb2d34f04e81f/roles/81c955f5702546679605b5484602ae69` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:49.979953 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65fb02-d8ad-41a8-8483-deaea625c38e None admin] RBAC: Authorizing `identity:create_grant(project_id=ad65f3cfc4d64bd1ad302921911da7ad, user_id=9c7076767e9b417b838bb2d34f04e81f, role_id=81c955f5702546679605b5484602ae69)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:49.981400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65fb02-d8ad-41a8-8483-deaea625c38e None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:50.099495 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 559/1123] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:43:49 2022] PUT /identity/v3/projects/ad65f3cfc4d64bd1ad302921911da7ad/users/9c7076767e9b417b838bb2d34f04e81f/roles/81c955f5702546679605b5484602ae69 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:43:52.080617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401896d-3a66-488b-9f48-2fb52cb1bf1b None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:52.081138 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401896d-3a66-488b-9f48-2fb52cb1bf1b None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:52.081251 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401896d-3a66-488b-9f48-2fb52cb1bf1b None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:52.082528 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 565/1124] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:52.087639 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d725f-3e99-4d85-a474-a4f55e613d9d None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:52.088081 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d725f-3e99-4d85-a474-a4f55e613d9d None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:52.088209 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d725f-3e99-4d85-a474-a4f55e613d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:52.106353 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-6c6d725f-3e99-4d85-a474-a4f55e613d9d None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:52.108178 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-6c6d725f-3e99-4d85-a474-a4f55e613d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:52.173641 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 560/1125] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:52.196266 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401896d-3a66-488b-9f48-2fb52cb1bf1b None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:52.297465 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401896d-3a66-488b-9f48-2fb52cb1bf1b None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:52.310704 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:52.332854 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370a449-6a1f-4aac-9635-69399add8e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:52.333427 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370a449-6a1f-4aac-9635-69399add8e3e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:52.333704 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370a449-6a1f-4aac-9635-69399add8e3e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:52.333975 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370a449-6a1f-4aac-9635-69399add8e3e None admin] PATH_INFO: `/v3/roles/81c955f5702546679605b5484602ae69` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:52.335418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370a449-6a1f-4aac-9635-69399add8e3e None admin] RBAC: Authorizing `identity:get_role(role_id=81c955f5702546679605b5484602ae69)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:52.336843 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370a449-6a1f-4aac-9635-69399add8e3e None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:52.338194 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 566/1126] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:43:52 2022] GET /identity/v3/roles/81c955f5702546679605b5484602ae69 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:43:52.344709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d725f-3e99-4d85-a474-a4f55e613d9d None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:52.409493 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:52.444719 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d725f-3e99-4d85-a474-a4f55e613d9d None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:52.477392 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfc209-8045-41fc-9bd4-ae2c0d72a5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:52.478029 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfc209-8045-41fc-9bd4-ae2c0d72a5ca None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:52.478309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfc209-8045-41fc-9bd4-ae2c0d72a5ca None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:52.478609 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfc209-8045-41fc-9bd4-ae2c0d72a5ca None admin] PATH_INFO: `/v3/users/9c7076767e9b417b838bb2d34f04e81f` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:52.479753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfc209-8045-41fc-9bd4-ae2c0d72a5ca None admin] RBAC: Authorizing `identity:get_user(user_id=9c7076767e9b417b838bb2d34f04e81f)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:52.481176 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfc209-8045-41fc-9bd4-ae2c0d72a5ca None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:52.483407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 561/1127] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:43:52 2022] GET /identity/v3/users/9c7076767e9b417b838bb2d34f04e81f => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:52.489221 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370a449-6a1f-4aac-9635-69399add8e3e None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:52.586866 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370a449-6a1f-4aac-9635-69399add8e3e None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:52.622298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda6754-075e-4629-ab91-21350fdbd4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:52.622922 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda6754-075e-4629-ab91-21350fdbd4b1 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:52.623205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda6754-075e-4629-ab91-21350fdbd4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:52.623516 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda6754-075e-4629-ab91-21350fdbd4b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:52.671227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:52.690265 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda6754-075e-4629-ab91-21350fdbd4b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:52.691761 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda6754-075e-4629-ab91-21350fdbd4b1 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:52.790317 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 567/1128] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:43:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:43:52.796409 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfc209-8045-41fc-9bd4-ae2c0d72a5ca None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:52.896037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfc209-8045-41fc-9bd4-ae2c0d72a5ca None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:52.928560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11fec1-804f-4779-bb2e-f557f9b48122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:52.929200 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11fec1-804f-4779-bb2e-f557f9b48122 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:52.929483 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11fec1-804f-4779-bb2e-f557f9b48122 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:52.929763 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11fec1-804f-4779-bb2e-f557f9b48122 None admin] PATH_INFO: `/v3/projects/ad65f3cfc4d64bd1ad302921911da7ad` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:52.930907 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11fec1-804f-4779-bb2e-f557f9b48122 None admin] RBAC: Authorizing `identity:get_project(project_id=ad65f3cfc4d64bd1ad302921911da7ad)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:52.932369 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11fec1-804f-4779-bb2e-f557f9b48122 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:52.934119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 562/1129] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:43:52 2022] GET /identity/v3/projects/ad65f3cfc4d64bd1ad302921911da7ad => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:52.941203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda6754-075e-4629-ab91-21350fdbd4b1 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:53.020217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:53.038479 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda6754-075e-4629-ab91-21350fdbd4b1 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:53.072632 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1a1b7-9d6c-48d4-b986-779aaa816060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:53.073249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1a1b7-9d6c-48d4-b986-779aaa816060 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:53.073526 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1a1b7-9d6c-48d4-b986-779aaa816060 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:53.073796 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1a1b7-9d6c-48d4-b986-779aaa816060 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:53.074575 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1a1b7-9d6c-48d4-b986-779aaa816060 None admin] RBAC: Adding query filter params (role.id=81c955f5702546679605b5484602ae69, scope.project.id=ad65f3cfc4d64bd1ad302921911da7ad, user.id=9c7076767e9b417b838bb2d34f04e81f) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:43:53.074881 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1a1b7-9d6c-48d4-b986-779aaa816060 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:53.076878 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1a1b7-9d6c-48d4-b986-779aaa816060 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:53.082674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 568/1130] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:43:52 2022] GET /identity/v3/role_assignments?user.id=9c7076767e9b417b838bb2d34f04e81f&scope.project.id=ad65f3cfc4d64bd1ad302921911da7ad&role.id=81c955f5702546679605b5484602ae69 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:55.121958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b46499-b182-446d-ab6e-8aa90ad5c258 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:55.123115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b46499-b182-446d-ab6e-8aa90ad5c258 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:55.123115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b46499-b182-446d-ab6e-8aa90ad5c258 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:55.124424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 563/1131] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:55.129524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156288e1-3301-417a-bdfe-f159ad50d269 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:55.129938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156288e1-3301-417a-bdfe-f159ad50d269 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:55.130073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156288e1-3301-417a-bdfe-f159ad50d269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:55.148378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-156288e1-3301-417a-bdfe-f159ad50d269 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:55.149586 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-156288e1-3301-417a-bdfe-f159ad50d269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:55.214034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 569/1132] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:43:55.237678 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b46499-b182-446d-ab6e-8aa90ad5c258 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:55.241455 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:55.338446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b46499-b182-446d-ab6e-8aa90ad5c258 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:55.371236 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd705042-28c9-4266-84e6-533eb89c615c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:55.372018 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd705042-28c9-4266-84e6-533eb89c615c None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:55.372787 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd705042-28c9-4266-84e6-533eb89c615c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:55.373065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd705042-28c9-4266-84e6-533eb89c615c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:55.374294 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd705042-28c9-4266-84e6-533eb89c615c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:55.375755 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd705042-28c9-4266-84e6-533eb89c615c None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:55.377338 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 564/1133] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:55.383422 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156288e1-3301-417a-bdfe-f159ad50d269 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:55.455015 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:55.478975 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156288e1-3301-417a-bdfe-f159ad50d269 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:55.512500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08050e01-c4b5-4ec3-ad62-4e41eca93d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:55.513264 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08050e01-c4b5-4ec3-ad62-4e41eca93d5d None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:55.513592 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08050e01-c4b5-4ec3-ad62-4e41eca93d5d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:55.513870 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08050e01-c4b5-4ec3-ad62-4e41eca93d5d None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:55.514560 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08050e01-c4b5-4ec3-ad62-4e41eca93d5d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:55.516030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08050e01-c4b5-4ec3-ad62-4e41eca93d5d None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:55.639507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 570/1134] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 28 03:43:55 2022] POST /identity/v3/projects => generated 311 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:43:57.676780 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023276a4-eef8-40bb-9bfd-f27f2fd60c00 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:57.677308 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023276a4-eef8-40bb-9bfd-f27f2fd60c00 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:57.677308 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023276a4-eef8-40bb-9bfd-f27f2fd60c00 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:57.678692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 565/1135] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:43:57.683900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d194a-0316-4764-b235-ce82ec9e3431 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:57.684313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d194a-0316-4764-b235-ce82ec9e3431 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:57.684533 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d194a-0316-4764-b235-ce82ec9e3431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:57.702672 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-072d194a-0316-4764-b235-ce82ec9e3431 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:43:57.703875 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-072d194a-0316-4764-b235-ce82ec9e3431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:43:57.775462 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 571/1136] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:43:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 03:43:57.800987 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023276a4-eef8-40bb-9bfd-f27f2fd60c00 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:57.871662 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:57.901368 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023276a4-eef8-40bb-9bfd-f27f2fd60c00 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:57.935830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de25701-f6ba-42e7-9b72-51d58f6bddc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:57.936402 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de25701-f6ba-42e7-9b72-51d58f6bddc4 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:57.936684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de25701-f6ba-42e7-9b72-51d58f6bddc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:57.936960 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de25701-f6ba-42e7-9b72-51d58f6bddc4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:57.938101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de25701-f6ba-42e7-9b72-51d58f6bddc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:57.939550 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de25701-f6ba-42e7-9b72-51d58f6bddc4 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:57.941147 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 566/1137] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:43:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:43:57.947219 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d194a-0316-4764-b235-ce82ec9e3431 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:43:58.002700 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:58.044383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d194a-0316-4764-b235-ce82ec9e3431 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:43:58.078679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81539cf4-7efa-4844-aab9-ce8b1fdab726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:43:58.079686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539cf4-7efa-4844-aab9-ce8b1fdab726 None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:43:58.079969 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539cf4-7efa-4844-aab9-ce8b1fdab726 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:43:58.080239 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539cf4-7efa-4844-aab9-ce8b1fdab726 None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:43:58.080932 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81539cf4-7efa-4844-aab9-ce8b1fdab726 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:43:58.082360 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81539cf4-7efa-4844-aab9-ce8b1fdab726 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:43:58.215691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 572/1138] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 28 03:43:57 2022] POST /identity/v3/users => generated 286 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:44:00.248873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d7125-65d5-449c-be2d-4b2f62046470 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:00.249458 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d7125-65d5-449c-be2d-4b2f62046470 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:00.249458 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d7125-65d5-449c-be2d-4b2f62046470 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:00.250882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 567/1139] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:44:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:44:00.255967 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed91ee-f553-4b7a-8665-c9f25396a901 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:00.256382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed91ee-f553-4b7a-8665-c9f25396a901 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:00.256530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed91ee-f553-4b7a-8665-c9f25396a901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:00.274929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-64ed91ee-f553-4b7a-8665-c9f25396a901 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:44:00.276156 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-64ed91ee-f553-4b7a-8665-c9f25396a901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:44:00.341052 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 573/1140] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:44:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:44:00.363517 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d7125-65d5-449c-be2d-4b2f62046470 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:00.479253 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d7125-65d5-449c-be2d-4b2f62046470 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:00.514506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a4470-0186-4f73-8426-b7679231afce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:00.515083 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a4470-0186-4f73-8426-b7679231afce None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:00.515396 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a4470-0186-4f73-8426-b7679231afce None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:00.515673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a4470-0186-4f73-8426-b7679231afce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:00.523008 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:00.526062 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a4470-0186-4f73-8426-b7679231afce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:44:00.531286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-2e5a4470-0186-4f73-8426-b7679231afce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:44:00.531286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:44:00.531286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:44:00.531286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:44:00.531286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:44:00.531286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:44:00.531286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:44:00.531286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:44:00.531286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:44:00.531286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:44:00.531286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:44:00.531286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:44:00.531286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:44:00.531286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:44:00.531286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:44:00.531286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:44:00.532381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:44:00.532381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:44:00.532381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:44:00.532381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:44:00.532381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:44:00.532381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:44:00.532381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:44:00.532381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:44:00.532381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:44:00.532381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:44:00.532381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:44:00.532381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:44:00.532381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:44:00.532381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:44:00.532381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:44:00.532381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:44:00.533238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:44:00.533238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:44:00.533238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:44:00.533238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:44:00.533238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:44:00.533238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:44:00.533238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:44:00.533238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:44:00.533238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:44:00.533238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:44:00.533238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:44:00.533238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:44:00.533238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 568/1141] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:44:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:44:00.538664 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed91ee-f553-4b7a-8665-c9f25396a901 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:00.582751 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:00.638611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed91ee-f553-4b7a-8665-c9f25396a901 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:00.672451 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca00bd-6c06-4269-b301-0d8dcc8647bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:00.673061 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca00bd-6c06-4269-b301-0d8dcc8647bc None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:00.673336 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca00bd-6c06-4269-b301-0d8dcc8647bc None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:00.673605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca00bd-6c06-4269-b301-0d8dcc8647bc None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:00.674303 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca00bd-6c06-4269-b301-0d8dcc8647bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:44:00.674602 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca00bd-6c06-4269-b301-0d8dcc8647bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:00.675988 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca00bd-6c06-4269-b301-0d8dcc8647bc None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:00.683693 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 574/1142] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:44:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:00.690496 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a4470-0186-4f73-8426-b7679231afce None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:00.790381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a4470-0186-4f73-8426-b7679231afce None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:00.890491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6c6e4-e957-46e1-99ee-55e8f761ef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:00.891134 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6c6e4-e957-46e1-99ee-55e8f761ef6f None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:00.891441 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6c6e4-e957-46e1-99ee-55e8f761ef6f None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:00.891719 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6c6e4-e957-46e1-99ee-55e8f761ef6f None admin] PATH_INFO: `/v3/users/c38f4af161e8444aa5d864964687820b` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:00.905465 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6c6e4-e957-46e1-99ee-55e8f761ef6f None admin] RBAC: Authorizing `identity:get_user(user_id=c38f4af161e8444aa5d864964687820b)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:00.906904 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6c6e4-e957-46e1-99ee-55e8f761ef6f None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:00.908648 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 569/1143] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:44:00 2022] GET /identity/v3/users/c38f4af161e8444aa5d864964687820b => generated 286 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:00.914899 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca00bd-6c06-4269-b301-0d8dcc8647bc None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:01.012123 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca00bd-6c06-4269-b301-0d8dcc8647bc None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:01.015031 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:01.045818 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccd338-60cf-42bd-9d99-9d578fb609fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:01.046449 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccd338-60cf-42bd-9d99-9d578fb609fc None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:01.046731 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccd338-60cf-42bd-9d99-9d578fb609fc None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:01.047002 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccd338-60cf-42bd-9d99-9d578fb609fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:01.112319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccd338-60cf-42bd-9d99-9d578fb609fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:01.113829 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccd338-60cf-42bd-9d99-9d578fb609fc None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:01.209479 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 575/1144] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:44:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:44:01.215467 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6c6e4-e957-46e1-99ee-55e8f761ef6f None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:01.273277 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:01.314338 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6c6e4-e957-46e1-99ee-55e8f761ef6f None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:01.346850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760a7e1-0c83-4b56-950a-836fe60d5953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:01.347505 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760a7e1-0c83-4b56-950a-836fe60d5953 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:01.347788 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760a7e1-0c83-4b56-950a-836fe60d5953 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:01.348065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760a7e1-0c83-4b56-950a-836fe60d5953 None admin] PATH_INFO: `/v3/projects/aaf2ac3e7434480eba9f758a7845a138` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:01.349202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760a7e1-0c83-4b56-950a-836fe60d5953 None admin] RBAC: Authorizing `identity:get_project(project_id=aaf2ac3e7434480eba9f758a7845a138)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:01.350626 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760a7e1-0c83-4b56-950a-836fe60d5953 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:01.352304 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 570/1145] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:44:01 2022] GET /identity/v3/projects/aaf2ac3e7434480eba9f758a7845a138 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:01.359055 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccd338-60cf-42bd-9d99-9d578fb609fc None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:01.362080 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:01.455466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccd338-60cf-42bd-9d99-9d578fb609fc None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:01.488452 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a48cff-83aa-44c1-a4ef-c230753cb8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:01.489057 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a48cff-83aa-44c1-a4ef-c230753cb8b9 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:01.489337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a48cff-83aa-44c1-a4ef-c230753cb8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:01.489610 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a48cff-83aa-44c1-a4ef-c230753cb8b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:01.490388 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a48cff-83aa-44c1-a4ef-c230753cb8b9 None admin] RBAC: Adding query filter params (role.id=8a5766c4aef44773834941d1bdbd1e98, scope.project.id=aaf2ac3e7434480eba9f758a7845a138, user.id=c38f4af161e8444aa5d864964687820b) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:44:01.490695 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a48cff-83aa-44c1-a4ef-c230753cb8b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:01.492140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a48cff-83aa-44c1-a4ef-c230753cb8b9 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:01.497345 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 576/1146] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:44:01 2022] GET /identity/v3/role_assignments?user.id=c38f4af161e8444aa5d864964687820b&scope.project.id=aaf2ac3e7434480eba9f758a7845a138&role.id=8a5766c4aef44773834941d1bdbd1e98 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:03.622046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d70d6b-8a0e-4f99-8123-a749cf0697a5 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:03.622589 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d70d6b-8a0e-4f99-8123-a749cf0697a5 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:03.622589 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d70d6b-8a0e-4f99-8123-a749cf0697a5 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:03.624016 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 571/1147] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:44:03.629214 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aaae1-54ae-48fe-8824-01185fd3cafc None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:03.629608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aaae1-54ae-48fe-8824-01185fd3cafc None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:03.629767 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aaae1-54ae-48fe-8824-01185fd3cafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:03.648244 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-461aaae1-54ae-48fe-8824-01185fd3cafc None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:44:03.649454 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-461aaae1-54ae-48fe-8824-01185fd3cafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:44:03.713896 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:03.720135 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 577/1148] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:44:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:44:03.742311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d70d6b-8a0e-4f99-8123-a749cf0697a5 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:03.846951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d70d6b-8a0e-4f99-8123-a749cf0697a5 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:03.874293 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:03.882862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1559d-1d14-48e4-870b-b12c65698189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:03.883533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1559d-1d14-48e4-870b-b12c65698189 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:03.888130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1559d-1d14-48e4-870b-b12c65698189 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:03.888130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1559d-1d14-48e4-870b-b12c65698189 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:03.894885 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1559d-1d14-48e4-870b-b12c65698189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:44:03.899807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-cfe1559d-1d14-48e4-870b-b12c65698189 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:44:03.899807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:44:03.899807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:44:03.899807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:44:03.899807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:44:03.899807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:44:03.899807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:44:03.899807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:44:03.899807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:44:03.899807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:44:03.899807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:44:03.899807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:44:03.899807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:44:03.899807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:44:03.899807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:44:03.899807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:44:03.900964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:44:03.900964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:44:03.900964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:44:03.900964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:44:03.900964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:44:03.900964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:44:03.900964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:44:03.900964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:44:03.900964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:44:03.900964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:44:03.900964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:44:03.900964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:44:03.900964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:44:03.900964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:44:03.900964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:44:03.900964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:44:03.902469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:44:03.902469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:44:03.902469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:44:03.902469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:44:03.902469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:44:03.902469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:44:03.902469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:44:03.902469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:44:03.902469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:44:03.902469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:44:03.902469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:44:03.902469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:44:03.902469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 572/1149] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:44:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:44:03.907927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aaae1-54ae-48fe-8824-01185fd3cafc None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:04.004264 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aaae1-54ae-48fe-8824-01185fd3cafc None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:04.038158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d723d-f96a-4d2e-9ffa-a8d5eabdf6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:04.038784 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d723d-f96a-4d2e-9ffa-a8d5eabdf6b9 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:04.039063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d723d-f96a-4d2e-9ffa-a8d5eabdf6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:04.039364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d723d-f96a-4d2e-9ffa-a8d5eabdf6b9 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:04.040081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d723d-f96a-4d2e-9ffa-a8d5eabdf6b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:44:04.040388 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d723d-f96a-4d2e-9ffa-a8d5eabdf6b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:04.041766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d723d-f96a-4d2e-9ffa-a8d5eabdf6b9 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:04.050563 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 578/1150] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:44:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:04.056801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1559d-1d14-48e4-870b-b12c65698189 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:04.157406 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1559d-1d14-48e4-870b-b12c65698189 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:04.190551 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf9ceb-63b4-4891-bdd4-cfa48c29bb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:04.191190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf9ceb-63b4-4891-bdd4-cfa48c29bb65 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:04.191509 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf9ceb-63b4-4891-bdd4-cfa48c29bb65 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:04.191786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf9ceb-63b4-4891-bdd4-cfa48c29bb65 None admin] PATH_INFO: `/v3/users/c38f4af161e8444aa5d864964687820b` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:04.192945 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf9ceb-63b4-4891-bdd4-cfa48c29bb65 None admin] RBAC: Authorizing `identity:get_user(user_id=c38f4af161e8444aa5d864964687820b)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:04.194387 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf9ceb-63b4-4891-bdd4-cfa48c29bb65 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:04.196033 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 573/1151] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:44:04 2022] GET /identity/v3/users/c38f4af161e8444aa5d864964687820b => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:44:04.202858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d723d-f96a-4d2e-9ffa-a8d5eabdf6b9 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:04.260430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:04.299535 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d723d-f96a-4d2e-9ffa-a8d5eabdf6b9 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:04.332432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a684b72-3cc2-436c-848f-df3dca0ae36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:04.333068 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a684b72-3cc2-436c-848f-df3dca0ae36a None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:04.333341 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a684b72-3cc2-436c-848f-df3dca0ae36a None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:04.333608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a684b72-3cc2-436c-848f-df3dca0ae36a None admin] PATH_INFO: `/v3/projects/aaf2ac3e7434480eba9f758a7845a138` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:04.334855 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a684b72-3cc2-436c-848f-df3dca0ae36a None admin] RBAC: Authorizing `identity:get_project(project_id=aaf2ac3e7434480eba9f758a7845a138)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:04.336275 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a684b72-3cc2-436c-848f-df3dca0ae36a None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:04.337918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 579/1152] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:44:04 2022] GET /identity/v3/projects/aaf2ac3e7434480eba9f758a7845a138 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:04.344512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf9ceb-63b4-4891-bdd4-cfa48c29bb65 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:04.399084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:04.442968 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf9ceb-63b4-4891-bdd4-cfa48c29bb65 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:04.476579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832cee4-123a-4c90-9b53-202c4bd06c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:04.477235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832cee4-123a-4c90-9b53-202c4bd06c99 None admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:04.477513 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832cee4-123a-4c90-9b53-202c4bd06c99 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:04.477785 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832cee4-123a-4c90-9b53-202c4bd06c99 None admin] PATH_INFO: `/v3/projects/aaf2ac3e7434480eba9f758a7845a138/users/c38f4af161e8444aa5d864964687820b/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:04.479708 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832cee4-123a-4c90-9b53-202c4bd06c99 None admin] RBAC: Authorizing `identity:create_grant(project_id=aaf2ac3e7434480eba9f758a7845a138, user_id=c38f4af161e8444aa5d864964687820b, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:04.481129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832cee4-123a-4c90-9b53-202c4bd06c99 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:04.577908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 574/1153] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:44:04 2022] PUT /identity/v3/projects/aaf2ac3e7434480eba9f758a7845a138/users/c38f4af161e8444aa5d864964687820b/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:44:06.617431 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465b1f5-0131-4bcb-8c51-c73e8973da4e None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:06.617959 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465b1f5-0131-4bcb-8c51-c73e8973da4e None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:06.617959 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465b1f5-0131-4bcb-8c51-c73e8973da4e None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:06.619342 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 580/1154] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:44:06.625028 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72af639-1dc1-4c8b-af72-4d0774276221 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:06.625433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72af639-1dc1-4c8b-af72-4d0774276221 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:06.625612 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72af639-1dc1-4c8b-af72-4d0774276221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:06.643844 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-a72af639-1dc1-4c8b-af72-4d0774276221 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:44:06.645121 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a72af639-1dc1-4c8b-af72-4d0774276221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:44:06.710109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 575/1155] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:44:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:44:06.733257 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465b1f5-0131-4bcb-8c51-c73e8973da4e None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:06.835234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465b1f5-0131-4bcb-8c51-c73e8973da4e None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:06.859996 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:06.871162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed87eac-87c2-46b1-a538-dabfbcab0b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:06.871162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed87eac-87c2-46b1-a538-dabfbcab0b3b None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:06.871162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed87eac-87c2-46b1-a538-dabfbcab0b3b None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:06.871162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed87eac-87c2-46b1-a538-dabfbcab0b3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:06.879483 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed87eac-87c2-46b1-a538-dabfbcab0b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:44:06.884364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-0ed87eac-87c2-46b1-a538-dabfbcab0b3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:44:06.884364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:44:06.884364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:44:06.884364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:44:06.884364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:44:06.884364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:44:06.884364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:44:06.884364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:44:06.884364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:44:06.884364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:44:06.884364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:44:06.884364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:44:06.884364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:44:06.884364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:44:06.884364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:44:06.884364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:44:06.885476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:44:06.885476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:44:06.885476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:44:06.885476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:44:06.885476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:44:06.885476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:44:06.885476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:44:06.885476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:44:06.885476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:44:06.885476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:44:06.885476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:44:06.885476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:44:06.885476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:44:06.885476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:44:06.885476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:44:06.885476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:44:06.886437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:44:06.886437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:44:06.886437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:44:06.886437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:44:06.886437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:44:06.886437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:44:06.886437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:44:06.886437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:44:06.886437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:44:06.886437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:44:06.886437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:44:06.886437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:44:06.886437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 581/1156] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:44:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:44:06.892262 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72af639-1dc1-4c8b-af72-4d0774276221 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:06.937316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:06.990766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72af639-1dc1-4c8b-af72-4d0774276221 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:07.025140 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a75276-c45c-44b9-850f-9d66b4b29b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:07.025850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a75276-c45c-44b9-850f-9d66b4b29b67 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:07.026129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a75276-c45c-44b9-850f-9d66b4b29b67 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:07.026399 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a75276-c45c-44b9-850f-9d66b4b29b67 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:07.027396 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a75276-c45c-44b9-850f-9d66b4b29b67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:44:07.027698 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a75276-c45c-44b9-850f-9d66b4b29b67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:07.030103 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a75276-c45c-44b9-850f-9d66b4b29b67 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:07.037857 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 576/1157] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:44:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:07.044931 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed87eac-87c2-46b1-a538-dabfbcab0b3b None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:07.142270 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed87eac-87c2-46b1-a538-dabfbcab0b3b None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:07.175362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937549d7-2ec5-4610-a57a-bcbd17b1fe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:07.176007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937549d7-2ec5-4610-a57a-bcbd17b1fe0c None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:07.176285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937549d7-2ec5-4610-a57a-bcbd17b1fe0c None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:07.176556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937549d7-2ec5-4610-a57a-bcbd17b1fe0c None admin] PATH_INFO: `/v3/users/c38f4af161e8444aa5d864964687820b` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:07.177708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937549d7-2ec5-4610-a57a-bcbd17b1fe0c None admin] RBAC: Authorizing `identity:get_user(user_id=c38f4af161e8444aa5d864964687820b)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:07.179133 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937549d7-2ec5-4610-a57a-bcbd17b1fe0c None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:07.180758 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 582/1158] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:44:07 2022] GET /identity/v3/users/c38f4af161e8444aa5d864964687820b => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:07.187364 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a75276-c45c-44b9-850f-9d66b4b29b67 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:07.285071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a75276-c45c-44b9-850f-9d66b4b29b67 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:07.291777 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:07.319694 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2c38e-bfb7-4113-ad52-2f45a0f86564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:07.320318 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2c38e-bfb7-4113-ad52-2f45a0f86564 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:07.320799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2c38e-bfb7-4113-ad52-2f45a0f86564 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:07.321296 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2c38e-bfb7-4113-ad52-2f45a0f86564 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:07.386727 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2c38e-bfb7-4113-ad52-2f45a0f86564 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:07.388395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2c38e-bfb7-4113-ad52-2f45a0f86564 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:07.482475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 577/1159] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:44:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:44:07.488307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937549d7-2ec5-4610-a57a-bcbd17b1fe0c None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:07.544909 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:07.588197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937549d7-2ec5-4610-a57a-bcbd17b1fe0c None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:07.620318 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24873474-7196-4ad5-b932-31e67d5bdc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:07.621053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24873474-7196-4ad5-b932-31e67d5bdc1a None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:07.621244 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24873474-7196-4ad5-b932-31e67d5bdc1a None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:07.621538 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24873474-7196-4ad5-b932-31e67d5bdc1a None admin] PATH_INFO: `/v3/projects/aaf2ac3e7434480eba9f758a7845a138` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:07.623680 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24873474-7196-4ad5-b932-31e67d5bdc1a None admin] RBAC: Authorizing `identity:get_project(project_id=aaf2ac3e7434480eba9f758a7845a138)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:07.625112 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24873474-7196-4ad5-b932-31e67d5bdc1a None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:07.626766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 583/1160] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:44:07 2022] GET /identity/v3/projects/aaf2ac3e7434480eba9f758a7845a138 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:07.632960 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2c38e-bfb7-4113-ad52-2f45a0f86564 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:07.642271 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:07.731025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2c38e-bfb7-4113-ad52-2f45a0f86564 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:07.764469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5ccfb-6ca4-4cc3-ac87-7f2384ae3133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:07.765004 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5ccfb-6ca4-4cc3-ac87-7f2384ae3133 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:07.765285 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5ccfb-6ca4-4cc3-ac87-7f2384ae3133 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:07.765558 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5ccfb-6ca4-4cc3-ac87-7f2384ae3133 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:07.766337 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5ccfb-6ca4-4cc3-ac87-7f2384ae3133 None admin] RBAC: Adding query filter params (role.id=8a5766c4aef44773834941d1bdbd1e98, scope.project.id=aaf2ac3e7434480eba9f758a7845a138, user.id=c38f4af161e8444aa5d864964687820b) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:44:07.766642 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5ccfb-6ca4-4cc3-ac87-7f2384ae3133 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:07.768127 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5ccfb-6ca4-4cc3-ac87-7f2384ae3133 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:07.773718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 578/1161] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:44:07 2022] GET /identity/v3/role_assignments?user.id=c38f4af161e8444aa5d864964687820b&scope.project.id=aaf2ac3e7434480eba9f758a7845a138&role.id=8a5766c4aef44773834941d1bdbd1e98 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:09.795676 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123f53a-fcd9-4cf2-b9f3-0a691d47db92 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:09.796198 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123f53a-fcd9-4cf2-b9f3-0a691d47db92 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:09.796295 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123f53a-fcd9-4cf2-b9f3-0a691d47db92 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:09.797659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 584/1162] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:44:09.802815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a041b4-f977-4652-b46b-92d75e20e991 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:09.803227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a041b4-f977-4652-b46b-92d75e20e991 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:09.803392 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a041b4-f977-4652-b46b-92d75e20e991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:09.822678 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-31a041b4-f977-4652-b46b-92d75e20e991 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:44:09.823884 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-31a041b4-f977-4652-b46b-92d75e20e991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:44:09.886511 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:09.892149 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 579/1163] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:44:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:44:09.914646 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123f53a-fcd9-4cf2-b9f3-0a691d47db92 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:10.013611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123f53a-fcd9-4cf2-b9f3-0a691d47db92 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:10.036235 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:10.047539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51af221-18b5-41fb-885c-a4d1e989fb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:10.050352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51af221-18b5-41fb-885c-a4d1e989fb2a None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:10.050352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51af221-18b5-41fb-885c-a4d1e989fb2a None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:10.050352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51af221-18b5-41fb-885c-a4d1e989fb2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:10.114671 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51af221-18b5-41fb-885c-a4d1e989fb2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:10.116148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51af221-18b5-41fb-885c-a4d1e989fb2a None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:10.211543 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 585/1164] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:44:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:44:10.218709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a041b4-f977-4652-b46b-92d75e20e991 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:10.317093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a041b4-f977-4652-b46b-92d75e20e991 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:10.351444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31de42-07a8-497d-8bcc-d02b2218f068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:10.352066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31de42-07a8-497d-8bcc-d02b2218f068 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:10.352345 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31de42-07a8-497d-8bcc-d02b2218f068 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:10.352614 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31de42-07a8-497d-8bcc-d02b2218f068 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:10.359988 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31de42-07a8-497d-8bcc-d02b2218f068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:10.361414 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31de42-07a8-497d-8bcc-d02b2218f068 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:10.373556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-ea31de42-07a8-497d-8bcc-d02b2218f068 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 03:44:10.373556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:44:10.373556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 28 03:44:10.373556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 28 03:44:10.373556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:44:10.373556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:44:10.373556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:44:10.373556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:44:10.373556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 28 03:44:10.373556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:44:10.373556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:44:10.373556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:44:10.373556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:44:10.373556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:44:10.373556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:44:10.373556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:44:10.373556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:44:10.374878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:44:10.374878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:44:10.374878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:44:10.374878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:44:10.374878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:44:10.374878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:44:10.374878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:44:10.374878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:44:10.374878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:44:10.374878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:44:10.374878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:44:10.374878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:44:10.374878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:44:10.374878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:44:10.374878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:44:10.374878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:44:10.376117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:44:10.376117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:44:10.376117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:44:10.376117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:44:10.376117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:44:10.376117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:44:10.376117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:44:10.376117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:44:10.376117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:44:10.376117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:44:10.376117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 28 03:44:10.376117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:44:10.376117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 03:44:10.376117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:44:10.376117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 580/1165] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 28 03:44:10 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:44:10.380673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51af221-18b5-41fb-885c-a4d1e989fb2a None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:10.404902 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:10.475714 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51af221-18b5-41fb-885c-a4d1e989fb2a None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:10.508897 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ce05a-dd51-4068-ad06-562e9240845c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:10.509515 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ce05a-dd51-4068-ad06-562e9240845c None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:10.509792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ce05a-dd51-4068-ad06-562e9240845c None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:10.510061 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ce05a-dd51-4068-ad06-562e9240845c None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:10.510748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ce05a-dd51-4068-ad06-562e9240845c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:44:10.511062 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ce05a-dd51-4068-ad06-562e9240845c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:10.512644 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ce05a-dd51-4068-ad06-562e9240845c None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:10.519529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 586/1166] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 28 03:44:10 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:12.501686 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57698b13-704d-496d-9e2f-075d3878cff8 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:12.502246 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57698b13-704d-496d-9e2f-075d3878cff8 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:12.502246 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57698b13-704d-496d-9e2f-075d3878cff8 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:12.503640 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 581/1167] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:44:12.508882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae4dd1-3400-48cf-8e2f-d5b03ce43b54 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:12.509385 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae4dd1-3400-48cf-8e2f-d5b03ce43b54 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:12.509480 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae4dd1-3400-48cf-8e2f-d5b03ce43b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:12.528617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-f1ae4dd1-3400-48cf-8e2f-d5b03ce43b54 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:44:12.529982 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f1ae4dd1-3400-48cf-8e2f-d5b03ce43b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:44:12.595751 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 587/1168] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:44:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:44:12.618326 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57698b13-704d-496d-9e2f-075d3878cff8 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:12.678811 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:12.720106 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57698b13-704d-496d-9e2f-075d3878cff8 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:12.752642 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8429eba-20a9-4060-81f8-0ee453dea74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:12.753195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8429eba-20a9-4060-81f8-0ee453dea74b None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:12.753475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8429eba-20a9-4060-81f8-0ee453dea74b None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:12.753752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8429eba-20a9-4060-81f8-0ee453dea74b None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:12.754467 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8429eba-20a9-4060-81f8-0ee453dea74b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:12.755861 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8429eba-20a9-4060-81f8-0ee453dea74b None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:12.841734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 582/1169] 10.222.0.64 () {60 vars in 1138 bytes} [Thu Jul 28 03:44:12 2022] POST /identity/v3/domains => generated 267 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:44:14.917242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd31e0-0598-408c-b0a1-df2758d72700 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:14.917784 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd31e0-0598-408c-b0a1-df2758d72700 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:14.917784 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd31e0-0598-408c-b0a1-df2758d72700 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:14.919277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 588/1170] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:44:14.924361 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ffd53-af40-4a11-ab0b-a1aa45860130 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:14.924772 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ffd53-af40-4a11-ab0b-a1aa45860130 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:14.924917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ffd53-af40-4a11-ab0b-a1aa45860130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:14.942677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-417ffd53-af40-4a11-ab0b-a1aa45860130 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:44:14.943889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-417ffd53-af40-4a11-ab0b-a1aa45860130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:44:15.008666 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 583/1171] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:44:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:44:15.033054 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd31e0-0598-408c-b0a1-df2758d72700 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:15.051856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:15.135923 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd31e0-0598-408c-b0a1-df2758d72700 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:15.170030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10892b2d-6ef6-441f-80ff-952d7bc2e07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:15.170726 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10892b2d-6ef6-441f-80ff-952d7bc2e07d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:15.170999 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10892b2d-6ef6-441f-80ff-952d7bc2e07d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:15.171268 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10892b2d-6ef6-441f-80ff-952d7bc2e07d None admin] PATH_INFO: `/v3/domains/8fc25ad9ea744343935aaa111cf738f8` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:15.181205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10892b2d-6ef6-441f-80ff-952d7bc2e07d None admin] RBAC: Authorizing `identity:get_domain(domain_id=8fc25ad9ea744343935aaa111cf738f8)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:15.182637 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10892b2d-6ef6-441f-80ff-952d7bc2e07d None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:15.184945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 589/1172] 10.222.0.64 () {56 vars in 1183 bytes} [Thu Jul 28 03:44:15 2022] GET /identity/v3/domains/8fc25ad9ea744343935aaa111cf738f8 => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:15.190842 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ffd53-af40-4a11-ab0b-a1aa45860130 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:15.238319 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:15.288574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ffd53-af40-4a11-ab0b-a1aa45860130 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:15.320840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784aee0-7b28-4b43-93da-74d9ce863551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:15.321386 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784aee0-7b28-4b43-93da-74d9ce863551 None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:15.321664 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784aee0-7b28-4b43-93da-74d9ce863551 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:15.321989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784aee0-7b28-4b43-93da-74d9ce863551 None admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:15.322669 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784aee0-7b28-4b43-93da-74d9ce863551 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:15.324122 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784aee0-7b28-4b43-93da-74d9ce863551 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:15.450410 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 584/1173] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 28 03:44:15 2022] POST /identity/v3/projects => generated 361 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:44:17.483653 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b14f6-83c5-485d-a7d3-31b9017fc86c None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:17.484210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b14f6-83c5-485d-a7d3-31b9017fc86c None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:17.484210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b14f6-83c5-485d-a7d3-31b9017fc86c None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:17.485544 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 590/1174] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:44:17.490605 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa895a3f-ac19-4daf-8088-71670f986ea0 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:17.491035 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa895a3f-ac19-4daf-8088-71670f986ea0 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:17.491142 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa895a3f-ac19-4daf-8088-71670f986ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:17.508736 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-aa895a3f-ac19-4daf-8088-71670f986ea0 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:44:17.509911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-aa895a3f-ac19-4daf-8088-71670f986ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:44:17.575096 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 585/1175] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:44:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:44:17.599603 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b14f6-83c5-485d-a7d3-31b9017fc86c None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:17.678138 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:17.699128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b14f6-83c5-485d-a7d3-31b9017fc86c None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:17.733260 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271d19e-86fe-4a7d-b117-7826c0dc47d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:17.733975 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271d19e-86fe-4a7d-b117-7826c0dc47d0 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:17.734204 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271d19e-86fe-4a7d-b117-7826c0dc47d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:17.734473 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271d19e-86fe-4a7d-b117-7826c0dc47d0 None admin] PATH_INFO: `/v3/domains/8fc25ad9ea744343935aaa111cf738f8` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:17.735642 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271d19e-86fe-4a7d-b117-7826c0dc47d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8fc25ad9ea744343935aaa111cf738f8)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:17.737059 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271d19e-86fe-4a7d-b117-7826c0dc47d0 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:17.738647 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 591/1176] 10.222.0.64 () {56 vars in 1183 bytes} [Thu Jul 28 03:44:17 2022] GET /identity/v3/domains/8fc25ad9ea744343935aaa111cf738f8 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:44:17.744813 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa895a3f-ac19-4daf-8088-71670f986ea0 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:17.774667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:17.842480 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa895a3f-ac19-4daf-8088-71670f986ea0 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:17.877616 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a5b2b-66fd-494b-bc92-293cc58fe99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:17.878225 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a5b2b-66fd-494b-bc92-293cc58fe99e None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:17.878507 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a5b2b-66fd-494b-bc92-293cc58fe99e None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:17.878782 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a5b2b-66fd-494b-bc92-293cc58fe99e None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:17.879626 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a5b2b-66fd-494b-bc92-293cc58fe99e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:17.881058 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a5b2b-66fd-494b-bc92-293cc58fe99e None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:17.983731 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 586/1177] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 28 03:44:17 2022] POST /identity/v3/users => generated 311 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:44:20.032363 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5d054-c5b7-4855-9383-92c89b5d5b4c None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:20.032868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5d054-c5b7-4855-9383-92c89b5d5b4c None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:20.032868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c5d054-c5b7-4855-9383-92c89b5d5b4c None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:20.034203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 592/1178] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:44:20.039434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de6d92-ae08-49b3-8861-7d9844fa5061 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:20.039831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de6d92-ae08-49b3-8861-7d9844fa5061 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:20.039987 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de6d92-ae08-49b3-8861-7d9844fa5061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:20.057711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-e4de6d92-ae08-49b3-8861-7d9844fa5061 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:44:20.058956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e4de6d92-ae08-49b3-8861-7d9844fa5061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:44:20.125069 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 587/1179] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:44:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:44:20.148689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5d054-c5b7-4855-9383-92c89b5d5b4c None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:20.253713 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c5d054-c5b7-4855-9383-92c89b5d5b4c None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:20.294260 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8bc83-9e57-4a03-a2b0-c61a459cc53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:20.295232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8bc83-9e57-4a03-a2b0-c61a459cc53d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:20.295758 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8bc83-9e57-4a03-a2b0-c61a459cc53d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:20.296242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8bc83-9e57-4a03-a2b0-c61a459cc53d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:20.308183 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8bc83-9e57-4a03-a2b0-c61a459cc53d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:44:20.314040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-bea8bc83-9e57-4a03-a2b0-c61a459cc53d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:44:20.314040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:44:20.314040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:44:20.314040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:44:20.314040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:44:20.314040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:44:20.314040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:44:20.314040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:44:20.314040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:44:20.314040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:44:20.314040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:44:20.314040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:44:20.314040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:44:20.314040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:44:20.314040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:44:20.314040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:44:20.315185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:44:20.315185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:44:20.315185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:44:20.315185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:44:20.315185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:44:20.315185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:44:20.315185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:44:20.315185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:44:20.315185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:44:20.315185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:44:20.315185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:44:20.315185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:44:20.315185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:44:20.315185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:44:20.315185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:44:20.315185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:44:20.316343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:44:20.316343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:44:20.316343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:44:20.316343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:44:20.316343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:44:20.316343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:44:20.316343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:44:20.316343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:44:20.316343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:44:20.316343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:44:20.316343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:44:20.316343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:44:20.316343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 593/1180] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:44:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:44:20.321468 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de6d92-ae08-49b3-8861-7d9844fa5061 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:20.341066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:20.421984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de6d92-ae08-49b3-8861-7d9844fa5061 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:20.457188 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9684c18-99df-4f47-b131-81b8efc15c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:20.457802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9684c18-99df-4f47-b131-81b8efc15c92 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:20.458081 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9684c18-99df-4f47-b131-81b8efc15c92 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:20.458354 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9684c18-99df-4f47-b131-81b8efc15c92 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:20.459063 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9684c18-99df-4f47-b131-81b8efc15c92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:44:20.459388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9684c18-99df-4f47-b131-81b8efc15c92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:20.460816 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9684c18-99df-4f47-b131-81b8efc15c92 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:20.469217 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 588/1181] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:44:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:20.475534 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8bc83-9e57-4a03-a2b0-c61a459cc53d None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:20.484901 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:20.573551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8bc83-9e57-4a03-a2b0-c61a459cc53d None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:20.605920 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1601042-db5f-4b8b-98a5-ea3611e3208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:20.606551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1601042-db5f-4b8b-98a5-ea3611e3208d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:20.606827 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1601042-db5f-4b8b-98a5-ea3611e3208d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:20.607652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1601042-db5f-4b8b-98a5-ea3611e3208d None admin] PATH_INFO: `/v3/users/a497eb10da7b4262b609e37690641dd3` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:20.620244 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1601042-db5f-4b8b-98a5-ea3611e3208d None admin] RBAC: Authorizing `identity:get_user(user_id=a497eb10da7b4262b609e37690641dd3)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:20.621731 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1601042-db5f-4b8b-98a5-ea3611e3208d None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:20.624434 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 594/1182] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:44:20 2022] GET /identity/v3/users/a497eb10da7b4262b609e37690641dd3 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:20.630207 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9684c18-99df-4f47-b131-81b8efc15c92 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:20.709049 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:20.727350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9684c18-99df-4f47-b131-81b8efc15c92 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:20.761178 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799dc6e-0270-47c2-946e-e733012dbd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:20.761791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799dc6e-0270-47c2-946e-e733012dbd7f None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:20.762075 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799dc6e-0270-47c2-946e-e733012dbd7f None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:20.762350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799dc6e-0270-47c2-946e-e733012dbd7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:20.890288 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799dc6e-0270-47c2-946e-e733012dbd7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:20.891597 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799dc6e-0270-47c2-946e-e733012dbd7f None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:20.969029 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:20.988586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 589/1183] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:44:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:44:20.994546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1601042-db5f-4b8b-98a5-ea3611e3208d None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:21.055611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:21.091912 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1601042-db5f-4b8b-98a5-ea3611e3208d None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:21.125392 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcaf5d9-e8cf-409c-bac8-bb630455f2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:21.126030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaf5d9-e8cf-409c-bac8-bb630455f2ac None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:21.126311 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaf5d9-e8cf-409c-bac8-bb630455f2ac None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:21.126587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaf5d9-e8cf-409c-bac8-bb630455f2ac None admin] PATH_INFO: `/v3/projects/a9322c0073a84500a7bd2008c177338d` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:21.127759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcaf5d9-e8cf-409c-bac8-bb630455f2ac None admin] RBAC: Authorizing `identity:get_project(project_id=a9322c0073a84500a7bd2008c177338d)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:21.129189 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcaf5d9-e8cf-409c-bac8-bb630455f2ac None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:21.130838 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 595/1184] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:44:20 2022] GET /identity/v3/projects/a9322c0073a84500a7bd2008c177338d => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:21.137164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799dc6e-0270-47c2-946e-e733012dbd7f None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:21.235273 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799dc6e-0270-47c2-946e-e733012dbd7f None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:21.269205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7409d-5723-4406-bc01-2bff3ca5c61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:21.269812 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7409d-5723-4406-bc01-2bff3ca5c61e None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:21.270091 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7409d-5723-4406-bc01-2bff3ca5c61e None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:21.270362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7409d-5723-4406-bc01-2bff3ca5c61e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:21.271141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7409d-5723-4406-bc01-2bff3ca5c61e None admin] RBAC: Adding query filter params (role.id=8a5766c4aef44773834941d1bdbd1e98, scope.project.id=a9322c0073a84500a7bd2008c177338d, user.id=a497eb10da7b4262b609e37690641dd3) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:44:21.271648 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7409d-5723-4406-bc01-2bff3ca5c61e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:21.273082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7409d-5723-4406-bc01-2bff3ca5c61e None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:21.278521 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 590/1185] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:44:21 2022] GET /identity/v3/role_assignments?user.id=a497eb10da7b4262b609e37690641dd3&scope.project.id=a9322c0073a84500a7bd2008c177338d&role.id=8a5766c4aef44773834941d1bdbd1e98 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:23.279418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ceef9-f7f0-4d6b-9f79-6444b7002d0d None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:23.279996 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ceef9-f7f0-4d6b-9f79-6444b7002d0d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:23.279996 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ceef9-f7f0-4d6b-9f79-6444b7002d0d None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:23.281337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 596/1186] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:44:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:44:23.287583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8842c-4b1c-4410-9464-5123d9c5c306 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:23.288022 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8842c-4b1c-4410-9464-5123d9c5c306 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:23.288142 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8842c-4b1c-4410-9464-5123d9c5c306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:23.305744 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-7be8842c-4b1c-4410-9464-5123d9c5c306 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:44:23.306923 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-7be8842c-4b1c-4410-9464-5123d9c5c306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:44:23.347574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:23.373614 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 591/1187] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:44:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:44:23.396481 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ceef9-f7f0-4d6b-9f79-6444b7002d0d None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:23.492948 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ceef9-f7f0-4d6b-9f79-6444b7002d0d None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:23.522225 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:23.527135 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b396f6-4b6d-4a20-9920-178443e4bb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:23.527790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b396f6-4b6d-4a20-9920-178443e4bb3e None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:23.528063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b396f6-4b6d-4a20-9920-178443e4bb3e None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:23.531530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b396f6-4b6d-4a20-9920-178443e4bb3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:23.538937 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b396f6-4b6d-4a20-9920-178443e4bb3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:44:23.544215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-b5b396f6-4b6d-4a20-9920-178443e4bb3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:44:23.544215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:44:23.544215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:44:23.544215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:44:23.544215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:44:23.544215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:44:23.544215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:44:23.544215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:44:23.544215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:44:23.544215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:44:23.544215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:44:23.544215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:44:23.544215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:44:23.544215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:44:23.544215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:44:23.544215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:44:23.545482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:44:23.545482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:44:23.545482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:44:23.545482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:44:23.545482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:44:23.545482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:44:23.545482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:44:23.545482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:44:23.545482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:44:23.545482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:44:23.545482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:44:23.545482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:44:23.545482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:44:23.545482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:44:23.545482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:44:23.545482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:44:23.546504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:44:23.546504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:44:23.546504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:44:23.546504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:44:23.546504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:44:23.546504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:44:23.546504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:44:23.546504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:44:23.546504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:44:23.546504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:44:23.546504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:44:23.546504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:44:23.547497 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 597/1188] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:44:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:44:23.551426 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8842c-4b1c-4410-9464-5123d9c5c306 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:23.647412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8842c-4b1c-4410-9464-5123d9c5c306 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:23.680321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3277211-d8a5-4bed-88fa-44cb7c7a1ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:23.680946 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3277211-d8a5-4bed-88fa-44cb7c7a1ddb None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:23.681236 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3277211-d8a5-4bed-88fa-44cb7c7a1ddb None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:23.681507 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3277211-d8a5-4bed-88fa-44cb7c7a1ddb None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:23.682222 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3277211-d8a5-4bed-88fa-44cb7c7a1ddb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:44:23.682524 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3277211-d8a5-4bed-88fa-44cb7c7a1ddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:23.683926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3277211-d8a5-4bed-88fa-44cb7c7a1ddb None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:23.692195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 592/1189] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:44:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:23.698058 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b396f6-4b6d-4a20-9920-178443e4bb3e None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:23.798673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b396f6-4b6d-4a20-9920-178443e4bb3e None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:23.831005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4e64e-effc-46f0-b93c-ef741556df92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:23.831671 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4e64e-effc-46f0-b93c-ef741556df92 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:23.831971 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4e64e-effc-46f0-b93c-ef741556df92 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:23.832239 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4e64e-effc-46f0-b93c-ef741556df92 None admin] PATH_INFO: `/v3/users/a497eb10da7b4262b609e37690641dd3` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:23.833453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4e64e-effc-46f0-b93c-ef741556df92 None admin] RBAC: Authorizing `identity:get_user(user_id=a497eb10da7b4262b609e37690641dd3)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:23.834892 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4e64e-effc-46f0-b93c-ef741556df92 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:23.836520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 598/1190] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:44:23 2022] GET /identity/v3/users/a497eb10da7b4262b609e37690641dd3 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:23.842882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3277211-d8a5-4bed-88fa-44cb7c7a1ddb None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:23.877166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:23.942336 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3277211-d8a5-4bed-88fa-44cb7c7a1ddb None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:23.974986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33d344-487a-4ee8-9586-cba5a5016612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:23.975655 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33d344-487a-4ee8-9586-cba5a5016612 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:23.975938 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33d344-487a-4ee8-9586-cba5a5016612 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:23.976214 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33d344-487a-4ee8-9586-cba5a5016612 None admin] PATH_INFO: `/v3/projects/a9322c0073a84500a7bd2008c177338d` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:23.977355 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33d344-487a-4ee8-9586-cba5a5016612 None admin] RBAC: Authorizing `identity:get_project(project_id=a9322c0073a84500a7bd2008c177338d)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:23.978777 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33d344-487a-4ee8-9586-cba5a5016612 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:23.980467 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 593/1191] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:44:23 2022] GET /identity/v3/projects/a9322c0073a84500a7bd2008c177338d => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:23.987305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4e64e-effc-46f0-b93c-ef741556df92 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:24.046759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:24.088113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4e64e-effc-46f0-b93c-ef741556df92 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:24.121969 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f2108-37a0-4a68-be5b-93a00c43b674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:24.122833 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f2108-37a0-4a68-be5b-93a00c43b674 None admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:24.123249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f2108-37a0-4a68-be5b-93a00c43b674 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:24.123561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f2108-37a0-4a68-be5b-93a00c43b674 None admin] PATH_INFO: `/v3/projects/a9322c0073a84500a7bd2008c177338d/users/a497eb10da7b4262b609e37690641dd3/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:24.125495 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f2108-37a0-4a68-be5b-93a00c43b674 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9322c0073a84500a7bd2008c177338d, user_id=a497eb10da7b4262b609e37690641dd3, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:24.126933 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f2108-37a0-4a68-be5b-93a00c43b674 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:24.202655 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 599/1192] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:44:23 2022] PUT /identity/v3/projects/a9322c0073a84500a7bd2008c177338d/users/a497eb10da7b4262b609e37690641dd3/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:44:26.236168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c2775-4c3f-4f57-9daa-88f631bc22ab None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:26.236700 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c2775-4c3f-4f57-9daa-88f631bc22ab None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:26.236700 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c2775-4c3f-4f57-9daa-88f631bc22ab None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:26.238066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 594/1193] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:44:26.243390 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12261b50-1ced-4be5-a251-0a0810674cb6 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:26.243780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12261b50-1ced-4be5-a251-0a0810674cb6 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:26.243943 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12261b50-1ced-4be5-a251-0a0810674cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:26.262127 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-12261b50-1ced-4be5-a251-0a0810674cb6 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:44:26.263348 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-12261b50-1ced-4be5-a251-0a0810674cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:44:26.328616 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 600/1194] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:44:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:44:26.351974 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c2775-4c3f-4f57-9daa-88f631bc22ab None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:26.452516 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c2775-4c3f-4f57-9daa-88f631bc22ab None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:26.454802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:26.485211 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db7bc1-4bf3-42f2-8603-2b207df2955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:26.485839 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db7bc1-4bf3-42f2-8603-2b207df2955b None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:26.486123 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db7bc1-4bf3-42f2-8603-2b207df2955b None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:26.486438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db7bc1-4bf3-42f2-8603-2b207df2955b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:26.496381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db7bc1-4bf3-42f2-8603-2b207df2955b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:44:26.501835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-a5db7bc1-4bf3-42f2-8603-2b207df2955b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:44:26.501835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:44:26.501835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:44:26.501835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:44:26.501835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:44:26.501835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:44:26.501835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:44:26.501835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:44:26.501835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:44:26.501835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:44:26.501835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:44:26.501835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:44:26.501835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:44:26.501835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:44:26.501835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:44:26.501835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:44:26.502942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:44:26.502942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:44:26.502942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:44:26.502942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:44:26.502942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:44:26.502942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:44:26.502942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:44:26.502942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:44:26.502942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:44:26.502942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:44:26.502942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:44:26.502942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:44:26.502942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:44:26.502942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:44:26.502942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:44:26.502942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:44:26.503913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:44:26.503913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:44:26.503913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:44:26.503913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:44:26.503913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:44:26.503913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:44:26.503913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:44:26.503913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:44:26.503913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:44:26.503913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:44:26.503913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:44:26.503913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:44:26.503913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 595/1195] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:44:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:44:26.509100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12261b50-1ced-4be5-a251-0a0810674cb6 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:26.557456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:26.606180 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12261b50-1ced-4be5-a251-0a0810674cb6 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:26.641039 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9bf42-f8fb-46fd-9b21-d70a8b70ace8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:26.641663 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9bf42-f8fb-46fd-9b21-d70a8b70ace8 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:26.641940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9bf42-f8fb-46fd-9b21-d70a8b70ace8 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:26.642211 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9bf42-f8fb-46fd-9b21-d70a8b70ace8 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:26.642942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9bf42-f8fb-46fd-9b21-d70a8b70ace8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:44:26.643250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9bf42-f8fb-46fd-9b21-d70a8b70ace8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:26.644649 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9bf42-f8fb-46fd-9b21-d70a8b70ace8 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:26.652868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 601/1196] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:44:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:26.658964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db7bc1-4bf3-42f2-8603-2b207df2955b None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:26.764349 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db7bc1-4bf3-42f2-8603-2b207df2955b None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:26.798756 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e099a9b-6ce2-4e82-993d-f9836aaf511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:26.799426 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e099a9b-6ce2-4e82-993d-f9836aaf511b None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:26.799712 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e099a9b-6ce2-4e82-993d-f9836aaf511b None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:26.799988 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e099a9b-6ce2-4e82-993d-f9836aaf511b None admin] PATH_INFO: `/v3/users/a497eb10da7b4262b609e37690641dd3` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:26.801144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e099a9b-6ce2-4e82-993d-f9836aaf511b None admin] RBAC: Authorizing `identity:get_user(user_id=a497eb10da7b4262b609e37690641dd3)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:26.802567 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e099a9b-6ce2-4e82-993d-f9836aaf511b None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:26.804212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 596/1197] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 28 03:44:26 2022] GET /identity/v3/users/a497eb10da7b4262b609e37690641dd3 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:26.810434 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9bf42-f8fb-46fd-9b21-d70a8b70ace8 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:26.910266 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9bf42-f8fb-46fd-9b21-d70a8b70ace8 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:26.922847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:26.943224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28ec76-c96a-424c-9694-e2bed2eaf232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:26.943861 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28ec76-c96a-424c-9694-e2bed2eaf232 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:26.944141 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28ec76-c96a-424c-9694-e2bed2eaf232 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:26.944515 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28ec76-c96a-424c-9694-e2bed2eaf232 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:27.011643 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28ec76-c96a-424c-9694-e2bed2eaf232 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:27.013220 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28ec76-c96a-424c-9694-e2bed2eaf232 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:27.113959 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 602/1198] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:44:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:44:27.119928 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e099a9b-6ce2-4e82-993d-f9836aaf511b None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:27.151890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:27.218635 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e099a9b-6ce2-4e82-993d-f9836aaf511b None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:27.251030 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93599cc1-666c-4a05-a4d6-5a0be7a4208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:27.251705 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93599cc1-666c-4a05-a4d6-5a0be7a4208d None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:27.251979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93599cc1-666c-4a05-a4d6-5a0be7a4208d None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:27.252251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93599cc1-666c-4a05-a4d6-5a0be7a4208d None admin] PATH_INFO: `/v3/projects/a9322c0073a84500a7bd2008c177338d` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:27.253396 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93599cc1-666c-4a05-a4d6-5a0be7a4208d None admin] RBAC: Authorizing `identity:get_project(project_id=a9322c0073a84500a7bd2008c177338d)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:27.254828 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93599cc1-666c-4a05-a4d6-5a0be7a4208d None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:27.256556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 597/1199] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 28 03:44:27 2022] GET /identity/v3/projects/a9322c0073a84500a7bd2008c177338d => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:27.264044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28ec76-c96a-424c-9694-e2bed2eaf232 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:44:27.277958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:27.361746 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28ec76-c96a-424c-9694-e2bed2eaf232 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:44:27.395786 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc5aba-dc20-48cb-b8f7-1509c0c1ab94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:44:27.396331 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc5aba-dc20-48cb-b8f7-1509c0c1ab94 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:44:27.396608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc5aba-dc20-48cb-b8f7-1509c0c1ab94 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:44:27.396877 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc5aba-dc20-48cb-b8f7-1509c0c1ab94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:44:27.397648 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc5aba-dc20-48cb-b8f7-1509c0c1ab94 None admin] RBAC: Adding query filter params (role.id=8a5766c4aef44773834941d1bdbd1e98, scope.project.id=a9322c0073a84500a7bd2008c177338d, user.id=a497eb10da7b4262b609e37690641dd3) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:44:27.397951 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc5aba-dc20-48cb-b8f7-1509c0c1ab94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:44:27.399387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc5aba-dc20-48cb-b8f7-1509c0c1ab94 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:44:27.405635 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 603/1200] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:44:27 2022] GET /identity/v3/role_assignments?user.id=a497eb10da7b4262b609e37690641dd3&scope.project.id=a9322c0073a84500a7bd2008c177338d&role.id=8a5766c4aef44773834941d1bdbd1e98 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:44:37.246827 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=50 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:37.402600 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=62 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:44.936675 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e99df4-e264-4bcc-8817-35ca9e8cfe93 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:44.937280 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e99df4-e264-4bcc-8817-35ca9e8cfe93 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:44.937280 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e99df4-e264-4bcc-8817-35ca9e8cfe93 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:44.938601 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 598/1201] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:45:44.943747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aa427-db07-44e3-88da-e8f56d2c6995 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:44.944141 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aa427-db07-44e3-88da-e8f56d2c6995 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:44.944289 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3aa427-db07-44e3-88da-e8f56d2c6995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:44.963188 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-cd3aa427-db07-44e3-88da-e8f56d2c6995 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:45:44.964398 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-cd3aa427-db07-44e3-88da-e8f56d2c6995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:45:45.031210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 604/1202] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:45:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:45:45.056128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e99df4-e264-4bcc-8817-35ca9e8cfe93 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:45.158666 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e99df4-e264-4bcc-8817-35ca9e8cfe93 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:45.196130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0810a-822f-4c65-90c7-ef0f88437fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:45.196778 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0810a-822f-4c65-90c7-ef0f88437fce None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:45.197055 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0810a-822f-4c65-90c7-ef0f88437fce None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:45.197327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0810a-822f-4c65-90c7-ef0f88437fce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:45.207471 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0810a-822f-4c65-90c7-ef0f88437fce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:45.208894 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0810a-822f-4c65-90c7-ef0f88437fce None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:45.223523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-8ac0810a-822f-4c65-90c7-ef0f88437fce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:45:45.223523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:45:45.223523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:45:45.223523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:45:45.223523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:45:45.223523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:45:45.223523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:45:45.223523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:45:45.223523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:45:45.223523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:45:45.223523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:45:45.223523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:45:45.223523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:45:45.223523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:45:45.223523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:45:45.224672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:45:45.224672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:45:45.224672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:45:45.224672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:45:45.224672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:45:45.224672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:45:45.224672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:45:45.224672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:45:45.224672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:45:45.224672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:45:45.224672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:45:45.224672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:45:45.224672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:45:45.224672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:45:45.224672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:45:45.224672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:45:45.224672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:45:45.225637 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:45:45.225637 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:45:45.225637 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:45:45.225637 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:45:45.225637 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 599/1203] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:45:45.231678 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3aa427-db07-44e3-88da-e8f56d2c6995 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:45.331238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3aa427-db07-44e3-88da-e8f56d2c6995 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:45.358998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:45.364835 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced39b05-a79f-400c-bfbc-663ec01436f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:45.365468 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced39b05-a79f-400c-bfbc-663ec01436f6 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:45.365746 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced39b05-a79f-400c-bfbc-663ec01436f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:45.366017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced39b05-a79f-400c-bfbc-663ec01436f6 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:45.366711 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced39b05-a79f-400c-bfbc-663ec01436f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:45:45.367652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced39b05-a79f-400c-bfbc-663ec01436f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:45.369029 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced39b05-a79f-400c-bfbc-663ec01436f6 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:45.380167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 605/1204] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:45:45.386719 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0810a-822f-4c65-90c7-ef0f88437fce None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:45.439144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:45.485779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0810a-822f-4c65-90c7-ef0f88437fce None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:45.518886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38011492-3706-429d-8c30-1996f0c22def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:45.519530 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38011492-3706-429d-8c30-1996f0c22def None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:45.519813 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38011492-3706-429d-8c30-1996f0c22def None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:45.520095 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38011492-3706-429d-8c30-1996f0c22def None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:45.520778 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38011492-3706-429d-8c30-1996f0c22def None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:45.522202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38011492-3706-429d-8c30-1996f0c22def None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:45.672794 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 600/1205] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 28 03:45:45 2022] POST /identity/v3/users => generated 251 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:45:47.698662 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32287483-95ae-483b-b456-62569e4149ac None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:47.699237 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32287483-95ae-483b-b456-62569e4149ac None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:47.699237 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32287483-95ae-483b-b456-62569e4149ac None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:47.700621 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 606/1206] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:45:47.705805 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0660ce-a51b-4f2d-bd7d-fc920c72d7ba None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:47.706399 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0660ce-a51b-4f2d-bd7d-fc920c72d7ba None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:47.706399 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0660ce-a51b-4f2d-bd7d-fc920c72d7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:47.725009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-cd0660ce-a51b-4f2d-bd7d-fc920c72d7ba None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:45:47.726223 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-cd0660ce-a51b-4f2d-bd7d-fc920c72d7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:45:47.799341 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 601/1207] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:45:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:45:47.823837 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32287483-95ae-483b-b456-62569e4149ac None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:47.930546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32287483-95ae-483b-b456-62569e4149ac None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:47.964954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebb27e-c083-4c4a-a8c3-6fbaec1aa645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:47.965591 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebb27e-c083-4c4a-a8c3-6fbaec1aa645 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:47.965870 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebb27e-c083-4c4a-a8c3-6fbaec1aa645 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:47.966142 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebb27e-c083-4c4a-a8c3-6fbaec1aa645 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:47.976730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebb27e-c083-4c4a-a8c3-6fbaec1aa645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:45:47.981547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-44ebb27e-c083-4c4a-a8c3-6fbaec1aa645 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:45:47.981547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:45:47.981547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:45:47.981547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:45:47.981547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:45:47.981547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:45:47.981547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:45:47.981547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:45:47.981547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:45:47.981547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:45:47.981547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:45:47.981547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:45:47.981547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:45:47.981547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:45:47.981547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:45:47.981547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:45:47.982659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:45:47.982659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:45:47.982659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:45:47.982659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:45:47.982659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:45:47.982659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:45:47.982659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:45:47.982659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:45:47.982659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:45:47.982659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:45:47.982659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:45:47.982659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:45:47.982659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:45:47.982659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:45:47.982659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:45:47.982659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:45:47.983556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:45:47.983556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:45:47.983556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:45:47.983556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:45:47.983556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:45:47.983556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:45:47.983556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:45:47.983556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:45:47.983556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:45:47.983556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:45:47.983556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:45:47.983556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:45:47.983556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 607/1208] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:45:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:45:47.988848 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0660ce-a51b-4f2d-bd7d-fc920c72d7ba None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:48.029432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:48.092142 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0660ce-a51b-4f2d-bd7d-fc920c72d7ba None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:48.125225 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07f511-1cb5-4e5c-bb55-fcbc2936948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:48.125832 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07f511-1cb5-4e5c-bb55-fcbc2936948a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:48.126112 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07f511-1cb5-4e5c-bb55-fcbc2936948a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:48.126386 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07f511-1cb5-4e5c-bb55-fcbc2936948a None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:48.127093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07f511-1cb5-4e5c-bb55-fcbc2936948a None admin] RBAC: Adding query filter params (name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:45:48.127424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07f511-1cb5-4e5c-bb55-fcbc2936948a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:48.128785 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07f511-1cb5-4e5c-bb55-fcbc2936948a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:48.136974 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 602/1209] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:45:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:45:48.142764 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebb27e-c083-4c4a-a8c3-6fbaec1aa645 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:48.193270 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:48.243106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebb27e-c083-4c4a-a8c3-6fbaec1aa645 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:48.276333 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265cff7-1393-47fc-85a2-e6acb0435626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:48.276964 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265cff7-1393-47fc-85a2-e6acb0435626 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:48.277245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265cff7-1393-47fc-85a2-e6acb0435626 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:48.277518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265cff7-1393-47fc-85a2-e6acb0435626 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:48.287571 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265cff7-1393-47fc-85a2-e6acb0435626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:48.289147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265cff7-1393-47fc-85a2-e6acb0435626 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:48.302913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-6265cff7-1393-47fc-85a2-e6acb0435626 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:45:48.302913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:45:48.302913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:45:48.302913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:45:48.302913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:45:48.302913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:45:48.302913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:45:48.302913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:45:48.302913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:45:48.302913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:45:48.302913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:45:48.302913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:45:48.302913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:45:48.302913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:45:48.302913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:45:48.303831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:45:48.303831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:45:48.303831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:45:48.303831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:45:48.303831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:45:48.303831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:45:48.303831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:45:48.303831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:45:48.303831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:45:48.303831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:45:48.303831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:45:48.303831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:45:48.303831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:45:48.303831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:45:48.303831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:45:48.303831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:45:48.303831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:45:48.304910 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:45:48.304910 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:45:48.304910 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:45:48.304910 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:45:48.304910 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 608/1210] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:45:48.310069 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07f511-1cb5-4e5c-bb55-fcbc2936948a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:48.408197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:48.411202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07f511-1cb5-4e5c-bb55-fcbc2936948a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:48.444482 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f3a41-6af3-4d34-ac24-49789ca92ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:48.445700 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f3a41-6af3-4d34-ac24-49789ca92ba0 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:48.446210 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f3a41-6af3-4d34-ac24-49789ca92ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:48.446504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f3a41-6af3-4d34-ac24-49789ca92ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:48.447189 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f3a41-6af3-4d34-ac24-49789ca92ba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:45:48.447517 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f3a41-6af3-4d34-ac24-49789ca92ba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:48.448873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f3a41-6af3-4d34-ac24-49789ca92ba0 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:48.459950 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 603/1211] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:45:48.466401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265cff7-1393-47fc-85a2-e6acb0435626 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:48.567115 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265cff7-1393-47fc-85a2-e6acb0435626 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:48.568824 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:48.599648 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039f6c7-6bd5-43c7-b5de-8c14c0a09b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:48.600285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039f6c7-6bd5-43c7-b5de-8c14c0a09b13 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:48.600564 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039f6c7-6bd5-43c7-b5de-8c14c0a09b13 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:48.600835 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039f6c7-6bd5-43c7-b5de-8c14c0a09b13 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:48.608516 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039f6c7-6bd5-43c7-b5de-8c14c0a09b13 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:48.609950 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039f6c7-6bd5-43c7-b5de-8c14c0a09b13 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:48.621381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-5039f6c7-6bd5-43c7-b5de-8c14c0a09b13 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 03:45:48.621381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:45:48.621381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:45:48.621381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:45:48.621381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:45:48.621381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:45:48.621381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:45:48.621381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:45:48.621381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:45:48.621381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:45:48.621381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:45:48.621381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:45:48.621381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:45:48.621381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:45:48.621381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:45:48.621381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:45:48.622507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:45:48.622507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:45:48.622507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:45:48.622507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:45:48.622507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:45:48.622507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:45:48.622507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:45:48.622507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:45:48.622507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:45:48.622507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:45:48.622507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:45:48.622507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:45:48.622507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:45:48.622507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:45:48.622507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:45:48.622507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:45:48.622507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:45:48.622507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:45:48.623720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:45:48.623720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:45:48.623720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:45:48.623720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:45:48.623720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:45:48.623720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:45:48.623720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:45:48.623720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:45:48.623720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 03:45:48.623720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:45:48.623720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 609/1212] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:45:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:45:48.628427 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f3a41-6af3-4d34-ac24-49789ca92ba0 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:48.729797 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f3a41-6af3-4d34-ac24-49789ca92ba0 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:48.763672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84ad89-974a-4bba-944c-da8379504c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:48.764281 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84ad89-974a-4bba-944c-da8379504c8f None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:48.764560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84ad89-974a-4bba-944c-da8379504c8f None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:48.764834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84ad89-974a-4bba-944c-da8379504c8f None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:48.765633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84ad89-974a-4bba-944c-da8379504c8f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:45:48.765918 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84ad89-974a-4bba-944c-da8379504c8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:48.767353 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84ad89-974a-4bba-944c-da8379504c8f None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:48.785931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 604/1213] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 28 03:45:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:45:48.791697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039f6c7-6bd5-43c7-b5de-8c14c0a09b13 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:48.891203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039f6c7-6bd5-43c7-b5de-8c14c0a09b13 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:48.925168 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989668a-ca4c-4362-aa98-4789d94c434d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:48.925782 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989668a-ca4c-4362-aa98-4789d94c434d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:48.926058 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989668a-ca4c-4362-aa98-4789d94c434d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:48.926329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989668a-ca4c-4362-aa98-4789d94c434d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:48.955568 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:48.995417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989668a-ca4c-4362-aa98-4789d94c434d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:48.996897 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989668a-ca4c-4362-aa98-4789d94c434d None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:49.096839 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 610/1214] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:45:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:45:49.103463 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84ad89-974a-4bba-944c-da8379504c8f None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:49.122632 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:49.201982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84ad89-974a-4bba-944c-da8379504c8f None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:49.235362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef278d57-7429-4e87-a13e-a6ca81a82f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:49.236052 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef278d57-7429-4e87-a13e-a6ca81a82f55 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:49.236338 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef278d57-7429-4e87-a13e-a6ca81a82f55 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:49.236617 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef278d57-7429-4e87-a13e-a6ca81a82f55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:49.248282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef278d57-7429-4e87-a13e-a6ca81a82f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:49.249711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef278d57-7429-4e87-a13e-a6ca81a82f55 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:49.267300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-ef278d57-7429-4e87-a13e-a6ca81a82f55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:45:49.267300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:45:49.267300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:45:49.267300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:45:49.267300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:45:49.267300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:45:49.267300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:45:49.267300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:45:49.267300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:45:49.267300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:45:49.267300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:45:49.267300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:45:49.267300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:45:49.267300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:45:49.267300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:45:49.268419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:45:49.268419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:45:49.268419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:45:49.268419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:45:49.268419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:45:49.268419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:45:49.268419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:45:49.268419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:45:49.268419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:45:49.268419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:45:49.268419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:45:49.268419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:45:49.268419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:45:49.268419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:45:49.268419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:45:49.268419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:45:49.268419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:45:49.269340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:45:49.269340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:45:49.269340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:45:49.269340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:45:49.269340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 605/1215] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:45:49.275532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989668a-ca4c-4362-aa98-4789d94c434d None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:49.336420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:49.375494 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989668a-ca4c-4362-aa98-4789d94c434d None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:49.408804 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bb63f-6eb7-4007-832b-ebd6704e6620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:49.409419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bb63f-6eb7-4007-832b-ebd6704e6620 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:49.409696 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bb63f-6eb7-4007-832b-ebd6704e6620 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:49.409964 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bb63f-6eb7-4007-832b-ebd6704e6620 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:49.410642 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581bb63f-6eb7-4007-832b-ebd6704e6620 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:45:49.410942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581bb63f-6eb7-4007-832b-ebd6704e6620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:49.412330 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581bb63f-6eb7-4007-832b-ebd6704e6620 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:49.424249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 611/1216] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:45:49.430847 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef278d57-7429-4e87-a13e-a6ca81a82f55 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:49.500774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:49.532432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef278d57-7429-4e87-a13e-a6ca81a82f55 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:49.566248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a0b87-1df9-4db8-9092-78c5d81fe97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:49.566886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a0b87-1df9-4db8-9092-78c5d81fe97a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:49.567173 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a0b87-1df9-4db8-9092-78c5d81fe97a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:49.567484 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a0b87-1df9-4db8-9092-78c5d81fe97a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:49.576127 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a0b87-1df9-4db8-9092-78c5d81fe97a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:49.576127 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a0b87-1df9-4db8-9092-78c5d81fe97a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:49.587781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-645a0b87-1df9-4db8-9092-78c5d81fe97a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:45:49.587781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:45:49.587781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:45:49.587781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:45:49.587781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:45:49.587781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:45:49.587781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:45:49.587781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:45:49.587781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:45:49.587781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:45:49.587781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:45:49.587781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:45:49.587781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:45:49.587781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:45:49.587781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:45:49.588866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:45:49.588866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:45:49.588866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:45:49.588866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:45:49.588866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:45:49.588866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:45:49.588866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:45:49.588866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:45:49.588866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:45:49.588866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:45:49.588866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:45:49.588866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:45:49.588866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:45:49.588866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:45:49.588866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:45:49.588866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:45:49.588866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:45:49.589958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:45:49.589958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:45:49.589958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:45:49.589958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:45:49.589958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:45:49.589958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:45:49.589958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:45:49.589958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:45:49.589958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 606/1217] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:45:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:45:49.594990 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bb63f-6eb7-4007-832b-ebd6704e6620 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:49.694275 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bb63f-6eb7-4007-832b-ebd6704e6620 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:49.716240 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:49.728540 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924282f-c6fd-4ce2-b06c-1e004d2af728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:49.729226 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924282f-c6fd-4ce2-b06c-1e004d2af728 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:49.729517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924282f-c6fd-4ce2-b06c-1e004d2af728 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:49.729796 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924282f-c6fd-4ce2-b06c-1e004d2af728 None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:49.730583 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924282f-c6fd-4ce2-b06c-1e004d2af728 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:45:49.730897 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924282f-c6fd-4ce2-b06c-1e004d2af728 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:49.732416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f924282f-c6fd-4ce2-b06c-1e004d2af728 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:49.744791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 612/1218] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:45:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:45:49.754323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a0b87-1df9-4db8-9092-78c5d81fe97a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:49.854073 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a0b87-1df9-4db8-9092-78c5d81fe97a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:49.881521 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:49.887809 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7a488-3be5-4ccc-b0af-2536442494d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:49.888417 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7a488-3be5-4ccc-b0af-2536442494d5 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:49.888697 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7a488-3be5-4ccc-b0af-2536442494d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:49.888970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7a488-3be5-4ccc-b0af-2536442494d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:49.889756 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7a488-3be5-4ccc-b0af-2536442494d5 None admin] RBAC: Adding query filter params (role.id=183fd05fe14a41828222fd09b6280796, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=e91f2584622a48bba21e1bf31c1aef30) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:45:49.890056 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7a488-3be5-4ccc-b0af-2536442494d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:49.891512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7a488-3be5-4ccc-b0af-2536442494d5 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:49.896949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 607/1219] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:45:49 2022] GET /identity/v3/role_assignments?user.id=e91f2584622a48bba21e1bf31c1aef30&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=183fd05fe14a41828222fd09b6280796 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:45:51.877114 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e19fbd-bfdd-4908-bcf9-5206944f9ed1 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:51.877677 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e19fbd-bfdd-4908-bcf9-5206944f9ed1 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:51.877677 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e19fbd-bfdd-4908-bcf9-5206944f9ed1 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:51.879010 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 613/1220] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:45:51.885002 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8858f-d96d-47c7-b5f1-ce25cfd3ed1b None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:51.885427 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8858f-d96d-47c7-b5f1-ce25cfd3ed1b None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:51.885563 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8858f-d96d-47c7-b5f1-ce25cfd3ed1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:51.904431 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-fba8858f-d96d-47c7-b5f1-ce25cfd3ed1b None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:45:51.905622 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-fba8858f-d96d-47c7-b5f1-ce25cfd3ed1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:45:51.972389 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 608/1221] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:45:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:45:51.995552 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e19fbd-bfdd-4908-bcf9-5206944f9ed1 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:52.098378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e19fbd-bfdd-4908-bcf9-5206944f9ed1 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:52.134086 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277452ed-5255-4174-a64f-521f615a0b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:52.134733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277452ed-5255-4174-a64f-521f615a0b1c None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:52.135011 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277452ed-5255-4174-a64f-521f615a0b1c None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:52.135281 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277452ed-5255-4174-a64f-521f615a0b1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:52.145233 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277452ed-5255-4174-a64f-521f615a0b1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:45:52.151439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-277452ed-5255-4174-a64f-521f615a0b1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:45:52.151439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:45:52.151439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:45:52.151439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:45:52.151439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:45:52.151439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:45:52.151439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:45:52.151439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:45:52.151439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:45:52.151439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:45:52.151439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:45:52.151439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:45:52.151439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:45:52.151439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:45:52.151439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:45:52.151439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:45:52.164636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:45:52.164636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:45:52.164636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:45:52.164636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:45:52.164636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:45:52.164636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:45:52.164636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:45:52.164636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:45:52.164636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:45:52.164636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:45:52.164636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:45:52.164636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:45:52.164636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:45:52.164636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:45:52.164636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:45:52.164636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:45:52.165685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:45:52.165685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:45:52.165685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:45:52.165685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:45:52.165685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:45:52.165685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:45:52.165685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:45:52.165685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:45:52.165685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:45:52.165685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:45:52.165685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:45:52.165685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:45:52.165685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 614/1222] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:45:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:45:52.166553 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8858f-d96d-47c7-b5f1-ce25cfd3ed1b None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:52.255446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8858f-d96d-47c7-b5f1-ce25cfd3ed1b None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:52.280203 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:52.290555 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7c3dd-a435-4934-9e32-a73d489cff63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:52.291215 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7c3dd-a435-4934-9e32-a73d489cff63 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:52.291533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7c3dd-a435-4934-9e32-a73d489cff63 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:52.291810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7c3dd-a435-4934-9e32-a73d489cff63 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:52.292522 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7c3dd-a435-4934-9e32-a73d489cff63 None admin] RBAC: Adding query filter params (name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:45:52.292825 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7c3dd-a435-4934-9e32-a73d489cff63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:52.294196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7c3dd-a435-4934-9e32-a73d489cff63 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:52.301801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 609/1223] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:45:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:45:52.308124 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277452ed-5255-4174-a64f-521f615a0b1c None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:52.351730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:52.408094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277452ed-5255-4174-a64f-521f615a0b1c None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:52.442334 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4f91c-e3e4-4f5a-b4d1-604ef8ca0183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:52.442976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4f91c-e3e4-4f5a-b4d1-604ef8ca0183 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:52.443258 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4f91c-e3e4-4f5a-b4d1-604ef8ca0183 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:52.443562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4f91c-e3e4-4f5a-b4d1-604ef8ca0183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:52.454575 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4f91c-e3e4-4f5a-b4d1-604ef8ca0183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:52.463881 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4f91c-e3e4-4f5a-b4d1-604ef8ca0183 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:52.470403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-28a4f91c-e3e4-4f5a-b4d1-604ef8ca0183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:45:52.470403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:45:52.470403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:45:52.470403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:45:52.470403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:45:52.470403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:45:52.470403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:45:52.470403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:45:52.470403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:45:52.470403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:45:52.470403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:45:52.470403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:45:52.470403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:45:52.470403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:45:52.470403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:45:52.471478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:45:52.471478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:45:52.471478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:45:52.471478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:45:52.471478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:45:52.471478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:45:52.471478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:45:52.471478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:45:52.471478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:45:52.471478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:45:52.471478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:45:52.471478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:45:52.471478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:45:52.471478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:45:52.471478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:45:52.471478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:45:52.471478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:45:52.472581 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:45:52.472581 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:45:52.472581 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:45:52.472581 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:45:52.472581 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 615/1224] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:45:52.477464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7c3dd-a435-4934-9e32-a73d489cff63 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:52.577305 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7c3dd-a435-4934-9e32-a73d489cff63 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:52.609639 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678cd7c-5b19-409e-90b7-3d3d42750c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:52.610187 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678cd7c-5b19-409e-90b7-3d3d42750c6d None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:52.610462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678cd7c-5b19-409e-90b7-3d3d42750c6d None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:52.610733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678cd7c-5b19-409e-90b7-3d3d42750c6d None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:52.611439 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678cd7c-5b19-409e-90b7-3d3d42750c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:45:52.611739 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678cd7c-5b19-409e-90b7-3d3d42750c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:52.613095 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678cd7c-5b19-409e-90b7-3d3d42750c6d None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:52.625730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 610/1225] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:45:52.631668 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4f91c-e3e4-4f5a-b4d1-604ef8ca0183 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:52.724771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:52.731951 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4f91c-e3e4-4f5a-b4d1-604ef8ca0183 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:52.764892 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1190a-347c-4a9d-b728-7555af5a5922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:52.765529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1190a-347c-4a9d-b728-7555af5a5922 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:52.765808 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1190a-347c-4a9d-b728-7555af5a5922 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:52.766076 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1190a-347c-4a9d-b728-7555af5a5922 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:52.773397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1190a-347c-4a9d-b728-7555af5a5922 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:52.775018 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1190a-347c-4a9d-b728-7555af5a5922 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:52.787157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-def1190a-347c-4a9d-b728-7555af5a5922 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 03:45:52.787157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:45:52.787157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:45:52.787157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:45:52.787157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:45:52.787157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:45:52.787157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:45:52.787157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:45:52.787157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:45:52.787157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:45:52.787157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:45:52.787157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:45:52.787157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:45:52.787157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:45:52.787157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:45:52.787157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:45:52.788285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:45:52.788285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:45:52.788285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:45:52.788285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:45:52.788285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:45:52.788285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:45:52.788285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:45:52.788285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:45:52.788285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:45:52.788285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:45:52.788285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:45:52.788285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:45:52.788285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:45:52.788285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:45:52.788285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:45:52.788285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:45:52.788285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:45:52.788285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:45:52.790043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:45:52.790043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:45:52.790043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:45:52.790043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:45:52.790043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:45:52.790043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:45:52.790043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:45:52.790043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:45:52.790043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 03:45:52.790043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:45:52.790043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 616/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:45:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:45:52.794778 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678cd7c-5b19-409e-90b7-3d3d42750c6d None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:52.841178 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:52.892734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678cd7c-5b19-409e-90b7-3d3d42750c6d None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:52.925603 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a19ac2-cb6b-47e4-ad7c-85e41dfa3504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:52.926215 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a19ac2-cb6b-47e4-ad7c-85e41dfa3504 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:52.926497 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a19ac2-cb6b-47e4-ad7c-85e41dfa3504 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:52.926767 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a19ac2-cb6b-47e4-ad7c-85e41dfa3504 None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:52.927578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a19ac2-cb6b-47e4-ad7c-85e41dfa3504 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:45:52.927884 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a19ac2-cb6b-47e4-ad7c-85e41dfa3504 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:52.929301 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a19ac2-cb6b-47e4-ad7c-85e41dfa3504 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:52.946209 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 611/1227] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 28 03:45:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:45:52.952115 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1190a-347c-4a9d-b728-7555af5a5922 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:53.055450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1190a-347c-4a9d-b728-7555af5a5922 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:53.089383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400043a3-8c53-4201-acca-d91c6670fbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:53.090062 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400043a3-8c53-4201-acca-d91c6670fbd8 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:53.090347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400043a3-8c53-4201-acca-d91c6670fbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:53.090623 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400043a3-8c53-4201-acca-d91c6670fbd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:53.101110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400043a3-8c53-4201-acca-d91c6670fbd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:53.102594 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400043a3-8c53-4201-acca-d91c6670fbd8 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:53.117845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-400043a3-8c53-4201-acca-d91c6670fbd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:45:53.117845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:45:53.117845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:45:53.117845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:45:53.117845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:45:53.117845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:45:53.117845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:45:53.117845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:45:53.117845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:45:53.117845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:45:53.117845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:45:53.117845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:45:53.117845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:45:53.117845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:45:53.117845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:45:53.126308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:45:53.126308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:45:53.126308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:45:53.126308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:45:53.126308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:45:53.126308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:45:53.126308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:45:53.126308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:45:53.126308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:45:53.126308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:45:53.126308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:45:53.126308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:45:53.126308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:45:53.126308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:45:53.126308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:45:53.126308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:45:53.126308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:45:53.127448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:45:53.127448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:45:53.127448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:45:53.127448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:45:53.127448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 617/1228] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 03:45:53.127800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a19ac2-cb6b-47e4-ad7c-85e41dfa3504 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:53.225089 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a19ac2-cb6b-47e4-ad7c-85e41dfa3504 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:53.227391 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:53.259907 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db509c79-04d7-4565-add8-b090a90cb146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:53.260527 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db509c79-04d7-4565-add8-b090a90cb146 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:53.260811 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db509c79-04d7-4565-add8-b090a90cb146 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:53.261086 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db509c79-04d7-4565-add8-b090a90cb146 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:53.261781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db509c79-04d7-4565-add8-b090a90cb146 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:45:53.262127 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db509c79-04d7-4565-add8-b090a90cb146 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:53.263821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db509c79-04d7-4565-add8-b090a90cb146 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:53.275866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 612/1229] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:45:53.281578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400043a3-8c53-4201-acca-d91c6670fbd8 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:53.291115 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:53.380684 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400043a3-8c53-4201-acca-d91c6670fbd8 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:53.418508 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e0c95-388a-45cd-bf00-6dbe400f8837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:53.419148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e0c95-388a-45cd-bf00-6dbe400f8837 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:53.419490 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e0c95-388a-45cd-bf00-6dbe400f8837 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:53.419803 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e0c95-388a-45cd-bf00-6dbe400f8837 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:53.426260 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e0c95-388a-45cd-bf00-6dbe400f8837 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:53.427717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e0c95-388a-45cd-bf00-6dbe400f8837 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:53.439548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-0b9e0c95-388a-45cd-bf00-6dbe400f8837 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:45:53.439548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:45:53.439548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:45:53.439548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:45:53.439548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:45:53.439548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:45:53.439548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:45:53.439548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:45:53.439548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:45:53.439548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:45:53.439548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:45:53.439548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:45:53.439548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:45:53.439548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:45:53.439548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:45:53.440409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:45:53.440409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:45:53.440409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:45:53.440409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:45:53.440409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:45:53.440409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:45:53.440409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:45:53.440409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:45:53.440409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:45:53.440409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:45:53.440409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:45:53.440409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:45:53.440409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:45:53.440409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:45:53.440409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:45:53.440409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:45:53.440409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:45:53.441286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:45:53.441286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:45:53.441286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:45:53.441286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:45:53.441286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:45:53.441286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:45:53.441286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:45:53.441286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:45:53.441286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 618/1230] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:45:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:45:53.446784 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db509c79-04d7-4565-add8-b090a90cb146 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:53.549502 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db509c79-04d7-4565-add8-b090a90cb146 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:53.582634 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744523be-1b8d-4b45-b6a3-c625da30e525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:53.583246 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744523be-1b8d-4b45-b6a3-c625da30e525 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:53.583587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744523be-1b8d-4b45-b6a3-c625da30e525 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:53.583932 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744523be-1b8d-4b45-b6a3-c625da30e525 None admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:53.584676 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744523be-1b8d-4b45-b6a3-c625da30e525 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:45:53.584980 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744523be-1b8d-4b45-b6a3-c625da30e525 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:53.587524 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744523be-1b8d-4b45-b6a3-c625da30e525 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:53.599293 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 613/1231] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:45:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:45:53.605581 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e0c95-388a-45cd-bf00-6dbe400f8837 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:53.670977 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:53.704941 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e0c95-388a-45cd-bf00-6dbe400f8837 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:53.739004 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b7450-72dc-4bbf-baec-b199e638c27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:53.739730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b7450-72dc-4bbf-baec-b199e638c27f None admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:53.740010 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b7450-72dc-4bbf-baec-b199e638c27f None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:53.740284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b7450-72dc-4bbf-baec-b199e638c27f None admin] PATH_INFO: `/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/e91f2584622a48bba21e1bf31c1aef30/roles/183fd05fe14a41828222fd09b6280796` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:53.755602 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b7450-72dc-4bbf-baec-b199e638c27f None admin] RBAC: Authorizing `identity:create_grant(project_id=28b7995e83524b9293d1c6fc319e5a85, user_id=e91f2584622a48bba21e1bf31c1aef30, role_id=183fd05fe14a41828222fd09b6280796)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:53.757183 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b7450-72dc-4bbf-baec-b199e638c27f None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:53.893125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 619/1232] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:45:53 2022] PUT /identity/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/e91f2584622a48bba21e1bf31c1aef30/roles/183fd05fe14a41828222fd09b6280796 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:45:55.917473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc480ce2-dea6-4d25-a62d-b4150adf42d3 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:55.918093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc480ce2-dea6-4d25-a62d-b4150adf42d3 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:55.918093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc480ce2-dea6-4d25-a62d-b4150adf42d3 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:55.919418 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 614/1233] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:45:55.924584 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501e069-4da4-4334-a2d7-9100f88a9128 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:55.924951 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501e069-4da4-4334-a2d7-9100f88a9128 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:55.925142 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501e069-4da4-4334-a2d7-9100f88a9128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:55.944426 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-9501e069-4da4-4334-a2d7-9100f88a9128 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:45:55.946296 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9501e069-4da4-4334-a2d7-9100f88a9128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:45:56.012703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 620/1234] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:45:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:45:56.037206 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc480ce2-dea6-4d25-a62d-b4150adf42d3 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:56.062818 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:56.139922 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc480ce2-dea6-4d25-a62d-b4150adf42d3 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:56.174669 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22dedc-f0fb-4929-9a2b-775b848a5a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:56.175305 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22dedc-f0fb-4929-9a2b-775b848a5a54 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:56.175617 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22dedc-f0fb-4929-9a2b-775b848a5a54 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:56.175883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22dedc-f0fb-4929-9a2b-775b848a5a54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:56.185948 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22dedc-f0fb-4929-9a2b-775b848a5a54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:45:56.190886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-4a22dedc-f0fb-4929-9a2b-775b848a5a54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:45:56.190886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:45:56.190886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:45:56.190886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:45:56.190886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:45:56.190886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:45:56.190886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:45:56.190886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:45:56.190886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:45:56.190886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:45:56.190886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:45:56.190886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:45:56.190886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:45:56.190886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:45:56.190886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:45:56.190886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:45:56.192009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:45:56.192009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:45:56.192009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:45:56.192009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:45:56.192009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:45:56.192009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:45:56.192009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:45:56.192009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:45:56.192009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:45:56.192009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:45:56.192009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:45:56.192009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:45:56.192009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:45:56.192009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:45:56.192009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:45:56.192009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:45:56.192878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:45:56.192878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:45:56.192878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:45:56.192878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:45:56.192878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:45:56.192878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:45:56.192878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:45:56.192878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:45:56.192878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:45:56.192878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:45:56.192878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 03:45:56.192878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:45:56.192878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 615/1235] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 28 03:45:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:45:56.198807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501e069-4da4-4334-a2d7-9100f88a9128 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:56.243933 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:56.295803 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501e069-4da4-4334-a2d7-9100f88a9128 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:56.329973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e7c15-bbe5-4ecf-b0ec-30d9a61977e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:56.330651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e7c15-bbe5-4ecf-b0ec-30d9a61977e8 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:56.330927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e7c15-bbe5-4ecf-b0ec-30d9a61977e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:56.331195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e7c15-bbe5-4ecf-b0ec-30d9a61977e8 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:56.331999 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e7c15-bbe5-4ecf-b0ec-30d9a61977e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:45:56.332303 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e7c15-bbe5-4ecf-b0ec-30d9a61977e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:56.334236 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e7c15-bbe5-4ecf-b0ec-30d9a61977e8 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:56.343496 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 621/1236] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 28 03:45:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:45:56.349429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22dedc-f0fb-4929-9a2b-775b848a5a54 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:56.434387 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:56.451375 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22dedc-f0fb-4929-9a2b-775b848a5a54 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:56.486644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae785e-d7f5-4f6b-a43b-4dbb1ca26024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:56.487274 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae785e-d7f5-4f6b-a43b-4dbb1ca26024 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:56.487603 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae785e-d7f5-4f6b-a43b-4dbb1ca26024 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:56.487882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae785e-d7f5-4f6b-a43b-4dbb1ca26024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:56.498370 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae785e-d7f5-4f6b-a43b-4dbb1ca26024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:56.499894 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae785e-d7f5-4f6b-a43b-4dbb1ca26024 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:56.514846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-e9ae785e-d7f5-4f6b-a43b-4dbb1ca26024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:45:56.514846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:45:56.514846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:45:56.514846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:45:56.514846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:45:56.514846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:45:56.514846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:45:56.514846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:45:56.514846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:45:56.514846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:45:56.514846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:45:56.514846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:45:56.514846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:45:56.514846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:45:56.514846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:45:56.515963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:45:56.515963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:45:56.515963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:45:56.515963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:45:56.515963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:45:56.515963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:45:56.515963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:45:56.515963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:45:56.515963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:45:56.515963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:45:56.515963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:45:56.515963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:45:56.515963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:45:56.515963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:45:56.515963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:45:56.515963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:45:56.515963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:45:56.517064 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:45:56.517064 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:45:56.517064 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:45:56.517064 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:45:56.517064 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 616/1237] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:45:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:45:56.521805 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e7c15-bbe5-4ecf-b0ec-30d9a61977e8 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:56.620950 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e7c15-bbe5-4ecf-b0ec-30d9a61977e8 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:56.629816 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:56.655627 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e4d99-e6a6-4177-9439-440d57a21785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:56.656244 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e4d99-e6a6-4177-9439-440d57a21785 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:56.656520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e4d99-e6a6-4177-9439-440d57a21785 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:56.656811 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e4d99-e6a6-4177-9439-440d57a21785 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:56.657490 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e4d99-e6a6-4177-9439-440d57a21785 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:45:56.657789 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e4d99-e6a6-4177-9439-440d57a21785 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:56.659218 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e4d99-e6a6-4177-9439-440d57a21785 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:56.671115 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 622/1238] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:45:56.676967 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae785e-d7f5-4f6b-a43b-4dbb1ca26024 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:56.776538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae785e-d7f5-4f6b-a43b-4dbb1ca26024 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:56.812202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be12e6c-711d-43e5-a27e-990adf004b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:56.812844 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be12e6c-711d-43e5-a27e-990adf004b53 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:56.813150 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be12e6c-711d-43e5-a27e-990adf004b53 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:56.813479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be12e6c-711d-43e5-a27e-990adf004b53 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:56.816129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:56.822258 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be12e6c-711d-43e5-a27e-990adf004b53 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:56.823741 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be12e6c-711d-43e5-a27e-990adf004b53 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:56.834581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-8be12e6c-711d-43e5-a27e-990adf004b53 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 03:45:56.834581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:45:56.834581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:45:56.834581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:45:56.834581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:45:56.834581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:45:56.834581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:45:56.834581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:45:56.834581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:45:56.834581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:45:56.834581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:45:56.834581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:45:56.834581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:45:56.834581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:45:56.834581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:45:56.834581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:45:56.836473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:45:56.836473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:45:56.836473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:45:56.836473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:45:56.836473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:45:56.836473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:45:56.836473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:45:56.836473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:45:56.836473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:45:56.836473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:45:56.836473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:45:56.836473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:45:56.836473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:45:56.836473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:45:56.836473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:45:56.836473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:45:56.836473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:45:56.836473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:45:56.837624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:45:56.837624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:45:56.837624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:45:56.837624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:45:56.837624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:45:56.837624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:45:56.837624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:45:56.837624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:45:56.837624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 03:45:56.837624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:45:56.837624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 617/1239] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:45:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:45:56.842346 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e4d99-e6a6-4177-9439-440d57a21785 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:56.941813 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e4d99-e6a6-4177-9439-440d57a21785 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:56.978537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a20ef-0b2f-4e83-8d71-0be2afb257c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:56.979182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a20ef-0b2f-4e83-8d71-0be2afb257c2 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:56.979525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a20ef-0b2f-4e83-8d71-0be2afb257c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:56.979797 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a20ef-0b2f-4e83-8d71-0be2afb257c2 None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:56.980631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a20ef-0b2f-4e83-8d71-0be2afb257c2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:45:56.980933 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a20ef-0b2f-4e83-8d71-0be2afb257c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:56.982355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a20ef-0b2f-4e83-8d71-0be2afb257c2 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:56.999572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 623/1240] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 28 03:45:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:45:57.005398 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be12e6c-711d-43e5-a27e-990adf004b53 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:57.112695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be12e6c-711d-43e5-a27e-990adf004b53 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:57.146878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2964dd-22d3-4a25-a1de-95081e887d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:57.147535 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2964dd-22d3-4a25-a1de-95081e887d70 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:57.147821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2964dd-22d3-4a25-a1de-95081e887d70 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:57.148192 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2964dd-22d3-4a25-a1de-95081e887d70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:57.213429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:57.219902 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2964dd-22d3-4a25-a1de-95081e887d70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:57.224867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2964dd-22d3-4a25-a1de-95081e887d70 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:57.318419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 618/1241] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:45:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:45:57.324333 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a20ef-0b2f-4e83-8d71-0be2afb257c2 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:57.350573 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:57.422429 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a20ef-0b2f-4e83-8d71-0be2afb257c2 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:57.455961 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabc7fa-0429-45c3-9c18-a418fa622731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:57.456634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabc7fa-0429-45c3-9c18-a418fa622731 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:57.456955 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabc7fa-0429-45c3-9c18-a418fa622731 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:57.457443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabc7fa-0429-45c3-9c18-a418fa622731 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:57.471196 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabc7fa-0429-45c3-9c18-a418fa622731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:57.471196 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabc7fa-0429-45c3-9c18-a418fa622731 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:57.485088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-8fabc7fa-0429-45c3-9c18-a418fa622731 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:45:57.485088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:45:57.485088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:45:57.485088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:45:57.485088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:45:57.485088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:45:57.485088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:45:57.485088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:45:57.485088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:45:57.485088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:45:57.485088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:45:57.485088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:45:57.485088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:45:57.485088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:45:57.485088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:45:57.486195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:45:57.486195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:45:57.486195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:45:57.486195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:45:57.486195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:45:57.486195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:45:57.486195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:45:57.486195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:45:57.486195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:45:57.486195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:45:57.486195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:45:57.486195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:45:57.486195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:45:57.486195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:45:57.486195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:45:57.486195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:45:57.486195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:45:57.487153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:45:57.487153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:45:57.487153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:45:57.487153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:45:57.487153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 624/1242] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:45:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:45:57.492905 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2964dd-22d3-4a25-a1de-95081e887d70 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:57.587141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:57.592779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2964dd-22d3-4a25-a1de-95081e887d70 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:57.626992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd221ab-b488-48ed-8a0d-a91616168a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:57.627639 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd221ab-b488-48ed-8a0d-a91616168a9b None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:57.627925 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd221ab-b488-48ed-8a0d-a91616168a9b None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:57.628202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd221ab-b488-48ed-8a0d-a91616168a9b None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:57.628895 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd221ab-b488-48ed-8a0d-a91616168a9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:45:57.629196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd221ab-b488-48ed-8a0d-a91616168a9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:57.630557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd221ab-b488-48ed-8a0d-a91616168a9b None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:57.641465 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 619/1243] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 03:45:57.647149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabc7fa-0429-45c3-9c18-a418fa622731 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:57.728364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:57.748966 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabc7fa-0429-45c3-9c18-a418fa622731 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:57.782185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dec802-f3bb-423b-9c40-09e5c5c38529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:57.782838 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dec802-f3bb-423b-9c40-09e5c5c38529 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:57.783117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dec802-f3bb-423b-9c40-09e5c5c38529 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:57.783903 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dec802-f3bb-423b-9c40-09e5c5c38529 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:57.790660 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dec802-f3bb-423b-9c40-09e5c5c38529 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:57.792181 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dec802-f3bb-423b-9c40-09e5c5c38529 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:57.804518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-01dec802-f3bb-423b-9c40-09e5c5c38529 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:45:57.804518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:45:57.804518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:45:57.804518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:45:57.804518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:45:57.804518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:45:57.804518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:45:57.804518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:45:57.804518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:45:57.804518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:45:57.804518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:45:57.804518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:45:57.804518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:45:57.804518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:45:57.804518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:45:57.805775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:45:57.805775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:45:57.805775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:45:57.805775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:45:57.805775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:45:57.805775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:45:57.805775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:45:57.805775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:45:57.805775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:45:57.805775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:45:57.805775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:45:57.805775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:45:57.805775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:45:57.805775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:45:57.805775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:45:57.805775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:45:57.805775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:45:57.806713 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:45:57.806713 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:45:57.806713 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:45:57.806713 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:45:57.806713 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:45:57.806713 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:45:57.806713 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:45:57.806713 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:45:57.806713 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 625/1244] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:45:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:45:57.811608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd221ab-b488-48ed-8a0d-a91616168a9b None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:57.910329 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd221ab-b488-48ed-8a0d-a91616168a9b None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:57.942067 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f54c0-bda8-4769-91c9-309348e26f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:57.942675 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f54c0-bda8-4769-91c9-309348e26f6c None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:57.942956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f54c0-bda8-4769-91c9-309348e26f6c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:57.943227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f54c0-bda8-4769-91c9-309348e26f6c None admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:57.944001 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f54c0-bda8-4769-91c9-309348e26f6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:45:57.944302 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f54c0-bda8-4769-91c9-309348e26f6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:57.946290 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f54c0-bda8-4769-91c9-309348e26f6c None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:57.957901 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 620/1245] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:45:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:45:57.964731 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dec802-f3bb-423b-9c40-09e5c5c38529 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:45:58.063948 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dec802-f3bb-423b-9c40-09e5c5c38529 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:45:58.097744 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cbedc-e594-4ca1-9ed1-87932de84009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:45:58.098354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cbedc-e594-4ca1-9ed1-87932de84009 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:45:58.098636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cbedc-e594-4ca1-9ed1-87932de84009 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:45:58.098904 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cbedc-e594-4ca1-9ed1-87932de84009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:45:58.099707 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cbedc-e594-4ca1-9ed1-87932de84009 None admin] RBAC: Adding query filter params (role.id=183fd05fe14a41828222fd09b6280796, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=e91f2584622a48bba21e1bf31c1aef30) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:45:58.100011 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cbedc-e594-4ca1-9ed1-87932de84009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:45:58.101442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cbedc-e594-4ca1-9ed1-87932de84009 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:45:58.107161 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 626/1246] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:45:57 2022] GET /identity/v3/role_assignments?user.id=e91f2584622a48bba21e1bf31c1aef30&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=183fd05fe14a41828222fd09b6280796 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:00.176558 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752db79-a4cd-41bc-b3a2-b73c46be572c None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:00.177109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752db79-a4cd-41bc-b3a2-b73c46be572c None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:00.177109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752db79-a4cd-41bc-b3a2-b73c46be572c None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:00.178472 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 621/1247] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:46:00.183842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f306924-731e-4cf8-999c-71bea2f80893 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:00.184236 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f306924-731e-4cf8-999c-71bea2f80893 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:00.184401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f306924-731e-4cf8-999c-71bea2f80893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:00.190666 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:00.203161 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-9f306924-731e-4cf8-999c-71bea2f80893 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:46:00.204391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9f306924-731e-4cf8-999c-71bea2f80893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:46:00.270967 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 627/1248] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:46:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:46:00.294935 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752db79-a4cd-41bc-b3a2-b73c46be572c None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:00.312759 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:00.396334 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752db79-a4cd-41bc-b3a2-b73c46be572c None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:00.431718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5155fd-f482-4526-8ad7-1f33971c2c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:00.432267 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5155fd-f482-4526-8ad7-1f33971c2c1b None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:00.432544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5155fd-f482-4526-8ad7-1f33971c2c1b None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:00.432811 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5155fd-f482-4526-8ad7-1f33971c2c1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:00.442997 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5155fd-f482-4526-8ad7-1f33971c2c1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:46:00.448571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-9d5155fd-f482-4526-8ad7-1f33971c2c1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:46:00.448571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:00.448571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:46:00.448571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:46:00.448571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:46:00.448571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:46:00.448571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:46:00.448571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:46:00.448571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:46:00.448571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:46:00.448571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:46:00.448571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:46:00.448571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:46:00.448571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:46:00.448571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:46:00.448571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:46:00.449544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:46:00.449544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:46:00.449544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:46:00.449544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:46:00.449544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:46:00.449544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:46:00.449544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:46:00.449544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:46:00.449544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:46:00.449544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:46:00.449544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:46:00.449544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:46:00.449544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:46:00.449544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:46:00.449544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:46:00.449544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:46:00.450377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:46:00.450377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:46:00.450377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:46:00.450377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:46:00.450377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:46:00.450377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:46:00.450377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:46:00.450377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:46:00.450377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:46:00.450377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:46:00.450377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:46:00.450377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:46:00.450377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 622/1249] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:46:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:46:00.456132 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f306924-731e-4cf8-999c-71bea2f80893 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:00.552784 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f306924-731e-4cf8-999c-71bea2f80893 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:00.583292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:00.588594 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea2cd0-de0e-44b5-849d-979a67f15d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:00.589260 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea2cd0-de0e-44b5-849d-979a67f15d17 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:00.589548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea2cd0-de0e-44b5-849d-979a67f15d17 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:00.589837 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea2cd0-de0e-44b5-849d-979a67f15d17 None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:00.590553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea2cd0-de0e-44b5-849d-979a67f15d17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:00.590880 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea2cd0-de0e-44b5-849d-979a67f15d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:00.592268 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea2cd0-de0e-44b5-849d-979a67f15d17 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:00.600274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 628/1250] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:46:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:00.606238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5155fd-f482-4526-8ad7-1f33971c2c1b None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:00.683007 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:00.705184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5155fd-f482-4526-8ad7-1f33971c2c1b None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:00.737735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec4920-bb77-4ecc-9fb8-2c642f35a2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:00.743077 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec4920-bb77-4ecc-9fb8-2c642f35a2f0 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:00.743077 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec4920-bb77-4ecc-9fb8-2c642f35a2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:00.743077 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec4920-bb77-4ecc-9fb8-2c642f35a2f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:00.750005 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec4920-bb77-4ecc-9fb8-2c642f35a2f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:00.751474 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec4920-bb77-4ecc-9fb8-2c642f35a2f0 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:00.765695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-bcec4920-bb77-4ecc-9fb8-2c642f35a2f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:46:00.765695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:00.765695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:46:00.765695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:46:00.765695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:46:00.765695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:46:00.765695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:46:00.765695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:46:00.765695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:46:00.765695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:46:00.765695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:46:00.765695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:46:00.765695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:46:00.765695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:46:00.765695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:46:00.766722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:46:00.766722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:46:00.766722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:46:00.766722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:46:00.766722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:46:00.766722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:46:00.766722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:46:00.766722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:46:00.766722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:46:00.766722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:46:00.766722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:46:00.766722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:46:00.766722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:46:00.766722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:46:00.766722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:46:00.766722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:46:00.766722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:46:00.767990 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:46:00.767990 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:46:00.767990 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:46:00.767990 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:46:00.767990 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 623/1251] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:46:00.772655 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea2cd0-de0e-44b5-849d-979a67f15d17 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:00.872530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea2cd0-de0e-44b5-849d-979a67f15d17 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:00.906342 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695bae6-34cf-4b70-be71-eb18b2ceb3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:00.906967 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695bae6-34cf-4b70-be71-eb18b2ceb3c1 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:00.907248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695bae6-34cf-4b70-be71-eb18b2ceb3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:00.907558 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695bae6-34cf-4b70-be71-eb18b2ceb3c1 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:00.908256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695bae6-34cf-4b70-be71-eb18b2ceb3c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:00.908549 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695bae6-34cf-4b70-be71-eb18b2ceb3c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:00.909905 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695bae6-34cf-4b70-be71-eb18b2ceb3c1 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:00.921865 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 629/1252] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:00.927623 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec4920-bb77-4ecc-9fb8-2c642f35a2f0 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:01.029567 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec4920-bb77-4ecc-9fb8-2c642f35a2f0 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:01.056106 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:01.063871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea92b2-164e-4a68-9ab1-37b47cd80f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:01.064510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea92b2-164e-4a68-9ab1-37b47cd80f7f None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:01.064789 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea92b2-164e-4a68-9ab1-37b47cd80f7f None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:01.065176 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea92b2-164e-4a68-9ab1-37b47cd80f7f None admin] PATH_INFO: `/v3/users/placement` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:01.073251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea92b2-164e-4a68-9ab1-37b47cd80f7f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:01.074798 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea92b2-164e-4a68-9ab1-37b47cd80f7f None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:01.085747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-9fea92b2-164e-4a68-9ab1-37b47cd80f7f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 03:46:01.085747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:01.085747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:46:01.085747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:46:01.085747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:46:01.085747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:46:01.085747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:46:01.085747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:46:01.085747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:46:01.085747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:46:01.085747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:46:01.085747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:46:01.085747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:46:01.085747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:46:01.085747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:46:01.085747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:46:01.086843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:46:01.086843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:46:01.086843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:46:01.086843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:46:01.086843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:46:01.086843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:46:01.086843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:46:01.086843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:46:01.086843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:46:01.086843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:46:01.086843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:46:01.086843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:46:01.086843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:46:01.086843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:46:01.086843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:46:01.086843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:46:01.086843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:46:01.086843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:46:01.088024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:46:01.088024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:46:01.088024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:46:01.088024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:46:01.088024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:46:01.088024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:46:01.088024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:46:01.088024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:46:01.088024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 03:46:01.088024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:46:01.088024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 624/1253] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:46:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:46:01.093255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695bae6-34cf-4b70-be71-eb18b2ceb3c1 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:01.149444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:01.192966 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695bae6-34cf-4b70-be71-eb18b2ceb3c1 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:01.227903 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b5340-2e12-47e4-9ebd-dab128c9a4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:01.228529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b5340-2e12-47e4-9ebd-dab128c9a4ce None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:01.228809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b5340-2e12-47e4-9ebd-dab128c9a4ce None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:01.229080 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b5340-2e12-47e4-9ebd-dab128c9a4ce None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:01.229869 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b5340-2e12-47e4-9ebd-dab128c9a4ce None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:01.230175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b5340-2e12-47e4-9ebd-dab128c9a4ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:01.231709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b5340-2e12-47e4-9ebd-dab128c9a4ce None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:01.250047 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 630/1254] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 28 03:46:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:01.255916 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea92b2-164e-4a68-9ab1-37b47cd80f7f None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:01.358959 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea92b2-164e-4a68-9ab1-37b47cd80f7f None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:01.392852 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe0ade-4f86-4611-8aac-4f7859fc43a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:01.393457 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe0ade-4f86-4611-8aac-4f7859fc43a7 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:01.393741 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe0ade-4f86-4611-8aac-4f7859fc43a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:01.394184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe0ade-4f86-4611-8aac-4f7859fc43a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:01.449710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:01.464080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe0ade-4f86-4611-8aac-4f7859fc43a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:01.465523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe0ade-4f86-4611-8aac-4f7859fc43a7 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:01.562792 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 625/1255] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:46:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:46:01.568643 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b5340-2e12-47e4-9ebd-dab128c9a4ce None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:01.668968 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b5340-2e12-47e4-9ebd-dab128c9a4ce None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:01.684709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:01.704865 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4a917-329d-4de7-b695-ae81ae24345f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:01.705505 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4a917-329d-4de7-b695-ae81ae24345f None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:01.705781 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4a917-329d-4de7-b695-ae81ae24345f None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:01.706051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4a917-329d-4de7-b695-ae81ae24345f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:01.716272 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4a917-329d-4de7-b695-ae81ae24345f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:01.717805 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4a917-329d-4de7-b695-ae81ae24345f None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:01.732371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-7fc4a917-329d-4de7-b695-ae81ae24345f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:46:01.732371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:01.732371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:46:01.732371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:46:01.732371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:46:01.732371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:46:01.732371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:46:01.732371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:46:01.732371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:46:01.732371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:46:01.732371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:46:01.732371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:46:01.732371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:46:01.732371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:46:01.732371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:46:01.740174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:46:01.740174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:46:01.740174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:46:01.740174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:46:01.740174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:46:01.740174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:46:01.740174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:46:01.740174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:46:01.740174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:46:01.740174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:46:01.740174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:46:01.740174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:46:01.740174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:46:01.740174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:46:01.740174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:46:01.740174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:46:01.740174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:46:01.741336 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:46:01.741336 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:46:01.741336 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:46:01.741336 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:46:01.741336 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 631/1256] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:46:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:46:01.741690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe0ade-4f86-4611-8aac-4f7859fc43a7 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:01.826953 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:01.838391 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe0ade-4f86-4611-8aac-4f7859fc43a7 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:01.871632 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf915cb-eedd-40c8-abf2-4393ef33335a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:01.872264 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf915cb-eedd-40c8-abf2-4393ef33335a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:01.872546 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf915cb-eedd-40c8-abf2-4393ef33335a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:01.872823 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf915cb-eedd-40c8-abf2-4393ef33335a None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:01.873524 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf915cb-eedd-40c8-abf2-4393ef33335a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:01.873828 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf915cb-eedd-40c8-abf2-4393ef33335a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:01.875211 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf915cb-eedd-40c8-abf2-4393ef33335a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:01.886437 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 626/1257] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:01.892168 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4a917-329d-4de7-b695-ae81ae24345f None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:01.993645 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4a917-329d-4de7-b695-ae81ae24345f None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:02.027635 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746591b-fac2-4f77-8ea5-3d06d3cd6523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:02.028296 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746591b-fac2-4f77-8ea5-3d06d3cd6523 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:02.028573 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746591b-fac2-4f77-8ea5-3d06d3cd6523 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:02.028844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746591b-fac2-4f77-8ea5-3d06d3cd6523 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:02.035441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746591b-fac2-4f77-8ea5-3d06d3cd6523 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:02.036864 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746591b-fac2-4f77-8ea5-3d06d3cd6523 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:02.048973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-9746591b-fac2-4f77-8ea5-3d06d3cd6523 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:46:02.048973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:02.048973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:46:02.048973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:46:02.048973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:46:02.048973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:46:02.048973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:46:02.048973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:46:02.048973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:46:02.048973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:46:02.048973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:46:02.048973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:46:02.048973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:46:02.048973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:46:02.048973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:46:02.050022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:46:02.050022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:46:02.050022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:46:02.050022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:46:02.050022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:46:02.050022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:46:02.050022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:46:02.050022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:46:02.050022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:46:02.050022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:46:02.050022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:46:02.050022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:46:02.050022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:46:02.050022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:46:02.050022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:46:02.050022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:46:02.050022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:46:02.050997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:46:02.050997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:46:02.050997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:46:02.050997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:46:02.050997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:46:02.050997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:46:02.050997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:46:02.050997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:46:02.050997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 632/1258] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:46:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:46:02.058392 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf915cb-eedd-40c8-abf2-4393ef33335a None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:02.155268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf915cb-eedd-40c8-abf2-4393ef33335a None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:02.192314 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bd232-8a5a-41b1-b714-33753831c03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:02.192935 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bd232-8a5a-41b1-b714-33753831c03a None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:02.193220 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bd232-8a5a-41b1-b714-33753831c03a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:02.193502 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bd232-8a5a-41b1-b714-33753831c03a None admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:02.194254 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bd232-8a5a-41b1-b714-33753831c03a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:02.194564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bd232-8a5a-41b1-b714-33753831c03a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:02.196443 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bd232-8a5a-41b1-b714-33753831c03a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:02.208598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 627/1259] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:46:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:02.215913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746591b-fac2-4f77-8ea5-3d06d3cd6523 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:02.243832 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:02.317342 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746591b-fac2-4f77-8ea5-3d06d3cd6523 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:02.352639 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc53da2-c69d-4ebd-8d78-09bf824cdb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:02.353266 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc53da2-c69d-4ebd-8d78-09bf824cdb96 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:02.353545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc53da2-c69d-4ebd-8d78-09bf824cdb96 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:02.353815 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc53da2-c69d-4ebd-8d78-09bf824cdb96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:02.354602 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc53da2-c69d-4ebd-8d78-09bf824cdb96 None admin] RBAC: Adding query filter params (role.id=8a5766c4aef44773834941d1bdbd1e98, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=e91f2584622a48bba21e1bf31c1aef30) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:02.354905 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc53da2-c69d-4ebd-8d78-09bf824cdb96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:02.356365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc53da2-c69d-4ebd-8d78-09bf824cdb96 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:02.364935 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 633/1260] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:46:02 2022] GET /identity/v3/role_assignments?user.id=e91f2584622a48bba21e1bf31c1aef30&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=8a5766c4aef44773834941d1bdbd1e98 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:04.334455 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daa039-01df-43cc-8ad2-2befb2c33201 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:04.334977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daa039-01df-43cc-8ad2-2befb2c33201 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:04.335068 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56daa039-01df-43cc-8ad2-2befb2c33201 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:04.337118 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 628/1261] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:46:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:46:04.342303 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006cae1-3214-46e5-a0be-9c755eda4747 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:04.342731 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006cae1-3214-46e5-a0be-9c755eda4747 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:04.342840 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006cae1-3214-46e5-a0be-9c755eda4747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:04.361989 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-6006cae1-3214-46e5-a0be-9c755eda4747 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:46:04.363184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-6006cae1-3214-46e5-a0be-9c755eda4747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:46:04.436925 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 634/1262] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:46:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:46:04.466231 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daa039-01df-43cc-8ad2-2befb2c33201 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:04.477184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:04.567685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56daa039-01df-43cc-8ad2-2befb2c33201 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:04.603911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522a0d2-3e67-46ec-bf84-d4b7819148da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:04.604510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522a0d2-3e67-46ec-bf84-d4b7819148da None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:04.604917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522a0d2-3e67-46ec-bf84-d4b7819148da None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:04.605191 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522a0d2-3e67-46ec-bf84-d4b7819148da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:04.619692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522a0d2-3e67-46ec-bf84-d4b7819148da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:46:04.624583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-6522a0d2-3e67-46ec-bf84-d4b7819148da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:46:04.624583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:04.624583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:46:04.624583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:46:04.624583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:46:04.624583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:46:04.624583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:46:04.624583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:46:04.624583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:46:04.624583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:46:04.624583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:46:04.624583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:46:04.624583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:46:04.624583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:46:04.624583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:46:04.624583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:46:04.625748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:46:04.625748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:46:04.625748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:46:04.625748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:46:04.625748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:46:04.625748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:46:04.625748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:46:04.625748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:46:04.625748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:46:04.625748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:46:04.625748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:46:04.625748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:46:04.625748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:46:04.625748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:46:04.625748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:46:04.625748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:46:04.626709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:46:04.626709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:46:04.626709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:46:04.626709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:46:04.626709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:46:04.626709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:46:04.626709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:46:04.626709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:46:04.626709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:46:04.626709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:46:04.626709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:46:04.626709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:46:04.626709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 629/1263] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:46:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:46:04.632144 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006cae1-3214-46e5-a0be-9c755eda4747 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:04.655126 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:04.765235 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006cae1-3214-46e5-a0be-9c755eda4747 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:04.809626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5ca04-1709-47ea-9eed-0e4e68bc4d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:04.810256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5ca04-1709-47ea-9eed-0e4e68bc4d3b None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:04.810536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5ca04-1709-47ea-9eed-0e4e68bc4d3b None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:04.810812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5ca04-1709-47ea-9eed-0e4e68bc4d3b None admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:04.811566 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5ca04-1709-47ea-9eed-0e4e68bc4d3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:04.811876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5ca04-1709-47ea-9eed-0e4e68bc4d3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:04.813251 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5ca04-1709-47ea-9eed-0e4e68bc4d3b None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:04.821872 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 635/1264] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:46:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:04.828194 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522a0d2-3e67-46ec-bf84-d4b7819148da None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:04.899651 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:04.935805 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522a0d2-3e67-46ec-bf84-d4b7819148da None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:04.972405 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ec619-e6d8-42be-b7b4-8d4248aa0ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:04.973067 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ec619-e6d8-42be-b7b4-8d4248aa0ac8 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:04.973350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ec619-e6d8-42be-b7b4-8d4248aa0ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:04.973770 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ec619-e6d8-42be-b7b4-8d4248aa0ac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:04.984469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ec619-e6d8-42be-b7b4-8d4248aa0ac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:04.985936 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ec619-e6d8-42be-b7b4-8d4248aa0ac8 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:05.002093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-cf2ec619-e6d8-42be-b7b4-8d4248aa0ac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:46:05.002093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:05.002093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:46:05.002093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:46:05.002093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:46:05.002093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:46:05.002093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:46:05.002093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:46:05.002093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:46:05.002093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:46:05.002093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:46:05.002093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:46:05.002093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:46:05.002093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:46:05.002093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:46:05.003071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:46:05.003071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:46:05.003071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:46:05.003071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:46:05.003071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:46:05.003071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:46:05.003071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:46:05.003071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:46:05.003071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:46:05.003071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:46:05.003071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:46:05.003071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:46:05.003071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:46:05.003071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:46:05.003071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:46:05.003071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:46:05.003071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:46:05.004136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:46:05.004136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:46:05.004136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:46:05.004136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:46:05.004136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 630/1265] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:46:05.009573 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5ca04-1709-47ea-9eed-0e4e68bc4d3b None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:05.101397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:05.122878 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5ca04-1709-47ea-9eed-0e4e68bc4d3b None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:05.163976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78041dd-5e98-4697-940f-75447946dea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:05.165283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78041dd-5e98-4697-940f-75447946dea7 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:05.165570 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78041dd-5e98-4697-940f-75447946dea7 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:05.165844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78041dd-5e98-4697-940f-75447946dea7 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:05.166542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78041dd-5e98-4697-940f-75447946dea7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:05.166848 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78041dd-5e98-4697-940f-75447946dea7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:05.169024 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78041dd-5e98-4697-940f-75447946dea7 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:05.185987 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 636/1266] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:05.191992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ec619-e6d8-42be-b7b4-8d4248aa0ac8 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:05.314183 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ec619-e6d8-42be-b7b4-8d4248aa0ac8 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:05.340437 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:05.354498 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71ce50-7cb1-420a-8c58-8b3b994bba26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:05.355140 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71ce50-7cb1-420a-8c58-8b3b994bba26 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:05.355462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71ce50-7cb1-420a-8c58-8b3b994bba26 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:05.355739 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71ce50-7cb1-420a-8c58-8b3b994bba26 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:05.363218 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71ce50-7cb1-420a-8c58-8b3b994bba26 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:05.366782 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71ce50-7cb1-420a-8c58-8b3b994bba26 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:05.376608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-2f71ce50-7cb1-420a-8c58-8b3b994bba26 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 03:46:05.376608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:05.376608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:46:05.376608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:46:05.376608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:46:05.376608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:46:05.376608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:46:05.376608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:46:05.376608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:46:05.376608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:46:05.376608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:46:05.376608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:46:05.376608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:46:05.376608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:46:05.376608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:46:05.376608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:46:05.377761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:46:05.377761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:46:05.377761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:46:05.377761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:46:05.377761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:46:05.377761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:46:05.377761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:46:05.377761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:46:05.377761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:46:05.377761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:46:05.377761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:46:05.377761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:46:05.377761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:46:05.377761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:46:05.377761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:46:05.377761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:46:05.377761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:46:05.377761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:46:05.378956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:46:05.378956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:46:05.378956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:46:05.378956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:46:05.378956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:46:05.378956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:46:05.378956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:46:05.378956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:46:05.378956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 03:46:05.378956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:46:05.378956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 631/1267] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:46:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:46:05.384474 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78041dd-5e98-4697-940f-75447946dea7 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:05.491924 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78041dd-5e98-4697-940f-75447946dea7 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:05.527054 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de98f6-dd0b-4dbb-8f12-7559d6724f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:05.527757 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de98f6-dd0b-4dbb-8f12-7559d6724f8d None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:05.528039 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de98f6-dd0b-4dbb-8f12-7559d6724f8d None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:05.528313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de98f6-dd0b-4dbb-8f12-7559d6724f8d None admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:05.529236 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de98f6-dd0b-4dbb-8f12-7559d6724f8d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:05.529776 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de98f6-dd0b-4dbb-8f12-7559d6724f8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:05.531222 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de98f6-dd0b-4dbb-8f12-7559d6724f8d None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:05.540340 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:05.548767 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 637/1268] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 28 03:46:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:05.554651 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71ce50-7cb1-420a-8c58-8b3b994bba26 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:05.655279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71ce50-7cb1-420a-8c58-8b3b994bba26 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:05.688627 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44cf58-eb99-4fd4-a99f-79db76b353cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:05.689264 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44cf58-eb99-4fd4-a99f-79db76b353cc None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:05.689549 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44cf58-eb99-4fd4-a99f-79db76b353cc None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:05.689825 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44cf58-eb99-4fd4-a99f-79db76b353cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:05.700299 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44cf58-eb99-4fd4-a99f-79db76b353cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:05.701748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44cf58-eb99-4fd4-a99f-79db76b353cc None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:05.715499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-1a44cf58-eb99-4fd4-a99f-79db76b353cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:46:05.715499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:05.715499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:46:05.715499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:46:05.715499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:46:05.715499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:46:05.715499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:46:05.715499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:46:05.715499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:46:05.715499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:46:05.715499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:46:05.715499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:46:05.715499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:46:05.715499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:46:05.715499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:46:05.718547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:46:05.718547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:46:05.718547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:46:05.718547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:46:05.718547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:46:05.718547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:46:05.718547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:46:05.718547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:46:05.718547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:46:05.718547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:46:05.718547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:46:05.718547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:46:05.718547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:46:05.718547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:46:05.718547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:46:05.718547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:46:05.718547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:46:05.719660 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:46:05.719660 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:46:05.719660 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:46:05.719660 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:46:05.719660 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 632/1269] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:46:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:46:05.722608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de98f6-dd0b-4dbb-8f12-7559d6724f8d None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:05.824774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de98f6-dd0b-4dbb-8f12-7559d6724f8d None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:05.858836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de036cb-06db-4f0b-8554-9b8c6cbef058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:05.859584 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de036cb-06db-4f0b-8554-9b8c6cbef058 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:05.859861 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de036cb-06db-4f0b-8554-9b8c6cbef058 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:05.860130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de036cb-06db-4f0b-8554-9b8c6cbef058 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:05.860824 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de036cb-06db-4f0b-8554-9b8c6cbef058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:05.861129 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de036cb-06db-4f0b-8554-9b8c6cbef058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:05.862495 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de036cb-06db-4f0b-8554-9b8c6cbef058 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:05.874316 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 638/1270] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:05.880004 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44cf58-eb99-4fd4-a99f-79db76b353cc None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:05.911712 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:05.979148 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44cf58-eb99-4fd4-a99f-79db76b353cc None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:06.012479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6aaaa1-c297-4da4-871c-77ee35d90d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:06.013114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6aaaa1-c297-4da4-871c-77ee35d90d0c None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:06.013394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6aaaa1-c297-4da4-871c-77ee35d90d0c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:06.013667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6aaaa1-c297-4da4-871c-77ee35d90d0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:06.020465 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6aaaa1-c297-4da4-871c-77ee35d90d0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:06.021957 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6aaaa1-c297-4da4-871c-77ee35d90d0c None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:06.035219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-fa6aaaa1-c297-4da4-871c-77ee35d90d0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:46:06.035219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:06.035219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:46:06.035219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:46:06.035219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:46:06.035219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:46:06.035219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:46:06.035219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:46:06.035219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:46:06.035219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:46:06.035219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:46:06.035219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:46:06.035219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:46:06.035219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:46:06.035219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:46:06.036307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:46:06.036307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:46:06.036307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:46:06.036307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:46:06.036307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:46:06.036307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:46:06.036307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:46:06.036307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:46:06.036307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:46:06.036307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:46:06.036307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:46:06.036307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:46:06.036307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:46:06.036307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:46:06.036307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:46:06.036307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:46:06.036307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:46:06.037407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:46:06.037407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:46:06.037407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:46:06.037407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:46:06.037407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:46:06.037407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:46:06.037407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:46:06.037407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:46:06.037407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 633/1271] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:46:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:46:06.042891 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de036cb-06db-4f0b-8554-9b8c6cbef058 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:06.101045 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:06.142001 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de036cb-06db-4f0b-8554-9b8c6cbef058 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:06.174533 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec17d0-19cd-48d6-ad7f-15bc5af70208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:06.175147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec17d0-19cd-48d6-ad7f-15bc5af70208 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:06.175455 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec17d0-19cd-48d6-ad7f-15bc5af70208 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:06.175728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec17d0-19cd-48d6-ad7f-15bc5af70208 None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:06.176468 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec17d0-19cd-48d6-ad7f-15bc5af70208 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:06.176772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec17d0-19cd-48d6-ad7f-15bc5af70208 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:06.178228 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec17d0-19cd-48d6-ad7f-15bc5af70208 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:06.190092 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 639/1272] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:46:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:06.196731 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6aaaa1-c297-4da4-871c-77ee35d90d0c None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:06.287046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:06.295619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6aaaa1-c297-4da4-871c-77ee35d90d0c None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:06.330260 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977bc35-8dc2-4b24-9ed4-0780f8c7770a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:06.330927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977bc35-8dc2-4b24-9ed4-0780f8c7770a None admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:06.331214 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977bc35-8dc2-4b24-9ed4-0780f8c7770a None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:06.331524 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977bc35-8dc2-4b24-9ed4-0780f8c7770a None admin] PATH_INFO: `/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/e91f2584622a48bba21e1bf31c1aef30/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:06.333457 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977bc35-8dc2-4b24-9ed4-0780f8c7770a None admin] RBAC: Authorizing `identity:create_grant(project_id=28b7995e83524b9293d1c6fc319e5a85, user_id=e91f2584622a48bba21e1bf31c1aef30, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:06.334986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977bc35-8dc2-4b24-9ed4-0780f8c7770a None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:06.426371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 634/1273] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 28 03:46:06 2022] PUT /identity/v3/projects/28b7995e83524b9293d1c6fc319e5a85/users/e91f2584622a48bba21e1bf31c1aef30/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:46:08.475332 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab32f8-1c9b-410d-a233-a5af9091fef2 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:08.475886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab32f8-1c9b-410d-a233-a5af9091fef2 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:08.475886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab32f8-1c9b-410d-a233-a5af9091fef2 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:08.478349 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 640/1274] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:46:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:46:08.483732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d1c46-6c06-4806-8b99-6a448c151564 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:08.484161 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d1c46-6c06-4806-8b99-6a448c151564 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:08.484273 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d1c46-6c06-4806-8b99-6a448c151564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:08.503126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-b03d1c46-6c06-4806-8b99-6a448c151564 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:46:08.504354 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b03d1c46-6c06-4806-8b99-6a448c151564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:46:08.572368 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 635/1275] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:46:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:46:08.595814 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab32f8-1c9b-410d-a233-a5af9091fef2 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:08.695966 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab32f8-1c9b-410d-a233-a5af9091fef2 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:08.713498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:08.729878 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc9c70-f058-48e8-be6f-26129063bee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:08.730461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc9c70-f058-48e8-be6f-26129063bee5 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:08.730740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc9c70-f058-48e8-be6f-26129063bee5 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:08.731015 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc9c70-f058-48e8-be6f-26129063bee5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:08.740761 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc9c70-f058-48e8-be6f-26129063bee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 03:46:08.746197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-e2cc9c70-f058-48e8-be6f-26129063bee5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:46:08.746197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:08.746197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:46:08.746197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:46:08.746197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:46:08.746197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:46:08.746197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:46:08.746197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:46:08.746197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:46:08.746197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:46:08.746197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:46:08.746197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:46:08.746197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 03:46:08.746197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 03:46:08.746197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 03:46:08.746197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 03:46:08.752993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 03:46:08.752993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 03:46:08.752993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 03:46:08.752993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 03:46:08.752993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:46:08.752993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:46:08.752993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:46:08.752993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:46:08.752993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:46:08.752993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:46:08.752993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:46:08.752993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:46:08.752993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:46:08.752993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:46:08.752993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:46:08.752993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:46:08.754224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:46:08.754224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:46:08.754224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:46:08.754224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:46:08.754224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 03:46:08.754224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 03:46:08.754224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 03:46:08.754224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 03:46:08.754224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 03:46:08.754224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 03:46:08.754224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 03:46:08.754224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:46:08.754224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 641/1276] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 28 03:46:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:46:08.755062 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d1c46-6c06-4806-8b99-6a448c151564 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:08.835707 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:08.853869 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d1c46-6c06-4806-8b99-6a448c151564 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:08.887863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e809b0-afd5-49b8-b1e1-ad8cda492c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:08.888474 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e809b0-afd5-49b8-b1e1-ad8cda492c22 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:08.888748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e809b0-afd5-49b8-b1e1-ad8cda492c22 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:08.889017 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e809b0-afd5-49b8-b1e1-ad8cda492c22 None admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:08.889722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e809b0-afd5-49b8-b1e1-ad8cda492c22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:08.890018 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e809b0-afd5-49b8-b1e1-ad8cda492c22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:08.891391 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e809b0-afd5-49b8-b1e1-ad8cda492c22 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:08.899746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 636/1277] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 28 03:46:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:08.914550 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc9c70-f058-48e8-be6f-26129063bee5 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:09.005509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc9c70-f058-48e8-be6f-26129063bee5 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:09.039207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca87b7-6c3c-4c22-8a48-35b24ab36c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:09.039871 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca87b7-6c3c-4c22-8a48-35b24ab36c0a None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:09.040151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca87b7-6c3c-4c22-8a48-35b24ab36c0a None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:09.040421 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca87b7-6c3c-4c22-8a48-35b24ab36c0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:09.050523 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca87b7-6c3c-4c22-8a48-35b24ab36c0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:09.052004 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca87b7-6c3c-4c22-8a48-35b24ab36c0a None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:09.066442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-43ca87b7-6c3c-4c22-8a48-35b24ab36c0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:46:09.066442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:09.066442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:46:09.066442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:46:09.066442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:46:09.066442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:46:09.066442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:46:09.066442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:46:09.066442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:46:09.066442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:46:09.066442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:46:09.066442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:46:09.066442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:46:09.066442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:46:09.066442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:46:09.068066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:46:09.068066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:46:09.068066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:46:09.068066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:46:09.068066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:46:09.068066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:46:09.068066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:46:09.068066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:46:09.068066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:46:09.068066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:46:09.068066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:46:09.068066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:46:09.068066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:46:09.068066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:46:09.068066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:46:09.068066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:46:09.068066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:46:09.068998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:46:09.068998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:46:09.068998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:46:09.068998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:46:09.068998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 642/1278] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:46:09.074351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e809b0-afd5-49b8-b1e1-ad8cda492c22 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:09.172158 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e809b0-afd5-49b8-b1e1-ad8cda492c22 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:09.206459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8d0d5-077e-475f-ba94-368fe6e6e697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:09.207080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8d0d5-077e-475f-ba94-368fe6e6e697 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:09.207387 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8d0d5-077e-475f-ba94-368fe6e6e697 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:09.207666 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8d0d5-077e-475f-ba94-368fe6e6e697 None admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:09.208361 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8d0d5-077e-475f-ba94-368fe6e6e697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:09.208667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8d0d5-077e-475f-ba94-368fe6e6e697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:09.210040 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8d0d5-077e-475f-ba94-368fe6e6e697 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:09.222256 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 637/1279] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:09.228565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca87b7-6c3c-4c22-8a48-35b24ab36c0a None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:09.259213 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:09.326457 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca87b7-6c3c-4c22-8a48-35b24ab36c0a None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:09.358977 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc2831-90a5-400c-a2ba-941d9bc55772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:09.359689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc2831-90a5-400c-a2ba-941d9bc55772 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:09.359971 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc2831-90a5-400c-a2ba-941d9bc55772 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:09.360241 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc2831-90a5-400c-a2ba-941d9bc55772 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:09.368113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc2831-90a5-400c-a2ba-941d9bc55772 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:09.369622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc2831-90a5-400c-a2ba-941d9bc55772 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:09.380717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-f3dc2831-90a5-400c-a2ba-941d9bc55772 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 03:46:09.380717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:09.380717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:46:09.380717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:46:09.380717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:46:09.380717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:46:09.380717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:46:09.380717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:46:09.380717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:46:09.380717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:46:09.380717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:46:09.380717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:46:09.380717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 03:46:09.380717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 03:46:09.380717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 03:46:09.380717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 03:46:09.381857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:46:09.381857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:46:09.381857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 03:46:09.381857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:46:09.381857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 03:46:09.381857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 03:46:09.381857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:46:09.381857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:46:09.381857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:46:09.381857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:46:09.381857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:46:09.381857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:46:09.381857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:46:09.381857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:46:09.381857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:46:09.381857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:46:09.381857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:46:09.381857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:46:09.383009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:46:09.383009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:46:09.383009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 03:46:09.383009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 03:46:09.383009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 03:46:09.383009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 03:46:09.383009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 03:46:09.383009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 03:46:09.383009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 03:46:09.383009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:46:09.383009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 643/1280] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:46:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:46:09.387753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8d0d5-077e-475f-ba94-368fe6e6e697 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:09.391514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:09.490656 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8d0d5-077e-475f-ba94-368fe6e6e697 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:09.527139 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbffbfa-87b9-45d7-aca2-45de69b56d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:09.527740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbffbfa-87b9-45d7-aca2-45de69b56d65 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:09.528023 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbffbfa-87b9-45d7-aca2-45de69b56d65 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:09.528302 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbffbfa-87b9-45d7-aca2-45de69b56d65 None admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:09.529097 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbffbfa-87b9-45d7-aca2-45de69b56d65 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:09.529403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbffbfa-87b9-45d7-aca2-45de69b56d65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:09.530833 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbffbfa-87b9-45d7-aca2-45de69b56d65 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:09.549112 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 638/1281] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 28 03:46:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:09.554153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc2831-90a5-400c-a2ba-941d9bc55772 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:09.644067 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:09.654528 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc2831-90a5-400c-a2ba-941d9bc55772 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:09.687902 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51742f-0eb6-41d7-a0e9-7e6b51e704c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:09.688551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51742f-0eb6-41d7-a0e9-7e6b51e704c0 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:09.688829 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51742f-0eb6-41d7-a0e9-7e6b51e704c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:09.689099 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51742f-0eb6-41d7-a0e9-7e6b51e704c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:09.755886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51742f-0eb6-41d7-a0e9-7e6b51e704c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:09.757367 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51742f-0eb6-41d7-a0e9-7e6b51e704c0 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:09.846580 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:09.857286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 644/1282] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 28 03:46:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 03:46:09.863344 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbffbfa-87b9-45d7-aca2-45de69b56d65 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:09.926595 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:09.965125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbffbfa-87b9-45d7-aca2-45de69b56d65 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:09.998027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b3e1b-2f4f-41ad-8c87-99b3948d168f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:09.998672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b3e1b-2f4f-41ad-8c87-99b3948d168f None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:09.998957 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b3e1b-2f4f-41ad-8c87-99b3948d168f None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:09.999236 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b3e1b-2f4f-41ad-8c87-99b3948d168f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:10.010513 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b3e1b-2f4f-41ad-8c87-99b3948d168f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:10.011986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b3e1b-2f4f-41ad-8c87-99b3948d168f None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:10.026198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-357b3e1b-2f4f-41ad-8c87-99b3948d168f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:46:10.026198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:10.026198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:46:10.026198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:46:10.026198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:46:10.026198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:46:10.026198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:46:10.026198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:46:10.026198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:46:10.026198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:46:10.026198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:46:10.026198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:46:10.026198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 03:46:10.026198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 03:46:10.026198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 03:46:10.027952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 03:46:10.027952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:46:10.027952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:46:10.027952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:46:10.027952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:46:10.027952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:46:10.027952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:46:10.027952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:46:10.027952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:46:10.027952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:46:10.027952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:46:10.027952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:46:10.027952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:46:10.027952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:46:10.027952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:46:10.027952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:46:10.027952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:46:10.029586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 03:46:10.029586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 03:46:10.029586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 03:46:10.029586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:46:10.029586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 639/1283] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:46:10.033436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51742f-0eb6-41d7-a0e9-7e6b51e704c0 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:10.133891 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51742f-0eb6-41d7-a0e9-7e6b51e704c0 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:10.168540 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720dda1-970d-4d44-9e95-7b42fc5c52c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:10.169153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720dda1-970d-4d44-9e95-7b42fc5c52c1 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:10.169435 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720dda1-970d-4d44-9e95-7b42fc5c52c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:10.169703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720dda1-970d-4d44-9e95-7b42fc5c52c1 None admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:10.170380 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720dda1-970d-4d44-9e95-7b42fc5c52c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:10.170678 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720dda1-970d-4d44-9e95-7b42fc5c52c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:10.172070 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720dda1-970d-4d44-9e95-7b42fc5c52c1 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:10.184160 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 645/1284] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 28 03:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:10.190192 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b3e1b-2f4f-41ad-8c87-99b3948d168f None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:10.290310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b3e1b-2f4f-41ad-8c87-99b3948d168f None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:10.303545 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:10.324002 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50095be3-0cb7-47b7-81c3-fcd0b71fa623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:10.324660 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50095be3-0cb7-47b7-81c3-fcd0b71fa623 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:10.324965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50095be3-0cb7-47b7-81c3-fcd0b71fa623 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:10.325256 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50095be3-0cb7-47b7-81c3-fcd0b71fa623 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:10.332016 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50095be3-0cb7-47b7-81c3-fcd0b71fa623 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:10.333459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50095be3-0cb7-47b7-81c3-fcd0b71fa623 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:10.344554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application [None req-50095be3-0cb7-47b7-81c3-fcd0b71fa623 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:46:10.344554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:10.344554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:46:10.344554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:46:10.344554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:46:10.344554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:46:10.344554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:46:10.344554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:46:10.344554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:46:10.344554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:46:10.344554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:46:10.344554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:46:10.344554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 03:46:10.344554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 03:46:10.344554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 03:46:10.348419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 03:46:10.348419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:46:10.348419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:46:10.348419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:46:10.348419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:46:10.348419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:46:10.348419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:46:10.348419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:46:10.348419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application with Lock( Jul 28 03:46:10.348419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:46:10.348419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:46:10.348419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:46:10.348419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:46:10.348419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:46:10.348419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:46:10.348419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:46:10.348419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:46:10.349327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 03:46:10.349327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 03:46:10.349327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 03:46:10.349327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 03:46:10.349327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 03:46:10.349327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 03:46:10.349327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 03:46:10.349327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: ERROR keystone.server.flask.application Jul 28 03:46:10.349327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 640/1285] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 28 03:46:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:46:10.351833 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720dda1-970d-4d44-9e95-7b42fc5c52c1 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:10.403977 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:10.452652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720dda1-970d-4d44-9e95-7b42fc5c52c1 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:10.485721 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159bfce-82da-44c8-90ef-6039f34d0a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:10.486341 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159bfce-82da-44c8-90ef-6039f34d0a84 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:10.486619 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159bfce-82da-44c8-90ef-6039f34d0a84 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:10.486891 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159bfce-82da-44c8-90ef-6039f34d0a84 None admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:10.487666 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159bfce-82da-44c8-90ef-6039f34d0a84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:10.487970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159bfce-82da-44c8-90ef-6039f34d0a84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:10.489402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159bfce-82da-44c8-90ef-6039f34d0a84 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:10.502121 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 646/1286] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 28 03:46:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:10.519048 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50095be3-0cb7-47b7-81c3-fcd0b71fa623 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:10.607714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50095be3-0cb7-47b7-81c3-fcd0b71fa623 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:10.641418 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ebb07-08fd-44e0-b46e-ed79ab14a55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:10.642036 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ebb07-08fd-44e0-b46e-ed79ab14a55c None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:10.642317 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ebb07-08fd-44e0-b46e-ed79ab14a55c None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:10.642592 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ebb07-08fd-44e0-b46e-ed79ab14a55c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:10.643412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ebb07-08fd-44e0-b46e-ed79ab14a55c None admin] RBAC: Adding query filter params (role.id=8a5766c4aef44773834941d1bdbd1e98, scope.project.id=28b7995e83524b9293d1c6fc319e5a85, user.id=e91f2584622a48bba21e1bf31c1aef30) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:10.643727 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ebb07-08fd-44e0-b46e-ed79ab14a55c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:10.645164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ebb07-08fd-44e0-b46e-ed79ab14a55c None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:10.651864 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 641/1287] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 28 03:46:10 2022] GET /identity/v3/role_assignments?user.id=e91f2584622a48bba21e1bf31c1aef30&scope.project.id=28b7995e83524b9293d1c6fc319e5a85&role.id=8a5766c4aef44773834941d1bdbd1e98 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:12.704249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256845c6-e630-4bb1-8119-d733edee1d05 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:12.704836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256845c6-e630-4bb1-8119-d733edee1d05 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:12.704836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256845c6-e630-4bb1-8119-d733edee1d05 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:12.706162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 647/1288] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:46:12.712057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b17653-b717-4551-a738-37693a5c05b9 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:12.712510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b17653-b717-4551-a738-37693a5c05b9 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:12.712791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b17653-b717-4551-a738-37693a5c05b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:12.731437 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-c4b17653-b717-4551-a738-37693a5c05b9 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:46:12.732638 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c4b17653-b717-4551-a738-37693a5c05b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:46:12.761572 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:12.799043 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 642/1289] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:46:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:46:12.820462 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256845c6-e630-4bb1-8119-d733edee1d05 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:12.920322 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256845c6-e630-4bb1-8119-d733edee1d05 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:12.932343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:12.954952 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded5323-4df4-4a04-b7d1-5df0cc711bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:12.955582 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5323-4df4-4a04-b7d1-5df0cc711bf7 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:12.955862 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5323-4df4-4a04-b7d1-5df0cc711bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:12.956133 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5323-4df4-4a04-b7d1-5df0cc711bf7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:12.956760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded5323-4df4-4a04-b7d1-5df0cc711bf7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:12.958117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded5323-4df4-4a04-b7d1-5df0cc711bf7 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:12.967130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-4ded5323-4df4-4a04-b7d1-5df0cc711bf7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 03:46:12.967130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:12.967130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:46:12.967130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:46:12.967130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:46:12.967130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:46:12.967130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:46:12.967130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:46:12.967130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 03:46:12.967130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:46:12.967130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:46:12.967130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:46:12.967130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:12.967130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:46:12.967130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:46:12.967130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:46:12.967130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:46:12.968243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:46:12.968243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:46:12.968243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:46:12.968243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:46:12.968243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:46:12.968243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:46:12.968243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:46:12.968243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:46:12.968243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:46:12.968243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:46:12.968243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:46:12.968243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:46:12.968243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:46:12.968243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:46:12.968243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:46:12.968243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:46:12.969167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:46:12.969167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:46:12.969167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:46:12.969167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:46:12.969167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:46:12.969167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:46:12.969167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:46:12.969167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:46:12.969167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:46:12.969167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:46:12.969167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:46:12.969167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:46:12.969167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 03:46:12.969167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:46:12.969167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 648/1290] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 28 03:46:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:46:12.974873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b17653-b717-4551-a738-37693a5c05b9 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:13.073167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b17653-b717-4551-a738-37693a5c05b9 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:13.106481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f2876-8afc-479b-a48c-4505695e24f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:13.107092 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f2876-8afc-479b-a48c-4505695e24f0 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:13.107407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f2876-8afc-479b-a48c-4505695e24f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:13.107680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f2876-8afc-479b-a48c-4505695e24f0 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:13.108353 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f2876-8afc-479b-a48c-4505695e24f0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:13.108655 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f2876-8afc-479b-a48c-4505695e24f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:13.109998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f2876-8afc-479b-a48c-4505695e24f0 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:13.114669 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 643/1291] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Jul 28 03:46:12 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:13.121270 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded5323-4df4-4a04-b7d1-5df0cc711bf7 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:13.220205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded5323-4df4-4a04-b7d1-5df0cc711bf7 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:13.254484 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645d588-b9c8-43f5-8e15-11bc36e84d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:13.255112 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645d588-b9c8-43f5-8e15-11bc36e84d0b None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:13.255425 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645d588-b9c8-43f5-8e15-11bc36e84d0b None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:13.255783 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645d588-b9c8-43f5-8e15-11bc36e84d0b None admin] PATH_INFO: `/v3/services` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:13.256457 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645d588-b9c8-43f5-8e15-11bc36e84d0b None admin] RBAC: Adding query filter params (type=placement) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:13.256768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645d588-b9c8-43f5-8e15-11bc36e84d0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:13.258162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645d588-b9c8-43f5-8e15-11bc36e84d0b None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:13.262744 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 649/1292] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Jul 28 03:46:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:15.254184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73846f-5ae4-4da4-9a85-63b33e46d41c None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:15.254755 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73846f-5ae4-4da4-9a85-63b33e46d41c None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:15.254755 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73846f-5ae4-4da4-9a85-63b33e46d41c None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:15.256125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 644/1293] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:46:15.261331 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249d96d-f034-4850-abb6-a0804f824ca5 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:15.261787 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249d96d-f034-4850-abb6-a0804f824ca5 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:15.261887 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249d96d-f034-4850-abb6-a0804f824ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:15.280809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-e249d96d-f034-4850-abb6-a0804f824ca5 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:46:15.282416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e249d96d-f034-4850-abb6-a0804f824ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:46:15.312206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:15.349610 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 650/1294] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:46:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:46:15.373496 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73846f-5ae4-4da4-9a85-63b33e46d41c None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:15.404389 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:15.472504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73846f-5ae4-4da4-9a85-63b33e46d41c None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:15.506175 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a32a5-f4a9-47f6-a427-19e9984ebe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:15.506730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a32a5-f4a9-47f6-a427-19e9984ebe16 None admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:15.507041 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a32a5-f4a9-47f6-a427-19e9984ebe16 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:15.507344 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a32a5-f4a9-47f6-a427-19e9984ebe16 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:15.508059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a32a5-f4a9-47f6-a427-19e9984ebe16 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:15.509658 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a32a5-f4a9-47f6-a427-19e9984ebe16 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:15.641685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 645/1295] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 28 03:46:15 2022] POST /identity/v3/services => generated 246 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:46:17.635245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24532239-ca8d-4aed-b929-7d02f7c1bfe7 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:17.635897 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24532239-ca8d-4aed-b929-7d02f7c1bfe7 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:17.635897 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24532239-ca8d-4aed-b929-7d02f7c1bfe7 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:17.637229 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 651/1296] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:46:17.642418 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4678e83-1b40-43f3-9c38-1c0563c283bf None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:17.642889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4678e83-1b40-43f3-9c38-1c0563c283bf None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:17.643032 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4678e83-1b40-43f3-9c38-1c0563c283bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:17.661227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-e4678e83-1b40-43f3-9c38-1c0563c283bf None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:46:17.662491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e4678e83-1b40-43f3-9c38-1c0563c283bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:46:17.734613 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 646/1297] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:46:17 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:46:17.756995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24532239-ca8d-4aed-b929-7d02f7c1bfe7 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:17.864758 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24532239-ca8d-4aed-b929-7d02f7c1bfe7 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:17.898402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec9f0d-baff-4bb1-933e-978891753aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:17.898977 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec9f0d-baff-4bb1-933e-978891753aa7 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:17.899251 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec9f0d-baff-4bb1-933e-978891753aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:17.899549 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec9f0d-baff-4bb1-933e-978891753aa7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:17.900429 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec9f0d-baff-4bb1-933e-978891753aa7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:17.902907 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec9f0d-baff-4bb1-933e-978891753aa7 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:17.911705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-c8ec9f0d-baff-4bb1-933e-978891753aa7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 03:46:17.911705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:17.911705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:46:17.911705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:46:17.911705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:46:17.911705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:46:17.911705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:46:17.911705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:46:17.911705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 03:46:17.911705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:46:17.911705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:46:17.911705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:46:17.911705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:17.911705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:46:17.911705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:46:17.911705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:46:17.911705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:46:17.912860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:46:17.912860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:46:17.912860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:46:17.912860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:46:17.912860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:46:17.912860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:46:17.912860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:46:17.912860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:46:17.912860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:46:17.912860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:46:17.912860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:46:17.912860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:46:17.912860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:46:17.912860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:46:17.912860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:46:17.912860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:46:17.913760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:46:17.913760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:46:17.913760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:46:17.913760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:46:17.913760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:46:17.913760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:46:17.913760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:46:17.913760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:46:17.913760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:46:17.913760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:46:17.913760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:46:17.913760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:46:17.913760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 03:46:17.913760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:46:17.913760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 652/1298] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 28 03:46:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:46:17.920532 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4678e83-1b40-43f3-9c38-1c0563c283bf None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:17.938592 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:18.017784 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4678e83-1b40-43f3-9c38-1c0563c283bf None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:18.051545 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c611642-3d2a-4710-a5c5-1a2583ae27c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:18.052178 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c611642-3d2a-4710-a5c5-1a2583ae27c2 None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:18.052446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c611642-3d2a-4710-a5c5-1a2583ae27c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:18.052718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c611642-3d2a-4710-a5c5-1a2583ae27c2 None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:18.053409 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c611642-3d2a-4710-a5c5-1a2583ae27c2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:18.053692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c611642-3d2a-4710-a5c5-1a2583ae27c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:18.055056 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c611642-3d2a-4710-a5c5-1a2583ae27c2 None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:18.060121 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 647/1299] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Jul 28 03:46:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:18.066257 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec9f0d-baff-4bb1-933e-978891753aa7 None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:18.099351 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:18.176081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec9f0d-baff-4bb1-933e-978891753aa7 None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:18.210071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62d98a-71b6-4595-a643-7a1a4eba4574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:18.210691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62d98a-71b6-4595-a643-7a1a4eba4574 None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:18.210970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62d98a-71b6-4595-a643-7a1a4eba4574 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:18.211240 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62d98a-71b6-4595-a643-7a1a4eba4574 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:18.212025 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62d98a-71b6-4595-a643-7a1a4eba4574 None admin] RBAC: Adding query filter params (interface=public, service_id=5ef9adc08c504fd39bd178e58140646f, region_id=RegionOne) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:18.212330 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62d98a-71b6-4595-a643-7a1a4eba4574 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:18.213737 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62d98a-71b6-4595-a643-7a1a4eba4574 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:18.219467 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 653/1300] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 28 03:46:18 2022] GET /identity/v3/endpoints?service_id=5ef9adc08c504fd39bd178e58140646f&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:18.225178 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c611642-3d2a-4710-a5c5-1a2583ae27c2 None admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:18.305226 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:18.321981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c611642-3d2a-4710-a5c5-1a2583ae27c2 None admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:18.354783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd4f99-a83e-40ce-b14d-f4b6d124b4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:18.355420 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd4f99-a83e-40ce-b14d-f4b6d124b4fb None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:18.355696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd4f99-a83e-40ce-b14d-f4b6d124b4fb None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:18.355972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd4f99-a83e-40ce-b14d-f4b6d124b4fb None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:18.356616 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd4f99-a83e-40ce-b14d-f4b6d124b4fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:18.357980 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd4f99-a83e-40ce-b14d-f4b6d124b4fb None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:18.364558 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 648/1301] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 28 03:46:18 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:46:20.384395 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d649b-887b-4878-adbc-e930f43f11ec None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:20.384970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d649b-887b-4878-adbc-e930f43f11ec None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:20.384970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d649b-887b-4878-adbc-e930f43f11ec None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:20.386849 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 654/1302] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:46:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:46:20.392002 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e84996-456e-4b8b-b8ee-1a2c9d3f88f6 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:20.392451 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e84996-456e-4b8b-b8ee-1a2c9d3f88f6 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:20.392587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e84996-456e-4b8b-b8ee-1a2c9d3f88f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:20.411590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-89e84996-456e-4b8b-b8ee-1a2c9d3f88f6 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:46:20.412767 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-89e84996-456e-4b8b-b8ee-1a2c9d3f88f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:46:20.479128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 649/1303] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:46:20 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 03:46:20.501102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d649b-887b-4878-adbc-e930f43f11ec None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:20.595136 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:20.601828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d649b-887b-4878-adbc-e930f43f11ec None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:20.634570 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab913c-bbbb-413b-be33-4a19470e24ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:20.635147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab913c-bbbb-413b-be33-4a19470e24ad None admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:20.635458 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab913c-bbbb-413b-be33-4a19470e24ad None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:20.636283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab913c-bbbb-413b-be33-4a19470e24ad None admin] PATH_INFO: `/v3/services/placement` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:20.637057 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab913c-bbbb-413b-be33-4a19470e24ad None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:20.638474 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab913c-bbbb-413b-be33-4a19470e24ad None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:20.647530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application [None req-67ab913c-bbbb-413b-be33-4a19470e24ad None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 03:46:20.647530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:20.647530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 03:46:20.647530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 03:46:20.647530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 03:46:20.647530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 03:46:20.647530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 03:46:20.647530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:46:20.647530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 03:46:20.647530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:46:20.647530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 03:46:20.647530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:46:20.647530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 03:46:20.647530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 03:46:20.647530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 03:46:20.647530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 03:46:20.647530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 03:46:20.648732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 03:46:20.648732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 03:46:20.648732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 03:46:20.648732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 03:46:20.648732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 03:46:20.648732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 03:46:20.648732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 03:46:20.648732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 03:46:20.648732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 03:46:20.648732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 03:46:20.648732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 03:46:20.648732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 03:46:20.648732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 03:46:20.648732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 03:46:20.648732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 03:46:20.648732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 03:46:20.649756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 03:46:20.649756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application with Lock( Jul 28 03:46:20.649756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 03:46:20.649756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self._enter() Jul 28 03:46:20.649756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 03:46:20.649756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 03:46:20.649756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 03:46:20.649756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application return self.creator() Jul 28 03:46:20.649756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 03:46:20.649756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application created_value = creator( Jul 28 03:46:20.649756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 03:46:20.649756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:46:20.649756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 03:46:20.649756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: ERROR keystone.server.flask.application Jul 28 03:46:20.649756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 655/1304] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 28 03:46:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 03:46:20.655884 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e84996-456e-4b8b-b8ee-1a2c9d3f88f6 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:20.733392 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:20.755613 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e84996-456e-4b8b-b8ee-1a2c9d3f88f6 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:20.792330 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e321c-98f0-4d6a-86c0-19e2aa6e331b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:20.793181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e321c-98f0-4d6a-86c0-19e2aa6e331b None admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:20.793464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e321c-98f0-4d6a-86c0-19e2aa6e331b None admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:20.793747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e321c-98f0-4d6a-86c0-19e2aa6e331b None admin] PATH_INFO: `/v3/services` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:20.794426 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e321c-98f0-4d6a-86c0-19e2aa6e331b None admin] RBAC: Adding query filter params (name=placement) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:46:20.794731 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e321c-98f0-4d6a-86c0-19e2aa6e331b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:20.796135 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e321c-98f0-4d6a-86c0-19e2aa6e331b None admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:20.801265 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 650/1305] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Jul 28 03:46:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:46:20.807057 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab913c-bbbb-413b-be33-4a19470e24ad None admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:46:20.908902 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab913c-bbbb-413b-be33-4a19470e24ad None admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:46:20.941361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6215bf1-4864-48c1-a3fa-66e8b66bde25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:46:20.941971 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6215bf1-4864-48c1-a3fa-66e8b66bde25 None admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:46:20.942248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6215bf1-4864-48c1-a3fa-66e8b66bde25 None admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:46:20.942518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6215bf1-4864-48c1-a3fa-66e8b66bde25 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:46:20.943229 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6215bf1-4864-48c1-a3fa-66e8b66bde25 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:46:20.944615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6215bf1-4864-48c1-a3fa-66e8b66bde25 None admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:46:21.047466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 656/1306] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 03:46:20 2022] POST /identity/v3/endpoints => generated 331 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 03:46:30.840925 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=30 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:31.042231 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:26.848768 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9a6a8-b103-4423-8bae-7462f439c991 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:26.849339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9a6a8-b103-4423-8bae-7462f439c991 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:26.849339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9a6a8-b103-4423-8bae-7462f439c991 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:26.855835 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a121ed6-9e43-40b5-bbc6-2db48ea8b6b3 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:26.856328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a121ed6-9e43-40b5-bbc6-2db48ea8b6b3 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:26.856412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a121ed6-9e43-40b5-bbc6-2db48ea8b6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:26.862168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 651/1307] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:53:26 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:53:26.954329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-2a121ed6-9e43-40b5-bbc6-2db48ea8b6b3 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:53:26.955797 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-2a121ed6-9e43-40b5-bbc6-2db48ea8b6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:27.107345 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 657/1308] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:53:27.151569 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149f9a9-5e30-4401-8c91-09737df3133f None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:27.151859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149f9a9-5e30-4401-8c91-09737df3133f None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:27.152220 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149f9a9-5e30-4401-8c91-09737df3133f None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:27.154046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 652/1309] 10.222.0.64 () {54 vars in 965 bytes} [Thu Jul 28 03:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:53:27.161395 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5084cf-bf40-47c3-918e-7667590092b0 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:27.161685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5084cf-bf40-47c3-918e-7667590092b0 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:27.161968 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5084cf-bf40-47c3-918e-7667590092b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:27.254573 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-3b5084cf-bf40-47c3-918e-7667590092b0 None None] MFA Rules not processed for user `03742c23cae849d9bf4ce0b432edd1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:53:27.256264 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-3b5084cf-bf40-47c3-918e-7667590092b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:27.286285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:27.350254 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 658/1310] 10.222.0.64 () {58 vars in 1062 bytes} [Thu Jul 28 03:53:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:53:27.360652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149f9a9-5e30-4401-8c91-09737df3133f None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:53:27.362404 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-1149f9a9-5e30-4401-8c91-09737df3133f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:27.499253 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149f9a9-5e30-4401-8c91-09737df3133f None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:53:27.607173 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc77286-baf5-4767-a4eb-2e25808435a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:53:27.607852 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc77286-baf5-4767-a4eb-2e25808435a2 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:27.608132 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc77286-baf5-4767-a4eb-2e25808435a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:27.608403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc77286-baf5-4767-a4eb-2e25808435a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:27.610431 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9bc77286-baf5-4767-a4eb-2e25808435a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:27.676846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:27.741705 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc77286-baf5-4767-a4eb-2e25808435a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:53:27.743158 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc77286-baf5-4767-a4eb-2e25808435a2 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:53:27.769293 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 653/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:53:30.121640 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785a819-ea1b-4fca-85aa-d3e17fe1964c None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:30.122283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785a819-ea1b-4fca-85aa-d3e17fe1964c None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:30.122283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785a819-ea1b-4fca-85aa-d3e17fe1964c None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:30.123863 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 659/1312] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:53:30.130290 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5163ca1-1023-47e6-8d5a-78e63f2ecae8 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:30.130853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5163ca1-1023-47e6-8d5a-78e63f2ecae8 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:30.130853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5163ca1-1023-47e6-8d5a-78e63f2ecae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:30.225829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-b5163ca1-1023-47e6-8d5a-78e63f2ecae8 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:53:30.227058 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b5163ca1-1023-47e6-8d5a-78e63f2ecae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:30.333609 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 654/1313] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:53:30.389092 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e563dfe-16c9-4aa2-876e-96d897a3e609 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:30.389278 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e563dfe-16c9-4aa2-876e-96d897a3e609 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:30.389559 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e563dfe-16c9-4aa2-876e-96d897a3e609 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:30.391597 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 660/1314] 10.222.0.64 () {54 vars in 965 bytes} [Thu Jul 28 03:53:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:53:30.398422 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218c166-c549-4354-a7a7-121f386541ca None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:30.398761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218c166-c549-4354-a7a7-121f386541ca None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:30.399007 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218c166-c549-4354-a7a7-121f386541ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:30.410796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:30.491021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-e218c166-c549-4354-a7a7-121f386541ca None None] MFA Rules not processed for user `03742c23cae849d9bf4ce0b432edd1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:53:30.492425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e218c166-c549-4354-a7a7-121f386541ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:30.580261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 655/1315] 10.222.0.64 () {58 vars in 1062 bytes} [Thu Jul 28 03:53:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:53:30.590342 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e563dfe-16c9-4aa2-876e-96d897a3e609 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:53:30.591920 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-2e563dfe-16c9-4aa2-876e-96d897a3e609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:30.703540 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e563dfe-16c9-4aa2-876e-96d897a3e609 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:53:30.776156 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:30.779669 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284b6a7-67e6-4871-bde8-5491b83614cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:53:30.780323 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284b6a7-67e6-4871-bde8-5491b83614cc service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:30.780757 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284b6a7-67e6-4871-bde8-5491b83614cc service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:30.781653 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284b6a7-67e6-4871-bde8-5491b83614cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:30.783388 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-8284b6a7-67e6-4871-bde8-5491b83614cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:30.903112 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284b6a7-67e6-4871-bde8-5491b83614cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:53:30.904601 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284b6a7-67e6-4871-bde8-5491b83614cc service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:53:30.925274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 661/1316] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:53:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:53:33.869356 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312495c3-9cde-41c6-9d55-e4a088ce99fc None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:33.869943 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312495c3-9cde-41c6-9d55-e4a088ce99fc None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:33.869943 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312495c3-9cde-41c6-9d55-e4a088ce99fc None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:33.871286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 656/1317] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:53:33.877545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fabd74-f2d2-4e2f-aec7-c3c208c06bc0 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:33.878048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fabd74-f2d2-4e2f-aec7-c3c208c06bc0 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:33.878147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fabd74-f2d2-4e2f-aec7-c3c208c06bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:33.944178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-19fabd74-f2d2-4e2f-aec7-c3c208c06bc0 None None] MFA Rules not processed for user `427345877d57430294ac22048db4a8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:53:33.945413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-19fabd74-f2d2-4e2f-aec7-c3c208c06bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:33.996808 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:34.043671 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 662/1318] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:53:33 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:53:34.084538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312495c3-9cde-41c6-9d55-e4a088ce99fc None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:53:34.086078 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-312495c3-9cde-41c6-9d55-e4a088ce99fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:34.192780 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312495c3-9cde-41c6-9d55-e4a088ce99fc None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:53:34.196090 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:34.270535 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b69ac-37a7-4960-bfce-018984f63868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:53:34.271159 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b69ac-37a7-4960-bfce-018984f63868 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:34.271476 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b69ac-37a7-4960-bfce-018984f63868 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:34.271757 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b69ac-37a7-4960-bfce-018984f63868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:34.273412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9d2b69ac-37a7-4960-bfce-018984f63868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:34.381542 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b69ac-37a7-4960-bfce-018984f63868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:53:34.382985 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b69ac-37a7-4960-bfce-018984f63868 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:53:34.401700 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 657/1319] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:53:34 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:53:37.259224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85022ff4-46ac-49b4-92fa-e624beb38ed4 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:37.259858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85022ff4-46ac-49b4-92fa-e624beb38ed4 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:37.259858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85022ff4-46ac-49b4-92fa-e624beb38ed4 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:37.261197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 663/1320] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:53:37.267403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2709d-052c-437c-acd1-db5382d71308 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:37.267903 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2709d-052c-437c-acd1-db5382d71308 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:37.268004 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2709d-052c-437c-acd1-db5382d71308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:37.313479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:37.344610 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-51e2709d-052c-437c-acd1-db5382d71308 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:53:37.345875 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-51e2709d-052c-437c-acd1-db5382d71308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:37.446885 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 658/1321] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:53:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:53:37.486471 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85022ff4-46ac-49b4-92fa-e624beb38ed4 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:53:37.488121 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-85022ff4-46ac-49b4-92fa-e624beb38ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:37.599231 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85022ff4-46ac-49b4-92fa-e624beb38ed4 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:53:37.677718 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285f77e-146a-4c5d-ba7c-645fb419912e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:53:37.678352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285f77e-146a-4c5d-ba7c-645fb419912e service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:37.678632 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285f77e-146a-4c5d-ba7c-645fb419912e service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:37.678906 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285f77e-146a-4c5d-ba7c-645fb419912e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:37.680603 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-7285f77e-146a-4c5d-ba7c-645fb419912e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:37.689569 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:37.798818 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285f77e-146a-4c5d-ba7c-645fb419912e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:53:37.800306 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285f77e-146a-4c5d-ba7c-645fb419912e service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:53:37.819783 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 664/1322] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:53:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:53:40.961465 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d204b5-e0d3-468e-be50-22eb03420cff None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:40.962058 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d204b5-e0d3-468e-be50-22eb03420cff None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:40.962058 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d204b5-e0d3-468e-be50-22eb03420cff None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:40.963294 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 659/1323] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:53:40.968821 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b88c31-8215-4a6d-bc82-3496ac231275 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:40.969333 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b88c31-8215-4a6d-bc82-3496ac231275 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:40.969439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b88c31-8215-4a6d-bc82-3496ac231275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:41.044248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-82b88c31-8215-4a6d-bc82-3496ac231275 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:53:41.045411 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-82b88c31-8215-4a6d-bc82-3496ac231275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:41.107800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:41.149307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 665/1324] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:53:41.186628 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d204b5-e0d3-468e-be50-22eb03420cff None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:53:41.189025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-69d204b5-e0d3-468e-be50-22eb03420cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:41.302072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d204b5-e0d3-468e-be50-22eb03420cff None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:53:41.317986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:41.391680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0765ce-56cb-4a51-bd5e-4847a085c80f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:53:41.392321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0765ce-56cb-4a51-bd5e-4847a085c80f service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:41.392608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0765ce-56cb-4a51-bd5e-4847a085c80f service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:41.392886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0765ce-56cb-4a51-bd5e-4847a085c80f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:41.394897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-8b0765ce-56cb-4a51-bd5e-4847a085c80f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:41.568180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0765ce-56cb-4a51-bd5e-4847a085c80f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:53:41.569581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0765ce-56cb-4a51-bd5e-4847a085c80f service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:53:41.591105 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 660/1325] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:53:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:53:43.996017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8983cd-0ea1-466a-8a1b-6d329a298c78 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:43.996548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8983cd-0ea1-466a-8a1b-6d329a298c78 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:43.996548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8983cd-0ea1-466a-8a1b-6d329a298c78 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:43.997922 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 666/1326] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:53:44.003993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc3c6d-6541-49d3-a6c3-7772d03adb73 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:44.004428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc3c6d-6541-49d3-a6c3-7772d03adb73 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:44.004680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc3c6d-6541-49d3-a6c3-7772d03adb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:44.054072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:44.073904 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-f5cc3c6d-6541-49d3-a6c3-7772d03adb73 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:53:44.075166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f5cc3c6d-6541-49d3-a6c3-7772d03adb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:44.175210 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 661/1327] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:53:44.211808 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8983cd-0ea1-466a-8a1b-6d329a298c78 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:53:44.213997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-2b8983cd-0ea1-466a-8a1b-6d329a298c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:44.320818 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8983cd-0ea1-466a-8a1b-6d329a298c78 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:53:44.393375 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5735b9-8dc7-4201-ae8c-e304dd7fd562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:53:44.394007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5735b9-8dc7-4201-ae8c-e304dd7fd562 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:44.394542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5735b9-8dc7-4201-ae8c-e304dd7fd562 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:44.394819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5735b9-8dc7-4201-ae8c-e304dd7fd562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:44.396477 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-0b5735b9-8dc7-4201-ae8c-e304dd7fd562 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:44.414331 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:44.507667 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5735b9-8dc7-4201-ae8c-e304dd7fd562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:53:44.509134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5735b9-8dc7-4201-ae8c-e304dd7fd562 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:53:44.528228 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 667/1328] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:53:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:53:46.625978 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e023d-ec22-4379-b2c5-e0c5da6a44f2 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:46.626541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e023d-ec22-4379-b2c5-e0c5da6a44f2 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:46.626541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e023d-ec22-4379-b2c5-e0c5da6a44f2 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:46.627907 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 662/1329] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:53:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:53:46.633161 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4251f-51f1-4836-b398-c33d5deae144 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:46.633614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4251f-51f1-4836-b398-c33d5deae144 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:46.633715 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4251f-51f1-4836-b398-c33d5deae144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:46.705382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-e2a4251f-51f1-4836-b398-c33d5deae144 None None] MFA Rules not processed for user `427345877d57430294ac22048db4a8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:53:46.706619 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e2a4251f-51f1-4836-b398-c33d5deae144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:46.786583 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:46.843693 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 668/1330] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:53:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:53:46.903840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e023d-ec22-4379-b2c5-e0c5da6a44f2 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:53:46.905903 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-972e023d-ec22-4379-b2c5-e0c5da6a44f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:47.018597 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e023d-ec22-4379-b2c5-e0c5da6a44f2 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:53:47.040652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:47.104609 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac88f2a-737c-4695-b29e-f4088365bef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:53:47.105226 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac88f2a-737c-4695-b29e-f4088365bef1 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:47.105499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac88f2a-737c-4695-b29e-f4088365bef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:47.105769 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac88f2a-737c-4695-b29e-f4088365bef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:47.107427 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-fac88f2a-737c-4695-b29e-f4088365bef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:47.222875 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac88f2a-737c-4695-b29e-f4088365bef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:53:47.224364 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac88f2a-737c-4695-b29e-f4088365bef1 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:53:47.243592 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 663/1331] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:53:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:53:49.856677 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d4af9-5591-4d3e-a37a-807755b43f0d None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:49.857252 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d4af9-5591-4d3e-a37a-807755b43f0d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:49.857252 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d4af9-5591-4d3e-a37a-807755b43f0d None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:49.858778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 669/1332] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:53:49.864210 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ba615-d181-4d4e-b482-c406de599952 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:49.864610 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ba615-d181-4d4e-b482-c406de599952 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:49.864769 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ba615-d181-4d4e-b482-c406de599952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:49.931700 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:49.934721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-156ba615-d181-4d4e-b482-c406de599952 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:53:49.935962 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-156ba615-d181-4d4e-b482-c406de599952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:50.035768 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 664/1333] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:53:50.074095 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d4af9-5591-4d3e-a37a-807755b43f0d None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:53:50.075689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-7d3d4af9-5591-4d3e-a37a-807755b43f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:50.178475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d4af9-5591-4d3e-a37a-807755b43f0d None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:53:50.250730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a690b2-c238-4f99-9b0b-0dfc0d9e94ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:53:50.251376 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a690b2-c238-4f99-9b0b-0dfc0d9e94ee service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:50.251656 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a690b2-c238-4f99-9b0b-0dfc0d9e94ee service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:50.251925 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a690b2-c238-4f99-9b0b-0dfc0d9e94ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:50.253539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-17a690b2-c238-4f99-9b0b-0dfc0d9e94ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:50.279536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:50.360001 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a690b2-c238-4f99-9b0b-0dfc0d9e94ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:53:50.361458 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a690b2-c238-4f99-9b0b-0dfc0d9e94ee service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:53:50.380547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 670/1334] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:53:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:53:52.478663 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329918f1-508d-4d72-b319-f55f68a2fae6 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:52.479130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329918f1-508d-4d72-b319-f55f68a2fae6 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:52.479237 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329918f1-508d-4d72-b319-f55f68a2fae6 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:52.480619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 665/1335] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:53:52.485901 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a376dac-ad69-4025-824f-e8cdc1bc0488 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:52.486351 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a376dac-ad69-4025-824f-e8cdc1bc0488 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:52.486456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a376dac-ad69-4025-824f-e8cdc1bc0488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:52.554207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-4a376dac-ad69-4025-824f-e8cdc1bc0488 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:53:52.555444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-4a376dac-ad69-4025-824f-e8cdc1bc0488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:52.631037 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:52.654953 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 671/1336] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:53:52.695683 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329918f1-508d-4d72-b319-f55f68a2fae6 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:53:52.697258 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-329918f1-508d-4d72-b319-f55f68a2fae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:52.804249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329918f1-508d-4d72-b319-f55f68a2fae6 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:53:52.833794 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:52.880983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286e6bb-8617-4595-8173-8e6d036f568b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:53:52.881593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286e6bb-8617-4595-8173-8e6d036f568b service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:52.881873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286e6bb-8617-4595-8173-8e6d036f568b service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:52.882144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286e6bb-8617-4595-8173-8e6d036f568b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:52.883799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e286e6bb-8617-4595-8173-8e6d036f568b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:52.994559 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286e6bb-8617-4595-8173-8e6d036f568b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:53:52.996019 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286e6bb-8617-4595-8173-8e6d036f568b service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:53:53.016303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 666/1337] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:53:55.967956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f138d-0d43-475b-8d96-43cfa9f63c7a None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:55.968510 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f138d-0d43-475b-8d96-43cfa9f63c7a None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:55.968716 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f138d-0d43-475b-8d96-43cfa9f63c7a None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:55.970252 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 672/1338] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:53:55.975555 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71057320-97ba-4af9-bb00-70ee3b46f9e1 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:55.976189 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71057320-97ba-4af9-bb00-70ee3b46f9e1 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:55.976189 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71057320-97ba-4af9-bb00-70ee3b46f9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:56.046201 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-71057320-97ba-4af9-bb00-70ee3b46f9e1 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:53:56.047480 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-71057320-97ba-4af9-bb00-70ee3b46f9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:56.056203 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:56.151387 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 667/1339] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:53:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:53:56.189077 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f138d-0d43-475b-8d96-43cfa9f63c7a None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:53:56.190623 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-db1f138d-0d43-475b-8d96-43cfa9f63c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:56.292683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f138d-0d43-475b-8d96-43cfa9f63c7a None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:53:56.365128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b62606-65df-4320-8b83-a4efc13c6e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:53:56.365665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b62606-65df-4320-8b83-a4efc13c6e01 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:53:56.365944 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b62606-65df-4320-8b83-a4efc13c6e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:53:56.366217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b62606-65df-4320-8b83-a4efc13c6e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:53:56.367897 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c9b62606-65df-4320-8b83-a4efc13c6e01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:53:56.403365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:56.477608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b62606-65df-4320-8b83-a4efc13c6e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:53:56.479052 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b62606-65df-4320-8b83-a4efc13c6e01 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:53:56.498157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 673/1340] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:53:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:00.848183 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cca9a-3192-4a78-9a16-90c9f05f1934 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:00.849069 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cca9a-3192-4a78-9a16-90c9f05f1934 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:00.849413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cca9a-3192-4a78-9a16-90c9f05f1934 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:00.851019 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 668/1341] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:54:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:00.856912 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fa0ef-ede1-43a1-a1c6-95421d928b2a None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:00.857414 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fa0ef-ede1-43a1-a1c6-95421d928b2a None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:00.857414 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fa0ef-ede1-43a1-a1c6-95421d928b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:00.955609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-8d1fa0ef-ede1-43a1-a1c6-95421d928b2a None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:00.968799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-8d1fa0ef-ede1-43a1-a1c6-95421d928b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:01.052252 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:01.065648 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 674/1342] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:01.107672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845cca9a-3192-4a78-9a16-90c9f05f1934 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:01.110548 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-845cca9a-3192-4a78-9a16-90c9f05f1934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:01.238058 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845cca9a-3192-4a78-9a16-90c9f05f1934 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:01.278197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:01.315280 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f70ae-45f7-4c13-8a96-60978a7a60ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:01.315924 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f70ae-45f7-4c13-8a96-60978a7a60ea service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:01.316201 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f70ae-45f7-4c13-8a96-60978a7a60ea service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:01.316469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f70ae-45f7-4c13-8a96-60978a7a60ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:01.318086 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-329f70ae-45f7-4c13-8a96-60978a7a60ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:01.430468 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f70ae-45f7-4c13-8a96-60978a7a60ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:01.431937 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f70ae-45f7-4c13-8a96-60978a7a60ea service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:01.450717 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 669/1343] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:54:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:04.655865 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37842253-1bd7-4b72-af09-d314ecb161e7 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:04.656394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37842253-1bd7-4b72-af09-d314ecb161e7 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:04.656394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37842253-1bd7-4b72-af09-d314ecb161e7 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:04.657996 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 675/1344] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:54:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:04.663360 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512a003-2812-460c-9d61-62399b11eabe None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:04.663829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512a003-2812-460c-9d61-62399b11eabe None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:04.663946 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512a003-2812-460c-9d61-62399b11eabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:04.734660 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-7512a003-2812-460c-9d61-62399b11eabe None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:04.735916 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-7512a003-2812-460c-9d61-62399b11eabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:04.754774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:04.842945 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 670/1345] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:54:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:04.880745 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37842253-1bd7-4b72-af09-d314ecb161e7 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:04.882324 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-37842253-1bd7-4b72-af09-d314ecb161e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:04.995346 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37842253-1bd7-4b72-af09-d314ecb161e7 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:05.085117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb517d-449b-4c3f-a6e4-de4123a210a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:05.086021 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb517d-449b-4c3f-a6e4-de4123a210a2 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:05.086297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb517d-449b-4c3f-a6e4-de4123a210a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:05.086567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb517d-449b-4c3f-a6e4-de4123a210a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:05.088256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-acbb517d-449b-4c3f-a6e4-de4123a210a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:05.133223 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:05.204555 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb517d-449b-4c3f-a6e4-de4123a210a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:05.206093 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb517d-449b-4c3f-a6e4-de4123a210a2 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:05.226836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 676/1346] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:54:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:09.664804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77ca66-2a55-458a-ad4f-872b6ffac09d None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:09.665406 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77ca66-2a55-458a-ad4f-872b6ffac09d None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:09.665511 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77ca66-2a55-458a-ad4f-872b6ffac09d None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:09.666985 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 671/1347] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:09.673295 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e8177-4c87-4949-ae6e-87d420fd4811 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:09.674046 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e8177-4c87-4949-ae6e-87d420fd4811 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:09.674046 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e8177-4c87-4949-ae6e-87d420fd4811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:09.747432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-4a4e8177-4c87-4949-ae6e-87d420fd4811 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:09.749940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-4a4e8177-4c87-4949-ae6e-87d420fd4811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:09.864436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:09.867000 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 677/1348] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:09.906690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77ca66-2a55-458a-ad4f-872b6ffac09d None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:09.908425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-3c77ca66-2a55-458a-ad4f-872b6ffac09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:10.026828 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77ca66-2a55-458a-ad4f-872b6ffac09d None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:10.078903 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:10.105369 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2808b-d51a-4764-ad67-aedbd3010e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:10.105991 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2808b-d51a-4764-ad67-aedbd3010e94 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:10.106271 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2808b-d51a-4764-ad67-aedbd3010e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:10.106545 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2808b-d51a-4764-ad67-aedbd3010e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:10.108298 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-eec2808b-d51a-4764-ad67-aedbd3010e94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:10.220674 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2808b-d51a-4764-ad67-aedbd3010e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:10.222142 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2808b-d51a-4764-ad67-aedbd3010e94 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:10.241561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 672/1349] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:54:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:15.300691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1292c8-3784-41ac-a203-f01ca51570e7 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:15.301089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1292c8-3784-41ac-a203-f01ca51570e7 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:15.301311 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1292c8-3784-41ac-a203-f01ca51570e7 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:15.309887 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 678/1350] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 28 03:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:15.312336 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c826d6-5364-4046-93ba-979a36915258 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:15.312336 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c826d6-5364-4046-93ba-979a36915258 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:15.312336 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c826d6-5364-4046-93ba-979a36915258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:15.418312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-f3c826d6-5364-4046-93ba-979a36915258 None None] MFA Rules not processed for user `e91f2584622a48bba21e1bf31c1aef30`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:15.420480 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f3c826d6-5364-4046-93ba-979a36915258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:15.452722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:15.586914 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 673/1351] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 28 03:54:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:19.788967 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ffc3c-b5f2-4cf1-b9f3-75a3bd06b476 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:19.789873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ffc3c-b5f2-4cf1-b9f3-75a3bd06b476 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:19.790377 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ffc3c-b5f2-4cf1-b9f3-75a3bd06b476 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:19.792065 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 679/1352] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 28 03:54:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:19.797518 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf550b5-201d-4afd-836d-a0a2e2c3748d None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:19.797976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf550b5-201d-4afd-836d-a0a2e2c3748d None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:19.798061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf550b5-201d-4afd-836d-a0a2e2c3748d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:19.886693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-9bf550b5-201d-4afd-836d-a0a2e2c3748d None None] MFA Rules not processed for user `e91f2584622a48bba21e1bf31c1aef30`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:19.888100 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9bf550b5-201d-4afd-836d-a0a2e2c3748d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:19.969722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:20.016201 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 674/1353] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 28 03:54:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:21.526115 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfe968-0d73-4a4f-883c-2f152fa96a61 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:21.527294 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfe968-0d73-4a4f-883c-2f152fa96a61 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:21.527294 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfe968-0d73-4a4f-883c-2f152fa96a61 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:21.528584 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 680/1354] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 28 03:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:21.533791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735bf2d-57bc-40bf-bee2-8d76f608afc8 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:21.534280 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735bf2d-57bc-40bf-bee2-8d76f608afc8 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:21.534360 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735bf2d-57bc-40bf-bee2-8d76f608afc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:21.616579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-a735bf2d-57bc-40bf-bee2-8d76f608afc8 None None] MFA Rules not processed for user `e91f2584622a48bba21e1bf31c1aef30`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:21.617815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a735bf2d-57bc-40bf-bee2-8d76f608afc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:21.734204 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 675/1355] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 28 03:54:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:25.247284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b538356-d9c2-4538-8fbb-23f584e9e6f3 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:25.248476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b538356-d9c2-4538-8fbb-23f584e9e6f3 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:25.248476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b538356-d9c2-4538-8fbb-23f584e9e6f3 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:25.249789 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 681/1356] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:25.255120 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96203f-4372-4098-85d7-12cae86de707 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:25.255609 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96203f-4372-4098-85d7-12cae86de707 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:25.255873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96203f-4372-4098-85d7-12cae86de707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:25.305553 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:25.345877 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-bf96203f-4372-4098-85d7-12cae86de707 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:25.347623 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-bf96203f-4372-4098-85d7-12cae86de707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:25.481287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 676/1357] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:25.539915 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069f10b-2249-4933-8efb-235ef29b77c8 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:25.540556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069f10b-2249-4933-8efb-235ef29b77c8 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:25.540990 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069f10b-2249-4933-8efb-235ef29b77c8 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:25.543066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 682/1358] 10.222.0.64 () {54 vars in 962 bytes} [Thu Jul 28 03:54:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:25.552734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a172e-5c1d-4334-a547-4b6beaa6fc9b None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:25.553696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a172e-5c1d-4334-a547-4b6beaa6fc9b None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:25.557440 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a172e-5c1d-4334-a547-4b6beaa6fc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:25.661557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-240a172e-5c1d-4334-a547-4b6beaa6fc9b None None] MFA Rules not processed for user `5133abf4c32a45b0b2188f71496c572b`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:25.662786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-240a172e-5c1d-4334-a547-4b6beaa6fc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:25.724978 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:25.803473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 677/1359] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Jul 28 03:54:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:25.808454 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069f10b-2249-4933-8efb-235ef29b77c8 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:25.811825 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f069f10b-2249-4933-8efb-235ef29b77c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:25.991782 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069f10b-2249-4933-8efb-235ef29b77c8 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:26.080322 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:26.124030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bc009-1d3d-488c-bd81-24273f76ea33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:26.125125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bc009-1d3d-488c-bd81-24273f76ea33 service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:26.125788 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bc009-1d3d-488c-bd81-24273f76ea33 service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:26.126067 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bc009-1d3d-488c-bd81-24273f76ea33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:26.128002 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ec7bc009-1d3d-488c-bd81-24273f76ea33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:26.226122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bc009-1d3d-488c-bd81-24273f76ea33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:26.227793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bc009-1d3d-488c-bd81-24273f76ea33 service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:26.247007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 683/1360] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:28.532054 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b80a4-23c1-4ef2-86d1-9610b9a01cc3 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:28.532594 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b80a4-23c1-4ef2-86d1-9610b9a01cc3 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:28.532594 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b80a4-23c1-4ef2-86d1-9610b9a01cc3 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:28.534160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 678/1361] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:28.539836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90211a-1b68-40be-b3dd-f661857e67fa None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:28.540347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90211a-1b68-40be-b3dd-f661857e67fa None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:28.540429 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90211a-1b68-40be-b3dd-f661857e67fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:28.614851 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-5b90211a-1b68-40be-b3dd-f661857e67fa None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:28.616120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-5b90211a-1b68-40be-b3dd-f661857e67fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:28.657710 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:28.728683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 684/1362] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:54:28.778346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b80a4-23c1-4ef2-86d1-9610b9a01cc3 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:28.780360 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-819b80a4-23c1-4ef2-86d1-9610b9a01cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:28.979348 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b80a4-23c1-4ef2-86d1-9610b9a01cc3 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:28.990939 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:29.113318 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212124ee-faef-4942-98d7-933c951bbdc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:29.113934 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212124ee-faef-4942-98d7-933c951bbdc8 service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:29.114248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212124ee-faef-4942-98d7-933c951bbdc8 service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:29.114248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212124ee-faef-4942-98d7-933c951bbdc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:29.116174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-212124ee-faef-4942-98d7-933c951bbdc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:29.219502 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212124ee-faef-4942-98d7-933c951bbdc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:29.221429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212124ee-faef-4942-98d7-933c951bbdc8 service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:29.243996 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 679/1363] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:54:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:31.783448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b1826-505a-42fc-80de-e2e904221bfc None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:31.784502 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b1826-505a-42fc-80de-e2e904221bfc None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:31.784502 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b1826-505a-42fc-80de-e2e904221bfc None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:31.787253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 685/1364] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:54:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:31.798731 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2d3ba-14b1-404e-a43c-0c193293e368 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:31.799248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2d3ba-14b1-404e-a43c-0c193293e368 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:31.799370 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2d3ba-14b1-404e-a43c-0c193293e368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:31.818829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:31.884020 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-3ee2d3ba-14b1-404e-a43c-0c193293e368 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:31.885426 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-3ee2d3ba-14b1-404e-a43c-0c193293e368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:32.014493 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 680/1365] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:32.063270 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7616b07-207b-4f67-99aa-bf61b59ce8a7 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:32.063709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7616b07-207b-4f67-99aa-bf61b59ce8a7 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:32.064050 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7616b07-207b-4f67-99aa-bf61b59ce8a7 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:32.065491 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 686/1366] 10.222.0.64 () {54 vars in 962 bytes} [Thu Jul 28 03:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:32.071757 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb502-351e-443a-9ce8-e2887c4cd9b0 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:32.072044 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb502-351e-443a-9ce8-e2887c4cd9b0 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:32.072322 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb502-351e-443a-9ce8-e2887c4cd9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:32.156237 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-636bb502-351e-443a-9ce8-e2887c4cd9b0 None None] MFA Rules not processed for user `5133abf4c32a45b0b2188f71496c572b`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:32.157508 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-636bb502-351e-443a-9ce8-e2887c4cd9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:32.196092 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:32.289051 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 681/1367] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Jul 28 03:54:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:32.297869 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7616b07-207b-4f67-99aa-bf61b59ce8a7 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:32.299517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a7616b07-207b-4f67-99aa-bf61b59ce8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:32.463467 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7616b07-207b-4f67-99aa-bf61b59ce8a7 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:32.492878 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:32.589013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef4e7b-c2b6-41a7-b23e-80e666414025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:32.589564 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef4e7b-c2b6-41a7-b23e-80e666414025 service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:32.589844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef4e7b-c2b6-41a7-b23e-80e666414025 service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:32.590119 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef4e7b-c2b6-41a7-b23e-80e666414025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:32.592442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-26ef4e7b-c2b6-41a7-b23e-80e666414025 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:32.694280 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef4e7b-c2b6-41a7-b23e-80e666414025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:32.695939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef4e7b-c2b6-41a7-b23e-80e666414025 service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:32.717601 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 687/1368] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:54:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:33.681946 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835b305-3aa8-4124-9f6c-e28c79700127 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:33.682505 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835b305-3aa8-4124-9f6c-e28c79700127 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:33.682505 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835b305-3aa8-4124-9f6c-e28c79700127 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:33.683985 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 682/1369] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:33.690468 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51da13-9cc9-44c9-b1b0-d565f99220c7 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:33.690963 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51da13-9cc9-44c9-b1b0-d565f99220c7 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:33.691055 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51da13-9cc9-44c9-b1b0-d565f99220c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:33.726444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:33.766097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-6e51da13-9cc9-44c9-b1b0-d565f99220c7 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:33.767278 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-6e51da13-9cc9-44c9-b1b0-d565f99220c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:33.886794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 688/1370] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:34.240220 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf491d-3106-4106-9fb7-4da1cd1a83f6 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:34.240514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf491d-3106-4106-9fb7-4da1cd1a83f6 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:34.240796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf491d-3106-4106-9fb7-4da1cd1a83f6 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:34.242342 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 683/1371] 10.222.0.64 () {54 vars in 964 bytes} [Thu Jul 28 03:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:34.248088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1023e7-d810-43ec-93fe-727e8b13b842 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:34.248629 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1023e7-d810-43ec-93fe-727e8b13b842 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:34.248982 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1023e7-d810-43ec-93fe-727e8b13b842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:34.333913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-2b1023e7-d810-43ec-93fe-727e8b13b842 None None] MFA Rules not processed for user `dd31134e1f8545b0bbbe3c223b165df1`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:34.335156 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-2b1023e7-d810-43ec-93fe-727e8b13b842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:34.389428 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:34.420791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 689/1372] 10.222.0.64 () {58 vars in 1061 bytes} [Thu Jul 28 03:54:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:34.428888 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf491d-3106-4106-9fb7-4da1cd1a83f6 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:34.430426 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-17cf491d-3106-4106-9fb7-4da1cd1a83f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:34.553315 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf491d-3106-4106-9fb7-4da1cd1a83f6 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:34.600133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:34.636360 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045c342-3daf-4676-a5ba-d3b0e4e10b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:34.636992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045c342-3daf-4676-a5ba-d3b0e4e10b1e service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:34.637276 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045c342-3daf-4676-a5ba-d3b0e4e10b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:34.637550 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045c342-3daf-4676-a5ba-d3b0e4e10b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:34.639460 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0045c342-3daf-4676-a5ba-d3b0e4e10b1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:34.772161 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045c342-3daf-4676-a5ba-d3b0e4e10b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:34.772775 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045c342-3daf-4676-a5ba-d3b0e4e10b1e service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:34.799538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 684/1373] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:54:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:35.030617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5168725-45cd-468d-b7b9-fc0ecbf32840 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:35.031053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5168725-45cd-468d-b7b9-fc0ecbf32840 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:35.031283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5168725-45cd-468d-b7b9-fc0ecbf32840 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:35.033783 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 690/1374] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:54:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:35.038823 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9134fd1-a785-48a5-8702-02db676903f4 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:35.038989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9134fd1-a785-48a5-8702-02db676903f4 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:35.039288 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9134fd1-a785-48a5-8702-02db676903f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:35.116580 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-b9134fd1-a785-48a5-8702-02db676903f4 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:35.117872 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b9134fd1-a785-48a5-8702-02db676903f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:35.143121 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:35.263478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 685/1375] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:35.298949 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5168725-45cd-468d-b7b9-fc0ecbf32840 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:35.300632 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b5168725-45cd-468d-b7b9-fc0ecbf32840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:35.453090 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5168725-45cd-468d-b7b9-fc0ecbf32840 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:35.508065 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:35.570955 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae990c21-7c19-4dcd-ae82-914c6d00f9bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:35.571645 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae990c21-7c19-4dcd-ae82-914c6d00f9bf service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:35.572020 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae990c21-7c19-4dcd-ae82-914c6d00f9bf service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:35.572290 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae990c21-7c19-4dcd-ae82-914c6d00f9bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:35.574210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ae990c21-7c19-4dcd-ae82-914c6d00f9bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:35.669225 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae990c21-7c19-4dcd-ae82-914c6d00f9bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:35.671774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae990c21-7c19-4dcd-ae82-914c6d00f9bf service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:35.690962 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 691/1376] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:54:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:37.937386 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a7495-bb9e-4bbb-9b32-bfe4006bfeb4 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:37.938043 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a7495-bb9e-4bbb-9b32-bfe4006bfeb4 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:37.938043 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a7495-bb9e-4bbb-9b32-bfe4006bfeb4 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:37.939575 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 686/1377] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:37.945052 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7ebd4-6462-4135-a105-91ba4a2974f9 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:37.945571 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7ebd4-6462-4135-a105-91ba4a2974f9 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:37.945698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7ebd4-6462-4135-a105-91ba4a2974f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:38.027752 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-60c7ebd4-6462-4135-a105-91ba4a2974f9 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:38.029777 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-60c7ebd4-6462-4135-a105-91ba4a2974f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:38.064500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:38.146432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 692/1378] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:38.191066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a7495-bb9e-4bbb-9b32-bfe4006bfeb4 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:38.192717 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-301a7495-bb9e-4bbb-9b32-bfe4006bfeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:38.346899 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a7495-bb9e-4bbb-9b32-bfe4006bfeb4 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:38.350734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:38.556056 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b84b6-acd8-4f51-b738-85475721a608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:38.556695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b84b6-acd8-4f51-b738-85475721a608 service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:38.556987 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b84b6-acd8-4f51-b738-85475721a608 service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:38.558720 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b84b6-acd8-4f51-b738-85475721a608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:38.562840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-295b84b6-acd8-4f51-b738-85475721a608 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:38.715255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b84b6-acd8-4f51-b738-85475721a608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:38.717746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b84b6-acd8-4f51-b738-85475721a608 service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:38.741282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 687/1379] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:54:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:40.966168 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b1cd2-4b0b-4a9d-b3e1-1caa5c6737d9 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:40.966168 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b1cd2-4b0b-4a9d-b3e1-1caa5c6737d9 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:40.966168 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b1cd2-4b0b-4a9d-b3e1-1caa5c6737d9 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:40.968755 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 693/1380] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:54:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:40.971653 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa067a3e-dd4d-482a-b9ad-7056b29d4b4f None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:40.972120 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa067a3e-dd4d-482a-b9ad-7056b29d4b4f None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:40.972210 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa067a3e-dd4d-482a-b9ad-7056b29d4b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:40.984440 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:41.053254 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-fa067a3e-dd4d-482a-b9ad-7056b29d4b4f None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:41.054623 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-fa067a3e-dd4d-482a-b9ad-7056b29d4b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:41.163145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 688/1381] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:41.208069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b1cd2-4b0b-4a9d-b3e1-1caa5c6737d9 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:41.209952 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-671b1cd2-4b0b-4a9d-b3e1-1caa5c6737d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:41.369288 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:41.381210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b1cd2-4b0b-4a9d-b3e1-1caa5c6737d9 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:41.514268 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511c8cb-eb16-4285-a9d7-db785021713e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:41.514934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511c8cb-eb16-4285-a9d7-db785021713e service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:41.515216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511c8cb-eb16-4285-a9d7-db785021713e service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:41.515717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511c8cb-eb16-4285-a9d7-db785021713e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:41.517651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-0511c8cb-eb16-4285-a9d7-db785021713e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:41.639212 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511c8cb-eb16-4285-a9d7-db785021713e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:41.641255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511c8cb-eb16-4285-a9d7-db785021713e service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:41.655234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:41.672245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 694/1382] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:54:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:44.012159 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efb0ac-a04e-4f59-ac0b-356423f1fa00 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:44.012683 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efb0ac-a04e-4f59-ac0b-356423f1fa00 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:44.012854 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efb0ac-a04e-4f59-ac0b-356423f1fa00 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:44.014244 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 689/1383] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:44.020128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175abdaa-a3cf-4204-a6f8-b95afbbabddb None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:44.020897 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175abdaa-a3cf-4204-a6f8-b95afbbabddb None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:44.020897 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175abdaa-a3cf-4204-a6f8-b95afbbabddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:44.097562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-175abdaa-a3cf-4204-a6f8-b95afbbabddb None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:44.098773 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-175abdaa-a3cf-4204-a6f8-b95afbbabddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:44.205218 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 695/1384] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:44.249905 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efb0ac-a04e-4f59-ac0b-356423f1fa00 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:44.251569 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-29efb0ac-a04e-4f59-ac0b-356423f1fa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:44.351060 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:44.431793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efb0ac-a04e-4f59-ac0b-356423f1fa00 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:44.569716 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519ca1a-6b0d-4f0c-84df-064c821e0bfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:44.570350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519ca1a-6b0d-4f0c-84df-064c821e0bfc service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:44.570632 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519ca1a-6b0d-4f0c-84df-064c821e0bfc service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:44.570913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519ca1a-6b0d-4f0c-84df-064c821e0bfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:44.572603 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-d519ca1a-6b0d-4f0c-84df-064c821e0bfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:44.627387 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:44.670966 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519ca1a-6b0d-4f0c-84df-064c821e0bfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:44.672626 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519ca1a-6b0d-4f0c-84df-064c821e0bfc service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:44.699649 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 690/1385] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:54:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:46.739096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdce6fe-2ef6-46a5-b998-ae67c6565dfd None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:46.739693 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdce6fe-2ef6-46a5-b998-ae67c6565dfd None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:46.739693 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdce6fe-2ef6-46a5-b998-ae67c6565dfd None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:46.741056 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 696/1386] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:46.749071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a18cf9-dd90-44d1-8156-67cd2e6ccd24 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:46.749646 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a18cf9-dd90-44d1-8156-67cd2e6ccd24 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:46.749742 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a18cf9-dd90-44d1-8156-67cd2e6ccd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:46.833561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-c4a18cf9-dd90-44d1-8156-67cd2e6ccd24 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:46.834863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c4a18cf9-dd90-44d1-8156-67cd2e6ccd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:46.941159 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 691/1387] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:46.986458 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdce6fe-2ef6-46a5-b998-ae67c6565dfd None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:46.988043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-2fdce6fe-2ef6-46a5-b998-ae67c6565dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:47.072118 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:47.154979 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdce6fe-2ef6-46a5-b998-ae67c6565dfd None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:47.292424 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c829a77-225e-4407-8a4c-eaaa82f7cfc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:47.293446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c829a77-225e-4407-8a4c-eaaa82f7cfc9 service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:47.293790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c829a77-225e-4407-8a4c-eaaa82f7cfc9 service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:47.294709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c829a77-225e-4407-8a4c-eaaa82f7cfc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:47.297398 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-7c829a77-225e-4407-8a4c-eaaa82f7cfc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:47.352714 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:47.412404 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c829a77-225e-4407-8a4c-eaaa82f7cfc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:47.413927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c829a77-225e-4407-8a4c-eaaa82f7cfc9 service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:47.435087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 697/1388] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:54:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:49.798380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fcd9a-d9a7-48fd-861c-f5a98fed47b7 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:49.798911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fcd9a-d9a7-48fd-861c-f5a98fed47b7 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:49.799005 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fcd9a-d9a7-48fd-861c-f5a98fed47b7 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:49.800386 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 692/1389] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:49.805719 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475d498-8152-4ace-9037-fef1ff6ae84f None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:49.806160 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475d498-8152-4ace-9037-fef1ff6ae84f None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:49.806337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475d498-8152-4ace-9037-fef1ff6ae84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:49.874987 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-3475d498-8152-4ace-9037-fef1ff6ae84f None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:49.876262 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-3475d498-8152-4ace-9037-fef1ff6ae84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:49.982787 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 698/1390] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:50.025234 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fcd9a-d9a7-48fd-861c-f5a98fed47b7 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:50.026749 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-367fcd9a-d9a7-48fd-861c-f5a98fed47b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:50.063389 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:50.196208 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fcd9a-d9a7-48fd-861c-f5a98fed47b7 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:50.308101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:50.320867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a23ae8-43a5-45a3-b3eb-bb26096e1725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:50.321414 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a23ae8-43a5-45a3-b3eb-bb26096e1725 service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:50.321692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a23ae8-43a5-45a3-b3eb-bb26096e1725 service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:50.321965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a23ae8-43a5-45a3-b3eb-bb26096e1725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:50.323641 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-76a23ae8-43a5-45a3-b3eb-bb26096e1725 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:50.420891 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a23ae8-43a5-45a3-b3eb-bb26096e1725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:50.422507 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a23ae8-43a5-45a3-b3eb-bb26096e1725 service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:50.441868 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 693/1391] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:54:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:50.471766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864f18b-96dc-431b-910d-37f56098bbbc None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:50.472078 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864f18b-96dc-431b-910d-37f56098bbbc None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:50.472352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864f18b-96dc-431b-910d-37f56098bbbc None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:50.473724 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 699/1392] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:50.479470 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b92e3c-20fd-4040-93af-2555a1f085ed None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:50.479756 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b92e3c-20fd-4040-93af-2555a1f085ed None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:50.480033 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b92e3c-20fd-4040-93af-2555a1f085ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:50.557081 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-47b92e3c-20fd-4040-93af-2555a1f085ed None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:50.558306 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-47b92e3c-20fd-4040-93af-2555a1f085ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:50.619388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:50.660164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 694/1393] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:50.729935 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86b9f5-28cf-492a-8a03-8fac9da2c0e4 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:50.730339 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86b9f5-28cf-492a-8a03-8fac9da2c0e4 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:50.730693 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86b9f5-28cf-492a-8a03-8fac9da2c0e4 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:50.733064 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 700/1394] 10.222.0.64 () {54 vars in 966 bytes} [Thu Jul 28 03:54:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:50.738793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1334eca-5c1a-4574-959b-38cf65026537 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:50.739107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1334eca-5c1a-4574-959b-38cf65026537 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:50.739383 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1334eca-5c1a-4574-959b-38cf65026537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:50.839833 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-c1334eca-5c1a-4574-959b-38cf65026537 None None] MFA Rules not processed for user `9bfc1fe981424313aecce5af443c8a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:50.841691 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c1334eca-5c1a-4574-959b-38cf65026537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:50.925371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 695/1395] 10.222.0.64 () {58 vars in 1063 bytes} [Thu Jul 28 03:54:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:50.932992 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86b9f5-28cf-492a-8a03-8fac9da2c0e4 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:50.934546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-7d86b9f5-28cf-492a-8a03-8fac9da2c0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:50.948682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:51.052505 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86b9f5-28cf-492a-8a03-8fac9da2c0e4 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:51.135719 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e027ad3-00e1-43ab-9741-4d6c00764850 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bfc1fe981424313aecce5af443c8a9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:51.136348 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e027ad3-00e1-43ab-9741-4d6c00764850 service glance] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:51.136625 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e027ad3-00e1-43ab-9741-4d6c00764850 service glance] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:51.136895 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e027ad3-00e1-43ab-9741-4d6c00764850 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:51.138632 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9e027ad3-00e1-43ab-9741-4d6c00764850 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:51.211373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:51.254089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e027ad3-00e1-43ab-9741-4d6c00764850 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:51.255581 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e027ad3-00e1-43ab-9741-4d6c00764850 service glance] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:51.274430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 701/1396] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:54:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:52.285160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331eaad2-7d13-4802-8c07-6013dc7fb203 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:52.285680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331eaad2-7d13-4802-8c07-6013dc7fb203 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:52.285790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331eaad2-7d13-4802-8c07-6013dc7fb203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:52.357745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-331eaad2-7d13-4802-8c07-6013dc7fb203 None None] MFA Rules not processed for user `420e2a81b66a470e8db624efd61fd1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:52.358951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-331eaad2-7d13-4802-8c07-6013dc7fb203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:52.367562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:52.454308 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 696/1397] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 28 03:54:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:52.503460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3ae6d-5b4a-41c3-b9fa-165817d389fd None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:52.503885 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3ae6d-5b4a-41c3-b9fa-165817d389fd None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:52.504171 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3ae6d-5b4a-41c3-b9fa-165817d389fd None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:52.505718 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 702/1398] 10.222.0.64 () {54 vars in 943 bytes} [Thu Jul 28 03:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:52.512565 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c5c36-f586-46cb-92d4-640b29461ad8 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:52.512834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c5c36-f586-46cb-92d4-640b29461ad8 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:52.513362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c5c36-f586-46cb-92d4-640b29461ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:52.594942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-6f5c5c36-f586-46cb-92d4-640b29461ad8 None None] MFA Rules not processed for user `382ff6087bf4486d8651162880825eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:52.596185 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-6f5c5c36-f586-46cb-92d4-640b29461ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:52.686438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:52.709624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 697/1399] 10.222.0.64 () {58 vars in 1040 bytes} [Thu Jul 28 03:54:52 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:52.720017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace987f-65c8-4f9a-bc65-6d58a590e197 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:52.723037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c5c36-f586-46cb-92d4-640b29461ad8 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:52.723146 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace987f-65c8-4f9a-bc65-6d58a590e197 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:52.723146 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace987f-65c8-4f9a-bc65-6d58a590e197 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:52.723146 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 703/1400] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:52.726871 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153fdf2-610a-4773-83ac-0508003920e4 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:52.727151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153fdf2-610a-4773-83ac-0508003920e4 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:52.727453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153fdf2-610a-4773-83ac-0508003920e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:52.730197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c5c36-f586-46cb-92d4-640b29461ad8 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:52.800303 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-7153fdf2-610a-4773-83ac-0508003920e4 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:52.801485 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-7153fdf2-610a-4773-83ac-0508003920e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:52.838758 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765277d-b92b-4152-820f-95d465d6fc33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382ff6087bf4486d8651162880825eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:52.839406 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765277d-b92b-4152-820f-95d465d6fc33 service swift] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:52.839689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765277d-b92b-4152-820f-95d465d6fc33 service swift] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:52.839963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765277d-b92b-4152-820f-95d465d6fc33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:52.842408 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0765277d-b92b-4152-820f-95d465d6fc33 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:52.900750 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 704/1401] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:54:52.928566 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765277d-b92b-4152-820f-95d465d6fc33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:52.930208 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765277d-b92b-4152-820f-95d465d6fc33 service swift] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:52.938845 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 698/1402] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 28 03:54:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 03:54:52.947861 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153fdf2-610a-4773-83ac-0508003920e4 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:52.949068 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-7153fdf2-610a-4773-83ac-0508003920e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:52.977663 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:53.066848 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153fdf2-610a-4773-83ac-0508003920e4 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:53.184098 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28ecd8-6ed2-4975-8394-eef02b879907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:53.184890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28ecd8-6ed2-4975-8394-eef02b879907 service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:53.185170 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28ecd8-6ed2-4975-8394-eef02b879907 service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:53.185446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28ecd8-6ed2-4975-8394-eef02b879907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:53.187091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-de28ecd8-6ed2-4975-8394-eef02b879907 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:53.205802 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:53.281309 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28ecd8-6ed2-4975-8394-eef02b879907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:53.282932 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28ecd8-6ed2-4975-8394-eef02b879907 service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:53.301353 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 705/1403] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:54:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:55.728727 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25f935-6b71-47d4-ab4b-8d7504e58629 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:55.729308 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25f935-6b71-47d4-ab4b-8d7504e58629 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:55.729308 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25f935-6b71-47d4-ab4b-8d7504e58629 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:55.730672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 699/1404] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:54:55.736771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078a86e-9d0e-4e22-adbe-d659c919bbc2 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:55.737259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078a86e-9d0e-4e22-adbe-d659c919bbc2 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:55.737386 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078a86e-9d0e-4e22-adbe-d659c919bbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:55.820044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-d078a86e-9d0e-4e22-adbe-d659c919bbc2 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:55.821599 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d078a86e-9d0e-4e22-adbe-d659c919bbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:55.935407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:55.945941 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 706/1405] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:55.995376 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25f935-6b71-47d4-ab4b-8d7504e58629 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:55.998689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-de25f935-6b71-47d4-ab4b-8d7504e58629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:56.011360 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:56.197631 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25f935-6b71-47d4-ab4b-8d7504e58629 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:56.421587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:56.463897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545a636-830f-470b-ac38-7806570dc2de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:56.464465 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545a636-830f-470b-ac38-7806570dc2de service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:56.464737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545a636-830f-470b-ac38-7806570dc2de service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:56.465012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545a636-830f-470b-ac38-7806570dc2de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:56.466806 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9545a636-830f-470b-ac38-7806570dc2de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:56.580137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545a636-830f-470b-ac38-7806570dc2de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:56.581829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545a636-830f-470b-ac38-7806570dc2de service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:56.606778 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 700/1406] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:54:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:54:58.963060 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3667b0-ee98-4df8-9356-d97dde5b8f2d None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:58.963687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3667b0-ee98-4df8-9356-d97dde5b8f2d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:58.963687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3667b0-ee98-4df8-9356-d97dde5b8f2d None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:58.967693 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 707/1407] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:54:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:54:58.970580 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055a759-10b7-4d94-b844-952aec66c355 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:58.971089 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055a759-10b7-4d94-b844-952aec66c355 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:58.971226 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055a759-10b7-4d94-b844-952aec66c355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:59.052564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-9055a759-10b7-4d94-b844-952aec66c355 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:54:59.053963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9055a759-10b7-4d94-b844-952aec66c355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:59.109922 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:59.170695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 701/1408] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:54:59.215086 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3667b0-ee98-4df8-9356-d97dde5b8f2d None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:54:59.216911 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ed3667b0-ee98-4df8-9356-d97dde5b8f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:59.379117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3667b0-ee98-4df8-9356-d97dde5b8f2d None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:54:59.460025 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:59.519751 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8df98-10fb-4154-b784-7c4d6856d840 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:54:59.520694 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8df98-10fb-4154-b784-7c4d6856d840 service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:54:59.520983 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8df98-10fb-4154-b784-7c4d6856d840 service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:54:59.521262 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8df98-10fb-4154-b784-7c4d6856d840 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:54:59.522943 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-39d8df98-10fb-4154-b784-7c4d6856d840 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:54:59.629695 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8df98-10fb-4154-b784-7c4d6856d840 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:54:59.631225 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8df98-10fb-4154-b784-7c4d6856d840 service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:54:59.652335 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 708/1409] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:55:09.167993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=23 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:09.649732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=64 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:16.521328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78531c-fed2-4623-ba84-41b9e75ce143 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:16.521774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78531c-fed2-4623-ba84-41b9e75ce143 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:16.521950 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78531c-fed2-4623-ba84-41b9e75ce143 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:16.523380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 702/1410] 10.222.0.64 () {54 vars in 918 bytes} [Thu Jul 28 03:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:55:16.529321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dbe3b-c4b8-4d05-a6ab-8fceae64bc07 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:16.529772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dbe3b-c4b8-4d05-a6ab-8fceae64bc07 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:16.529878 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dbe3b-c4b8-4d05-a6ab-8fceae64bc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:16.604062 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-cb2dbe3b-c4b8-4d05-a6ab-8fceae64bc07 None None] MFA Rules not processed for user `e91f2584622a48bba21e1bf31c1aef30`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:16.605299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-cb2dbe3b-c4b8-4d05-a6ab-8fceae64bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:16.712773 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 709/1411] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Jul 28 03:55:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:55:16.727694 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1248541-2dae-4441-9220-90f76357f8aa None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:16.727977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1248541-2dae-4441-9220-90f76357f8aa None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:16.728255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1248541-2dae-4441-9220-90f76357f8aa None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:16.729622 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 703/1412] 10.222.0.64 () {54 vars in 918 bytes} [Thu Jul 28 03:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:55:16.734672 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c70e6-745c-46d7-b728-ad919f099ac0 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:16.734961 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c70e6-745c-46d7-b728-ad919f099ac0 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:16.735259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c70e6-745c-46d7-b728-ad919f099ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:16.810831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:16.814016 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-e61c70e6-745c-46d7-b728-ad919f099ac0 None None] MFA Rules not processed for user `5133abf4c32a45b0b2188f71496c572b`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:16.815283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e61c70e6-745c-46d7-b728-ad919f099ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:16.931258 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 710/1413] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Jul 28 03:55:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:55:19.449188 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc084d-fcf7-4b59-b265-2b6b1fe89941 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:19.449786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc084d-fcf7-4b59-b265-2b6b1fe89941 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:19.449955 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc084d-fcf7-4b59-b265-2b6b1fe89941 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:19.451346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 03:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:55:19.456893 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aba2b-e002-4dde-a08f-a5142f305256 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:19.457370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aba2b-e002-4dde-a08f-a5142f305256 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:19.457468 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aba2b-e002-4dde-a08f-a5142f305256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:19.526663 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-f05aba2b-e002-4dde-a08f-a5142f305256 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:19.528180 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f05aba2b-e002-4dde-a08f-a5142f305256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:19.582177 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:19.624228 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 03:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:55:19.668860 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc084d-fcf7-4b59-b265-2b6b1fe89941 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:55:19.671211 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b0dc084d-fcf7-4b59-b265-2b6b1fe89941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:19.827435 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc084d-fcf7-4b59-b265-2b6b1fe89941 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:55:19.901931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:19.942829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783182f-03c8-4b8f-af47-4cb092fef1e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:55:19.943482 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783182f-03c8-4b8f-af47-4cb092fef1e1 service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:19.943763 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783182f-03c8-4b8f-af47-4cb092fef1e1 service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:19.944031 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783182f-03c8-4b8f-af47-4cb092fef1e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:19.945644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-7783182f-03c8-4b8f-af47-4cb092fef1e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:20.037299 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783182f-03c8-4b8f-af47-4cb092fef1e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:55:20.038934 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783182f-03c8-4b8f-af47-4cb092fef1e1 service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:55:20.057606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 705/1416] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:55:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:55:20.972369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b462ecf-84a5-4d0d-9803-73a829d84f6c None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:20.972959 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b462ecf-84a5-4d0d-9803-73a829d84f6c None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:20.972959 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b462ecf-84a5-4d0d-9803-73a829d84f6c None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:20.974295 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 03:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:55:20.979260 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fed334-eaed-4b7f-898d-3e967188b720 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:20.979729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fed334-eaed-4b7f-898d-3e967188b720 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:20.979835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fed334-eaed-4b7f-898d-3e967188b720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:21.056211 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-e0fed334-eaed-4b7f-898d-3e967188b720 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:21.057430 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e0fed334-eaed-4b7f-898d-3e967188b720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:21.086637 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:21.158346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 03:55:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:55:21.313240 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b462ecf-84a5-4d0d-9803-73a829d84f6c None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:55:21.314701 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-8b462ecf-84a5-4d0d-9803-73a829d84f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:21.459941 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b462ecf-84a5-4d0d-9803-73a829d84f6c None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:55:21.502859 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:21.578411 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f01882-d628-4a25-91ff-6a206da92566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:55:21.578957 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f01882-d628-4a25-91ff-6a206da92566 service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:21.579236 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f01882-d628-4a25-91ff-6a206da92566 service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:21.579605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f01882-d628-4a25-91ff-6a206da92566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:21.581239 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-56f01882-d628-4a25-91ff-6a206da92566 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:21.674058 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f01882-d628-4a25-91ff-6a206da92566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:55:21.675710 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f01882-d628-4a25-91ff-6a206da92566 service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:55:21.694329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 713/1419] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:55:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:55:22.596395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2a503-c2bd-43bc-9b8a-e13dd1795a88 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:22.596926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2a503-c2bd-43bc-9b8a-e13dd1795a88 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:22.596926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2a503-c2bd-43bc-9b8a-e13dd1795a88 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:22.598315 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 03:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:55:22.603271 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f0b57-ee32-406a-a73e-d3a7fc54a1d8 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:22.603709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f0b57-ee32-406a-a73e-d3a7fc54a1d8 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:22.603844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f0b57-ee32-406a-a73e-d3a7fc54a1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:22.660449 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:22.682450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-857f0b57-ee32-406a-a73e-d3a7fc54a1d8 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:22.684284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-857f0b57-ee32-406a-a73e-d3a7fc54a1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:22.784023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 03:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:55:22.937633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2a503-c2bd-43bc-9b8a-e13dd1795a88 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:55:22.939162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c9e2a503-c2bd-43bc-9b8a-e13dd1795a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:23.085570 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2a503-c2bd-43bc-9b8a-e13dd1795a88 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:55:23.098520 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:23.206293 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806dcad3-18fe-418e-8460-bc2394d6c8a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:55:23.206908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dcad3-18fe-418e-8460-bc2394d6c8a9 service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:23.207185 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dcad3-18fe-418e-8460-bc2394d6c8a9 service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:23.207492 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806dcad3-18fe-418e-8460-bc2394d6c8a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:23.209123 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-806dcad3-18fe-418e-8460-bc2394d6c8a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:23.299446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806dcad3-18fe-418e-8460-bc2394d6c8a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:55:23.301040 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806dcad3-18fe-418e-8460-bc2394d6c8a9 service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:55:23.318967 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 708/1422] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:55:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:55:24.226653 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c9111-b408-4d42-b998-fe86a423e896 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:24.227251 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c9111-b408-4d42-b998-fe86a423e896 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:24.227251 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c9111-b408-4d42-b998-fe86a423e896 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:24.228591 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 03:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:55:24.234569 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204a517-4610-40f0-b5c4-4dfe21cf1e0c None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:24.234998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204a517-4610-40f0-b5c4-4dfe21cf1e0c None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:24.235119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204a517-4610-40f0-b5c4-4dfe21cf1e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:24.255973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:24.320848 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-4204a517-4610-40f0-b5c4-4dfe21cf1e0c None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:24.322114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-4204a517-4610-40f0-b5c4-4dfe21cf1e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:24.421228 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 03:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:55:24.589712 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c9111-b408-4d42-b998-fe86a423e896 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:55:24.591557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ce5c9111-b408-4d42-b998-fe86a423e896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:24.703924 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:24.740217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c9111-b408-4d42-b998-fe86a423e896 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:55:24.856600 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cf9a1-deac-49d5-865c-8cc850edc5da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:55:24.857221 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cf9a1-deac-49d5-865c-8cc850edc5da service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:24.857500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cf9a1-deac-49d5-865c-8cc850edc5da service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:24.857770 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cf9a1-deac-49d5-865c-8cc850edc5da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:24.859436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-415cf9a1-deac-49d5-865c-8cc850edc5da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:24.936076 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:24.950336 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415cf9a1-deac-49d5-865c-8cc850edc5da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:55:24.952061 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415cf9a1-deac-49d5-865c-8cc850edc5da service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:55:24.971304 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 716/1425] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:55:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:55:25.860143 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d706621-08f3-410c-81fc-915498ae9cf7 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:25.860730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d706621-08f3-410c-81fc-915498ae9cf7 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:25.860730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d706621-08f3-410c-81fc-915498ae9cf7 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:25.862169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 03:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:55:25.867569 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e635c2b-1a73-4cfd-a65d-4ea9f97aa3d8 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:25.872538 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e635c2b-1a73-4cfd-a65d-4ea9f97aa3d8 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:25.872538 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e635c2b-1a73-4cfd-a65d-4ea9f97aa3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:25.956053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-8e635c2b-1a73-4cfd-a65d-4ea9f97aa3d8 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:25.957285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-8e635c2b-1a73-4cfd-a65d-4ea9f97aa3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:26.065275 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 03:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:55:26.223654 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d706621-08f3-410c-81fc-915498ae9cf7 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:55:26.225225 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0d706621-08f3-410c-81fc-915498ae9cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:26.309937 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:26.371480 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d706621-08f3-410c-81fc-915498ae9cf7 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:55:26.492134 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850aecf-624a-40f8-a04a-693ce0a02e70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:55:26.492748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850aecf-624a-40f8-a04a-693ce0a02e70 service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:26.493025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850aecf-624a-40f8-a04a-693ce0a02e70 service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:26.493295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850aecf-624a-40f8-a04a-693ce0a02e70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:26.494953 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-2850aecf-624a-40f8-a04a-693ce0a02e70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:26.545939 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:26.586971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850aecf-624a-40f8-a04a-693ce0a02e70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:55:26.588517 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850aecf-624a-40f8-a04a-693ce0a02e70 service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:55:26.607166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 711/1428] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:55:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:55:27.495797 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44258cd9-2901-4273-a06f-475bf1cf5344 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:27.496879 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44258cd9-2901-4273-a06f-475bf1cf5344 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:27.496879 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44258cd9-2901-4273-a06f-475bf1cf5344 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:27.498172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 03:55:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:55:27.503170 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52e5c1-7b12-4fcd-9235-fa26614e76a1 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:27.503665 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52e5c1-7b12-4fcd-9235-fa26614e76a1 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:27.503775 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52e5c1-7b12-4fcd-9235-fa26614e76a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:27.582133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-fa52e5c1-7b12-4fcd-9235-fa26614e76a1 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:27.583403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-fa52e5c1-7b12-4fcd-9235-fa26614e76a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:27.679755 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 03:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:55:27.835762 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44258cd9-2901-4273-a06f-475bf1cf5344 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:55:27.837280 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-44258cd9-2901-4273-a06f-475bf1cf5344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:27.885567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:27.985631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44258cd9-2901-4273-a06f-475bf1cf5344 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:55:28.098784 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4476277-e5eb-4280-80a8-a7d6c5fad1b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:55:28.099431 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4476277-e5eb-4280-80a8-a7d6c5fad1b4 service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:28.099712 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4476277-e5eb-4280-80a8-a7d6c5fad1b4 service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:28.099984 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4476277-e5eb-4280-80a8-a7d6c5fad1b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:28.101744 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e4476277-e5eb-4280-80a8-a7d6c5fad1b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:28.109193 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:28.192525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4476277-e5eb-4280-80a8-a7d6c5fad1b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:55:28.194152 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4476277-e5eb-4280-80a8-a7d6c5fad1b4 service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:55:28.212489 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 719/1431] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:55:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:55:29.078217 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dfd93-6ca7-4c35-a9aa-6181577aac6d None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:29.080231 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dfd93-6ca7-4c35-a9aa-6181577aac6d None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:29.080231 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dfd93-6ca7-4c35-a9aa-6181577aac6d None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:29.080231 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 03:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:55:29.085621 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ad6c5-3330-4c36-85dd-f819376fa6f9 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:29.086091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ad6c5-3330-4c36-85dd-f819376fa6f9 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:29.086205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ad6c5-3330-4c36-85dd-f819376fa6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:29.162989 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-949ad6c5-3330-4c36-85dd-f819376fa6f9 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:29.164247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-949ad6c5-3330-4c36-85dd-f819376fa6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:29.231722 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:29.265246 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 03:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:55:29.418142 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dfd93-6ca7-4c35-a9aa-6181577aac6d None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:55:29.420302 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ab7dfd93-6ca7-4c35-a9aa-6181577aac6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:29.438117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:29.565340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dfd93-6ca7-4c35-a9aa-6181577aac6d None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:55:29.651983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:29.678377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d8ae6-9dc3-4cee-96b1-1f315ea4d801 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:55:29.679040 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d8ae6-9dc3-4cee-96b1-1f315ea4d801 service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:29.679344 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d8ae6-9dc3-4cee-96b1-1f315ea4d801 service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:29.679624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d8ae6-9dc3-4cee-96b1-1f315ea4d801 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:29.681247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-fa5d8ae6-9dc3-4cee-96b1-1f315ea4d801 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:29.771406 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d8ae6-9dc3-4cee-96b1-1f315ea4d801 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:55:29.773073 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d8ae6-9dc3-4cee-96b1-1f315ea4d801 service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:55:29.793922 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 714/1434] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:55:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:55:30.687345 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290e2f7-02d2-4c45-9647-5ebb09edd853 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:30.687915 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290e2f7-02d2-4c45-9647-5ebb09edd853 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:30.688034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290e2f7-02d2-4c45-9647-5ebb09edd853 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:30.689385 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 03:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:55:30.694284 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2eba04-0183-4ac5-b8ea-bfe93253d40e None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:30.694686 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2eba04-0183-4ac5-b8ea-bfe93253d40e None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:30.694838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2eba04-0183-4ac5-b8ea-bfe93253d40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:30.770131 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-ee2eba04-0183-4ac5-b8ea-bfe93253d40e None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:30.771267 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ee2eba04-0183-4ac5-b8ea-bfe93253d40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:30.813846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:30.869061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 03:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:55:31.026422 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290e2f7-02d2-4c45-9647-5ebb09edd853 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:55:31.027882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f290e2f7-02d2-4c45-9647-5ebb09edd853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:31.174381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290e2f7-02d2-4c45-9647-5ebb09edd853 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:55:31.230226 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:31.289386 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd0c1af-b894-411b-b473-3bf3d31bed48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:55:31.289935 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0c1af-b894-411b-b473-3bf3d31bed48 service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:31.290212 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0c1af-b894-411b-b473-3bf3d31bed48 service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:31.290480 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0c1af-b894-411b-b473-3bf3d31bed48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:31.292133 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-1bd0c1af-b894-411b-b473-3bf3d31bed48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:31.382807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0c1af-b894-411b-b473-3bf3d31bed48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:55:31.384446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd0c1af-b894-411b-b473-3bf3d31bed48 service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:55:31.404303 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 722/1437] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:55:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:55:32.271396 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2103f2-9161-4d9e-94ab-6008fbeed962 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:32.272037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2103f2-9161-4d9e-94ab-6008fbeed962 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:32.272037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2103f2-9161-4d9e-94ab-6008fbeed962 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:32.273366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 03:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:55:32.278932 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ac5d5-d118-4014-ad1f-d45fee2d1946 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:32.279421 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ac5d5-d118-4014-ad1f-d45fee2d1946 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:32.279814 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ac5d5-d118-4014-ad1f-d45fee2d1946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:32.357978 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-654ac5d5-d118-4014-ad1f-d45fee2d1946 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:32.359221 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-654ac5d5-d118-4014-ad1f-d45fee2d1946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:32.361273 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:32.455988 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 03:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:55:32.609746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2103f2-9161-4d9e-94ab-6008fbeed962 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:55:32.611282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-4b2103f2-9161-4d9e-94ab-6008fbeed962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:32.759235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2103f2-9161-4d9e-94ab-6008fbeed962 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:55:32.788885 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:32.875616 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236f216-a263-424a-83ba-049bb4a08b90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:55:32.876274 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236f216-a263-424a-83ba-049bb4a08b90 service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:32.876528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236f216-a263-424a-83ba-049bb4a08b90 service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:32.876805 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236f216-a263-424a-83ba-049bb4a08b90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:32.878450 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9236f216-a263-424a-83ba-049bb4a08b90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:32.966639 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236f216-a263-424a-83ba-049bb4a08b90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:55:32.968318 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236f216-a263-424a-83ba-049bb4a08b90 service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:55:32.986051 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 717/1440] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:55:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:55:34.902274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e080e-29aa-43d4-9615-1a818dd9f7da None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:34.902820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e080e-29aa-43d4-9615-1a818dd9f7da None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:34.902820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e080e-29aa-43d4-9615-1a818dd9f7da None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:34.904264 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 03:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:55:34.909587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50594aad-603a-4611-bd72-cee8f8dbeac3 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:34.909990 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50594aad-603a-4611-bd72-cee8f8dbeac3 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:34.910141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50594aad-603a-4611-bd72-cee8f8dbeac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:34.953313 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:34.977716 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-50594aad-603a-4611-bd72-cee8f8dbeac3 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:34.978965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-50594aad-603a-4611-bd72-cee8f8dbeac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:35.079187 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 03:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:55:35.119132 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e080e-29aa-43d4-9615-1a818dd9f7da None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:55:35.120734 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-0e2e080e-29aa-43d4-9615-1a818dd9f7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:35.223098 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e080e-29aa-43d4-9615-1a818dd9f7da None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:55:35.256476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:35.299062 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d240b2-8a11-46de-abf8-538b116275a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:55:35.299724 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d240b2-8a11-46de-abf8-538b116275a9 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:35.300006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d240b2-8a11-46de-abf8-538b116275a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:35.300279 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d240b2-8a11-46de-abf8-538b116275a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:35.301919 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a2d240b2-8a11-46de-abf8-538b116275a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:35.409507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d240b2-8a11-46de-abf8-538b116275a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:55:35.411088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d240b2-8a11-46de-abf8-538b116275a9 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:55:35.429670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 725/1443] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:55:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:55:37.608407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd9a21-c7ba-46f1-8c54-7fdefc657baa None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:37.608968 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd9a21-c7ba-46f1-8c54-7fdefc657baa None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:37.608968 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd9a21-c7ba-46f1-8c54-7fdefc657baa None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:37.610372 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 03:55:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:55:37.615899 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04530e66-6f20-4410-86f1-30cc40fb8003 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:37.616335 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04530e66-6f20-4410-86f1-30cc40fb8003 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:37.616449 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04530e66-6f20-4410-86f1-30cc40fb8003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:37.683086 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-04530e66-6f20-4410-86f1-30cc40fb8003 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:37.684362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-04530e66-6f20-4410-86f1-30cc40fb8003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:37.697104 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:37.782700 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 03:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:55:37.820324 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd9a21-c7ba-46f1-8c54-7fdefc657baa None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:55:37.821896 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c2dd9a21-c7ba-46f1-8c54-7fdefc657baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:37.926772 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd9a21-c7ba-46f1-8c54-7fdefc657baa None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:55:37.939264 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:38.000419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75790529-b9af-44c3-958d-4778eff8ad2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:55:38.001190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75790529-b9af-44c3-958d-4778eff8ad2f service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:38.001569 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75790529-b9af-44c3-958d-4778eff8ad2f service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:38.001943 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75790529-b9af-44c3-958d-4778eff8ad2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:38.003779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-75790529-b9af-44c3-958d-4778eff8ad2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:38.115539 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75790529-b9af-44c3-958d-4778eff8ad2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:55:38.117049 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75790529-b9af-44c3-958d-4778eff8ad2f service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:55:38.134632 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 720/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:55:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:55:40.556332 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef9ec0-a1a1-4000-a3ce-50d52e4655a8 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:40.556812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef9ec0-a1a1-4000-a3ce-50d52e4655a8 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:40.556925 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef9ec0-a1a1-4000-a3ce-50d52e4655a8 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:40.558284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 03:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:55:40.564380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7082a-81c2-4fc6-b885-5909e166e8f6 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:40.564839 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7082a-81c2-4fc6-b885-5909e166e8f6 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:40.564939 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7082a-81c2-4fc6-b885-5909e166e8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:40.614861 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:40.634112 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-c5f7082a-81c2-4fc6-b885-5909e166e8f6 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:40.635505 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c5f7082a-81c2-4fc6-b885-5909e166e8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:40.731672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 03:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:55:40.771148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef9ec0-a1a1-4000-a3ce-50d52e4655a8 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:55:40.772727 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-34ef9ec0-a1a1-4000-a3ce-50d52e4655a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:40.875775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef9ec0-a1a1-4000-a3ce-50d52e4655a8 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:55:40.915566 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:40.948592 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263335c-cb10-441e-8c86-7d0bf1728bfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:55:40.949215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263335c-cb10-441e-8c86-7d0bf1728bfc service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:40.949492 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263335c-cb10-441e-8c86-7d0bf1728bfc service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:40.949760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263335c-cb10-441e-8c86-7d0bf1728bfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:40.951927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-5263335c-cb10-441e-8c86-7d0bf1728bfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:41.059526 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263335c-cb10-441e-8c86-7d0bf1728bfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:55:41.061241 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263335c-cb10-441e-8c86-7d0bf1728bfc service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:55:41.081798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 728/1449] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:55:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:55:43.264928 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df531e-5f7f-48a8-8c20-feef72d472d6 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:43.265469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df531e-5f7f-48a8-8c20-feef72d472d6 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:43.265469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df531e-5f7f-48a8-8c20-feef72d472d6 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:43.267140 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 03:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:55:43.272548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a096aa-fef2-4099-8391-d5b103586b1f None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:43.272933 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a096aa-fef2-4099-8391-d5b103586b1f None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:43.273106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a096aa-fef2-4099-8391-d5b103586b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:43.340017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-84a096aa-fef2-4099-8391-d5b103586b1f None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:43.341744 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-84a096aa-fef2-4099-8391-d5b103586b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:43.361981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:43.564062 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 03:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:55:43.603378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df531e-5f7f-48a8-8c20-feef72d472d6 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:55:43.604939 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-18df531e-5f7f-48a8-8c20-feef72d472d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:43.710869 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df531e-5f7f-48a8-8c20-feef72d472d6 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:55:43.731570 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:43.786364 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb574fa-71cd-47bd-8331-4e1e1086be5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:55:43.786993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb574fa-71cd-47bd-8331-4e1e1086be5c service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:43.787276 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb574fa-71cd-47bd-8331-4e1e1086be5c service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:43.787581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb574fa-71cd-47bd-8331-4e1e1086be5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:43.789217 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-abb574fa-71cd-47bd-8331-4e1e1086be5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:43.898382 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb574fa-71cd-47bd-8331-4e1e1086be5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:55:43.899770 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb574fa-71cd-47bd-8331-4e1e1086be5c service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:55:43.917520 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 723/1452] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:55:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:55:46.000934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89a99b-f0c8-46af-8472-430ff2dc1353 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:46.001479 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89a99b-f0c8-46af-8472-430ff2dc1353 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:46.001660 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89a99b-f0c8-46af-8472-430ff2dc1353 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:46.003029 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 03:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:55:46.008345 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1329a9-e96d-493b-ab0f-8a8b48b8ab33 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:46.008736 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1329a9-e96d-493b-ab0f-8a8b48b8ab33 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:46.008902 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1329a9-e96d-493b-ab0f-8a8b48b8ab33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:46.074240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:46.081849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-ee1329a9-e96d-493b-ab0f-8a8b48b8ab33 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:46.082824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ee1329a9-e96d-493b-ab0f-8a8b48b8ab33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:46.180377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 03:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:55:46.218930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89a99b-f0c8-46af-8472-430ff2dc1353 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:55:46.220516 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ad89a99b-f0c8-46af-8472-430ff2dc1353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:46.321547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89a99b-f0c8-46af-8472-430ff2dc1353 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:55:46.368559 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:46.392935 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced2123-a3f4-4084-821c-525054f574f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:55:46.393546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced2123-a3f4-4084-821c-525054f574f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:46.393821 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced2123-a3f4-4084-821c-525054f574f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:46.394087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced2123-a3f4-4084-821c-525054f574f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:46.395725 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-6ced2123-a3f4-4084-821c-525054f574f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:46.501148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced2123-a3f4-4084-821c-525054f574f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:55:46.502577 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced2123-a3f4-4084-821c-525054f574f8 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:55:46.521011 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 731/1455] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:55:48.644712 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f323f94-2f12-4fa4-9131-91d4ba6d28eb None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:48.645283 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f323f94-2f12-4fa4-9131-91d4ba6d28eb None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:48.645283 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f323f94-2f12-4fa4-9131-91d4ba6d28eb None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:48.646613 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 03:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:55:48.652027 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed41252-456d-4a21-9606-c02ae39f399c None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:48.652433 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed41252-456d-4a21-9606-c02ae39f399c None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:48.652606 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed41252-456d-4a21-9606-c02ae39f399c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:48.718821 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-7ed41252-456d-4a21-9606-c02ae39f399c None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:48.720069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-7ed41252-456d-4a21-9606-c02ae39f399c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:48.749854 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:48.818164 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 03:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:55:48.857710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f323f94-2f12-4fa4-9131-91d4ba6d28eb None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:55:48.859297 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-4f323f94-2f12-4fa4-9131-91d4ba6d28eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:48.964494 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f323f94-2f12-4fa4-9131-91d4ba6d28eb None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:55:48.993884 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:49.041393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5322a2-13fc-4ebd-a03e-cd6d0b68b172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:55:49.041926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5322a2-13fc-4ebd-a03e-cd6d0b68b172 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:49.042203 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5322a2-13fc-4ebd-a03e-cd6d0b68b172 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:49.042471 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5322a2-13fc-4ebd-a03e-cd6d0b68b172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:49.044703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-bc5322a2-13fc-4ebd-a03e-cd6d0b68b172 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:49.150763 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5322a2-13fc-4ebd-a03e-cd6d0b68b172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:55:49.152227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5322a2-13fc-4ebd-a03e-cd6d0b68b172 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:55:49.171671 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 726/1458] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:55:51.277356 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29100c42-e5e4-4825-ae6f-2ffe5a21a504 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:51.277936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29100c42-e5e4-4825-ae6f-2ffe5a21a504 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:51.278068 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29100c42-e5e4-4825-ae6f-2ffe5a21a504 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:51.279447 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 03:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:55:51.284906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91965f-92a6-440e-9f3a-090885641818 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:51.285350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91965f-92a6-440e-9f3a-090885641818 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:51.285510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91965f-92a6-440e-9f3a-090885641818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:51.352314 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-2c91965f-92a6-440e-9f3a-090885641818 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:51.353577 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-2c91965f-92a6-440e-9f3a-090885641818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:51.362065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:51.450315 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 03:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:55:51.487593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29100c42-e5e4-4825-ae6f-2ffe5a21a504 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:55:51.489119 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-29100c42-e5e4-4825-ae6f-2ffe5a21a504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:51.592331 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29100c42-e5e4-4825-ae6f-2ffe5a21a504 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:55:51.648782 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:51.668103 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04912b2-4f08-45de-b4f1-7b118b4f2002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:55:51.668710 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04912b2-4f08-45de-b4f1-7b118b4f2002 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:51.669058 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04912b2-4f08-45de-b4f1-7b118b4f2002 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:51.669322 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04912b2-4f08-45de-b4f1-7b118b4f2002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:51.670972 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c04912b2-4f08-45de-b4f1-7b118b4f2002 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:51.780171 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04912b2-4f08-45de-b4f1-7b118b4f2002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:55:51.781972 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04912b2-4f08-45de-b4f1-7b118b4f2002 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:55:51.800759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 734/1461] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:55:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:55:53.869198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ca8b1-f70d-4160-9656-833be97203bf None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:53.869724 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ca8b1-f70d-4160-9656-833be97203bf None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:53.869724 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ca8b1-f70d-4160-9656-833be97203bf None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:53.871027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 03:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:55:53.876351 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193eded-bb01-4ad6-ad62-0be0bb385632 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:53.876810 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193eded-bb01-4ad6-ad62-0be0bb385632 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:53.876923 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193eded-bb01-4ad6-ad62-0be0bb385632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:53.943910 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-5193eded-bb01-4ad6-ad62-0be0bb385632 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:53.945131 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-5193eded-bb01-4ad6-ad62-0be0bb385632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:53.984299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:54.043172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 03:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:55:54.082100 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ca8b1-f70d-4160-9656-833be97203bf None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:55:54.083796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-5b0ca8b1-f70d-4160-9656-833be97203bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:54.190642 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ca8b1-f70d-4160-9656-833be97203bf None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:55:54.227666 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:54.263896 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc66ba3-2b43-43b4-b4f6-89fc47a6a107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:55:54.264642 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc66ba3-2b43-43b4-b4f6-89fc47a6a107 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:54.264977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc66ba3-2b43-43b4-b4f6-89fc47a6a107 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:54.265536 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc66ba3-2b43-43b4-b4f6-89fc47a6a107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:54.267466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ecc66ba3-2b43-43b4-b4f6-89fc47a6a107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:54.375938 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc66ba3-2b43-43b4-b4f6-89fc47a6a107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:55:54.377413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc66ba3-2b43-43b4-b4f6-89fc47a6a107 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:55:54.396059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 729/1464] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:55:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:55:56.464323 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4985784-2e0a-4451-b185-2587a20149ff None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:56.464889 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4985784-2e0a-4451-b185-2587a20149ff None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:56.464889 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4985784-2e0a-4451-b185-2587a20149ff None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:56.467234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 03:55:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:55:56.472877 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83991f3-925b-4fca-bba8-086e5fdbad49 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:56.473297 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83991f3-925b-4fca-bba8-086e5fdbad49 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:56.473443 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83991f3-925b-4fca-bba8-086e5fdbad49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:56.539772 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-f83991f3-925b-4fca-bba8-086e5fdbad49 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:56.541022 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f83991f3-925b-4fca-bba8-086e5fdbad49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:56.560073 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:56.638959 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 03:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:55:56.675634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4985784-2e0a-4451-b185-2587a20149ff None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:55:56.677216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e4985784-2e0a-4451-b185-2587a20149ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:56.787418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4985784-2e0a-4451-b185-2587a20149ff None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:55:56.854555 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:56.861860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507022de-6b36-4af2-b404-46b2a5319689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:55:56.862482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507022de-6b36-4af2-b404-46b2a5319689 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:56.862764 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507022de-6b36-4af2-b404-46b2a5319689 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:56.863137 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507022de-6b36-4af2-b404-46b2a5319689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:56.864721 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-507022de-6b36-4af2-b404-46b2a5319689 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:56.973653 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507022de-6b36-4af2-b404-46b2a5319689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:55:56.975089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507022de-6b36-4af2-b404-46b2a5319689 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:55:56.992874 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 737/1467] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:55:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:55:59.048521 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d3c0f-cb00-4442-9741-b548686b4179 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:59.049037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d3c0f-cb00-4442-9741-b548686b4179 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:59.049149 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d3c0f-cb00-4442-9741-b548686b4179 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:59.050472 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 03:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:55:59.055709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6d82f-323d-420f-a23e-9d8bf6387f41 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:59.056204 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6d82f-323d-420f-a23e-9d8bf6387f41 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:59.056315 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6d82f-323d-420f-a23e-9d8bf6387f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:59.126474 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-d4a6d82f-323d-420f-a23e-9d8bf6387f41 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:55:59.127740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d4a6d82f-323d-420f-a23e-9d8bf6387f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:59.175448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:59.222881 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 03:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:55:59.259592 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d3c0f-cb00-4442-9741-b548686b4179 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:55:59.261125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c49d3c0f-cb00-4442-9741-b548686b4179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:59.367369 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d3c0f-cb00-4442-9741-b548686b4179 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:55:59.413807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:59.439647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe0984-1ccc-4297-ac3c-23a12d2cee5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:55:59.450130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe0984-1ccc-4297-ac3c-23a12d2cee5a service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:55:59.450130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe0984-1ccc-4297-ac3c-23a12d2cee5a service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:55:59.450130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe0984-1ccc-4297-ac3c-23a12d2cee5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:55:59.450130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-80fe0984-1ccc-4297-ac3c-23a12d2cee5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:55:59.550414 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe0984-1ccc-4297-ac3c-23a12d2cee5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:55:59.551893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe0984-1ccc-4297-ac3c-23a12d2cee5a service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:55:59.570751 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 732/1470] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:55:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:56:09.221138 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=22 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:09.568452 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=66 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:19.780738 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44697f-ec1c-490b-9db5-5c5f389b813b None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:19.781614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44697f-ec1c-490b-9db5-5c5f389b813b None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:19.781895 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44697f-ec1c-490b-9db5-5c5f389b813b None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:19.783292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 739/1471] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:56:19.788935 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844aa5e7-652d-4636-8bb2-7e3c2806290c None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:19.789377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844aa5e7-652d-4636-8bb2-7e3c2806290c None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:19.789491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844aa5e7-652d-4636-8bb2-7e3c2806290c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:19.855658 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-844aa5e7-652d-4636-8bb2-7e3c2806290c None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:56:19.856972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-844aa5e7-652d-4636-8bb2-7e3c2806290c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:19.957598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 733/1472] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:56:20.043393 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d48f6a-79c1-48c7-ba1a-7f2740c87a34 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:20.043716 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d48f6a-79c1-48c7-ba1a-7f2740c87a34 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:20.044000 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d48f6a-79c1-48c7-ba1a-7f2740c87a34 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:20.045361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 740/1473] 10.222.0.64 () {54 vars in 966 bytes} [Thu Jul 28 03:56:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:56:20.050591 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ade3b-618d-464d-a1bb-a039119330d4 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:20.050876 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ade3b-618d-464d-a1bb-a039119330d4 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:20.051151 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ade3b-618d-464d-a1bb-a039119330d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:20.130759 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-2c7ade3b-618d-464d-a1bb-a039119330d4 None None] MFA Rules not processed for user `9bfc1fe981424313aecce5af443c8a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:56:20.132055 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-2c7ade3b-618d-464d-a1bb-a039119330d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:20.153616 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:20.212040 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 734/1474] 10.222.0.64 () {58 vars in 1063 bytes} [Thu Jul 28 03:56:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:56:20.219690 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d48f6a-79c1-48c7-ba1a-7f2740c87a34 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:56:20.221242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-12d48f6a-79c1-48c7-ba1a-7f2740c87a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:20.323617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d48f6a-79c1-48c7-ba1a-7f2740c87a34 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:56:20.397285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0929147-f448-4169-a174-dce7720298e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bfc1fe981424313aecce5af443c8a9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:56:20.397911 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0929147-f448-4169-a174-dce7720298e0 service glance] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:20.398192 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0929147-f448-4169-a174-dce7720298e0 service glance] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:20.398470 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0929147-f448-4169-a174-dce7720298e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:20.400129 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e0929147-f448-4169-a174-dce7720298e0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:20.453443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:20.508357 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0929147-f448-4169-a174-dce7720298e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:56:20.509801 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0929147-f448-4169-a174-dce7720298e0 service glance] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:56:20.528617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 741/1475] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:56:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:56:22.627981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53a894-cdd5-4151-9a99-98afa497a96d None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:22.628536 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53a894-cdd5-4151-9a99-98afa497a96d None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:22.628536 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53a894-cdd5-4151-9a99-98afa497a96d None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:22.630224 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 735/1476] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:56:22.635654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea39e-3ff0-4d7b-8f17-7bd3439515a9 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:22.636068 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea39e-3ff0-4d7b-8f17-7bd3439515a9 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:22.636376 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ea39e-3ff0-4d7b-8f17-7bd3439515a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:22.702879 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-952ea39e-3ff0-4d7b-8f17-7bd3439515a9 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:56:22.704123 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-952ea39e-3ff0-4d7b-8f17-7bd3439515a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:22.800437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 742/1477] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:56:22.823515 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53a894-cdd5-4151-9a99-98afa497a96d None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:56:22.826259 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0b53a894-cdd5-4151-9a99-98afa497a96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:22.954665 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53a894-cdd5-4151-9a99-98afa497a96d None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:56:23.002217 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:23.047876 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398951e3-8c0e-4736-ab03-def8e221983a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:56:23.048500 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398951e3-8c0e-4736-ab03-def8e221983a admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:23.048782 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398951e3-8c0e-4736-ab03-def8e221983a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:23.049102 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398951e3-8c0e-4736-ab03-def8e221983a admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:23.051954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398951e3-8c0e-4736-ab03-def8e221983a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:56:23.053710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: WARNING py.warnings [None req-398951e3-8c0e-4736-ab03-def8e221983a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:56:23.053710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: warnings.warn(msg) Jul 28 03:56:23.053710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: Jul 28 03:56:23.054856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398951e3-8c0e-4736-ab03-def8e221983a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:56:23.075951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 736/1478] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 28 03:56:22 2022] GET /identity/v3/projects => generated 2553 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:56:25.104141 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17682581-6a7d-45b1-a99b-3fe79814fe14 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:25.104681 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17682581-6a7d-45b1-a99b-3fe79814fe14 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:25.104681 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17682581-6a7d-45b1-a99b-3fe79814fe14 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:25.106799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 743/1479] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:56:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:56:25.111972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0939b29-8779-4290-8d27-4e92613c14b6 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:25.112418 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0939b29-8779-4290-8d27-4e92613c14b6 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:25.112516 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0939b29-8779-4290-8d27-4e92613c14b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:25.179568 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-f0939b29-8779-4290-8d27-4e92613c14b6 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:56:25.180780 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f0939b29-8779-4290-8d27-4e92613c14b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:25.277358 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 737/1480] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:56:25.319390 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17682581-6a7d-45b1-a99b-3fe79814fe14 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:56:25.320906 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-17682581-6a7d-45b1-a99b-3fe79814fe14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:25.331046 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:25.468793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17682581-6a7d-45b1-a99b-3fe79814fe14 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:56:25.550163 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:25.581810 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5db8f-5037-4471-a98b-8f0470e2fd51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:56:25.582432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5db8f-5037-4471-a98b-8f0470e2fd51 service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:25.582707 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5db8f-5037-4471-a98b-8f0470e2fd51 service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:25.582977 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5db8f-5037-4471-a98b-8f0470e2fd51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:25.585382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b9d5db8f-5037-4471-a98b-8f0470e2fd51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:25.675065 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5db8f-5037-4471-a98b-8f0470e2fd51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:56:25.676565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5db8f-5037-4471-a98b-8f0470e2fd51 service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:56:25.694788 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 744/1481] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:56:27.919954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6340a-976f-45c6-893f-b05b371dd097 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:27.920517 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6340a-976f-45c6-893f-b05b371dd097 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:27.920517 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6340a-976f-45c6-893f-b05b371dd097 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:27.921851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 738/1482] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:56:27.927506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a7c85-6d34-4da8-bd74-85e695f22d4b None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:27.927965 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a7c85-6d34-4da8-bd74-85e695f22d4b None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:27.928062 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a7c85-6d34-4da8-bd74-85e695f22d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:27.993377 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-422a7c85-6d34-4da8-bd74-85e695f22d4b None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:56:27.994597 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-422a7c85-6d34-4da8-bd74-85e695f22d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:28.040746 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:28.093656 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 745/1483] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:56:28.130835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6340a-976f-45c6-893f-b05b371dd097 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:56:28.132396 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-82a6340a-976f-45c6-893f-b05b371dd097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:28.156769 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:28.237400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6340a-976f-45c6-893f-b05b371dd097 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:56:28.309884 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18148361-dbd1-4081-85c2-84f6f07f6b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:56:28.310509 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18148361-dbd1-4081-85c2-84f6f07f6b02 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:28.310794 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18148361-dbd1-4081-85c2-84f6f07f6b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:28.311070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18148361-dbd1-4081-85c2-84f6f07f6b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:28.312755 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-18148361-dbd1-4081-85c2-84f6f07f6b02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:28.385384 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:28.419995 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18148361-dbd1-4081-85c2-84f6f07f6b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:56:28.421435 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18148361-dbd1-4081-85c2-84f6f07f6b02 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:56:28.439607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 739/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:56:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:56:30.497700 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae09503-d816-46d5-b21f-9f18d5207308 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:30.498240 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae09503-d816-46d5-b21f-9f18d5207308 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:30.498240 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae09503-d816-46d5-b21f-9f18d5207308 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:30.499651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 746/1485] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 03:56:30.504903 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065a11c-7753-4918-adb0-31a8c1079d91 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:30.505332 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065a11c-7753-4918-adb0-31a8c1079d91 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:30.505468 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065a11c-7753-4918-adb0-31a8c1079d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:30.572447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-f065a11c-7753-4918-adb0-31a8c1079d91 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:56:30.575425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f065a11c-7753-4918-adb0-31a8c1079d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:30.672013 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 740/1486] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:56:30.715245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae09503-d816-46d5-b21f-9f18d5207308 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:56:30.716803 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-bae09503-d816-46d5-b21f-9f18d5207308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:30.822439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae09503-d816-46d5-b21f-9f18d5207308 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:56:30.893989 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:30.895757 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539cdd9-1b2f-47b8-843f-2e2cdd8335e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:56:30.896375 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539cdd9-1b2f-47b8-843f-2e2cdd8335e5 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:30.896652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539cdd9-1b2f-47b8-843f-2e2cdd8335e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:30.896937 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539cdd9-1b2f-47b8-843f-2e2cdd8335e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:30.898520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a539cdd9-1b2f-47b8-843f-2e2cdd8335e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:31.007250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539cdd9-1b2f-47b8-843f-2e2cdd8335e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:56:31.008711 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539cdd9-1b2f-47b8-843f-2e2cdd8335e5 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:56:31.027538 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 747/1487] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:56:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:56:33.141005 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143ab06-067b-40fc-b91e-2e0f067e0d20 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:33.141568 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143ab06-067b-40fc-b91e-2e0f067e0d20 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:33.141568 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143ab06-067b-40fc-b91e-2e0f067e0d20 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:33.144375 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 741/1488] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:56:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:56:33.149667 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cad2ee-5921-42b4-abfb-4bb2ed10dd7d None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:33.150149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cad2ee-5921-42b4-abfb-4bb2ed10dd7d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:33.150300 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cad2ee-5921-42b4-abfb-4bb2ed10dd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:33.215808 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-c8cad2ee-5921-42b4-abfb-4bb2ed10dd7d None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:56:33.217058 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c8cad2ee-5921-42b4-abfb-4bb2ed10dd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:33.269032 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:33.313550 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 748/1489] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:56:33.354133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143ab06-067b-40fc-b91e-2e0f067e0d20 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:56:33.356319 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-d143ab06-067b-40fc-b91e-2e0f067e0d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:33.390984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:33.456941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143ab06-067b-40fc-b91e-2e0f067e0d20 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:56:33.530169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfc0f0-4cd5-4270-a109-77dc2411ad3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:56:33.530792 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfc0f0-4cd5-4270-a109-77dc2411ad3d service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:33.531078 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfc0f0-4cd5-4270-a109-77dc2411ad3d service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:33.531381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfc0f0-4cd5-4270-a109-77dc2411ad3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:33.533018 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f8bfc0f0-4cd5-4270-a109-77dc2411ad3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:33.612250 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:33.641026 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfc0f0-4cd5-4270-a109-77dc2411ad3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:56:33.642512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfc0f0-4cd5-4270-a109-77dc2411ad3d service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:56:33.660974 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 742/1490] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:56:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:56:36.098357 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf056720-8b26-4404-8953-ba51becfcbc8 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:36.098925 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf056720-8b26-4404-8953-ba51becfcbc8 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:36.098925 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf056720-8b26-4404-8953-ba51becfcbc8 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:36.100299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 749/1491] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 28 03:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:56:36.106006 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a3934-ccea-4d70-bc48-70252b47695a None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:36.106442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a3934-ccea-4d70-bc48-70252b47695a None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:36.106575 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a3934-ccea-4d70-bc48-70252b47695a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:36.173072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-5e0a3934-ccea-4d70-bc48-70252b47695a None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:56:36.174303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-5e0a3934-ccea-4d70-bc48-70252b47695a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:36.273041 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 743/1492] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 28 03:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:56:36.313260 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf056720-8b26-4404-8953-ba51becfcbc8 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:56:36.314829 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-bf056720-8b26-4404-8953-ba51becfcbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:36.418764 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf056720-8b26-4404-8953-ba51becfcbc8 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:56:36.490715 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb145b-2fe8-46c3-bb04-788808808d0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:56:36.491417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb145b-2fe8-46c3-bb04-788808808d0f service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:56:36.491634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb145b-2fe8-46c3-bb04-788808808d0f service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:56:36.491903 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb145b-2fe8-46c3-bb04-788808808d0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:56:36.494133 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-4dcb145b-2fe8-46c3-bb04-788808808d0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:56:36.503832 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:36.604994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb145b-2fe8-46c3-bb04-788808808d0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:56:36.606437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb145b-2fe8-46c3-bb04-788808808d0f service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:56:36.624310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 750/1493] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:56:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 03:56:46.271087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=82 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:46.622052 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=50 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:14.661324 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88290b06-1087-448e-a89c-cd6f6bd692db None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:14.661883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88290b06-1087-448e-a89c-cd6f6bd692db None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:14.661883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88290b06-1087-448e-a89c-cd6f6bd692db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:14.738390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-88290b06-1087-448e-a89c-cd6f6bd692db None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:58:14.739643 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-88290b06-1087-448e-a89c-cd6f6bd692db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:14.846854 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 744/1494] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 03:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:58:14.855599 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddd8bb-a7cb-4b37-a077-f2eb8d5b547b None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:14.856164 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddd8bb-a7cb-4b37-a077-f2eb8d5b547b None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:14.856164 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddd8bb-a7cb-4b37-a077-f2eb8d5b547b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:14.936675 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-56ddd8bb-a7cb-4b37-a077-f2eb8d5b547b None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:58:14.937825 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-56ddd8bb-a7cb-4b37-a077-f2eb8d5b547b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:15.034006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 751/1495] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 03:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 03:58:15.038783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88290b06-1087-448e-a89c-cd6f6bd692db None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:15.040065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-88290b06-1087-448e-a89c-cd6f6bd692db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:15.051617 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88290b06-1087-448e-a89c-cd6f6bd692db None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:15.113830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:15.148339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b36c7f-3eaf-498d-9d1a-c339e20b035c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:15.149134 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b36c7f-3eaf-498d-9d1a-c339e20b035c admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:15.149711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b36c7f-3eaf-498d-9d1a-c339e20b035c admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:15.150050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b36c7f-3eaf-498d-9d1a-c339e20b035c admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:15.151093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b36c7f-3eaf-498d-9d1a-c339e20b035c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 03:58:15.151759 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b36c7f-3eaf-498d-9d1a-c339e20b035c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:15.152783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: WARNING py.warnings [None req-75b36c7f-3eaf-498d-9d1a-c339e20b035c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:58:15.152783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: warnings.warn(msg) Jul 28 03:58:15.152783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: Jul 28 03:58:15.153691 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b36c7f-3eaf-498d-9d1a-c339e20b035c admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:15.165104 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 745/1496] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 03:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 03:58:15.173569 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddd8bb-a7cb-4b37-a077-f2eb8d5b547b None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:15.183302 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddd8bb-a7cb-4b37-a077-f2eb8d5b547b None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:15.244176 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:15.278589 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b5b71-45f6-4ffe-9b22-d459b360a645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:15.279207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b5b71-45f6-4ffe-9b22-d459b360a645 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:15.279520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b5b71-45f6-4ffe-9b22-d459b360a645 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:15.279789 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b5b71-45f6-4ffe-9b22-d459b360a645 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:15.280457 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b5b71-45f6-4ffe-9b22-d459b360a645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:15.282327 dv-cinder-851279-1-smb devstack@keystone.service[86895]: WARNING py.warnings [None req-330b5b71-45f6-4ffe-9b22-d459b360a645 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:58:15.282327 dv-cinder-851279-1-smb devstack@keystone.service[86895]: warnings.warn(msg) Jul 28 03:58:15.282327 dv-cinder-851279-1-smb devstack@keystone.service[86895]: Jul 28 03:58:15.283542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b5b71-45f6-4ffe-9b22-d459b360a645 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:15.397511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 752/1497] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 03:58:15 2022] POST /identity/v3/projects => generated 377 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:58:15.402233 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b36c7f-3eaf-498d-9d1a-c339e20b035c admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:15.403807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-75b36c7f-3eaf-498d-9d1a-c339e20b035c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:15.440139 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b36c7f-3eaf-498d-9d1a-c339e20b035c admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:15.535793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a95c0-4351-4420-95b0-c0620b21981f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:15.536320 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a95c0-4351-4420-95b0-c0620b21981f admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:15.536601 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a95c0-4351-4420-95b0-c0620b21981f admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:15.536875 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a95c0-4351-4420-95b0-c0620b21981f admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:15.537546 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a95c0-4351-4420-95b0-c0620b21981f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:15.538552 dv-cinder-851279-1-smb devstack@keystone.service[86894]: WARNING py.warnings [None req-6c8a95c0-4351-4420-95b0-c0620b21981f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:58:15.538552 dv-cinder-851279-1-smb devstack@keystone.service[86894]: warnings.warn(msg) Jul 28 03:58:15.538552 dv-cinder-851279-1-smb devstack@keystone.service[86894]: Jul 28 03:58:15.540083 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a95c0-4351-4420-95b0-c0620b21981f admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:15.658707 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 746/1498] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 03:58:15 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 03:58:15.662959 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b5b71-45f6-4ffe-9b22-d459b360a645 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:15.664749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-330b5b71-45f6-4ffe-9b22-d459b360a645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:15.725961 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b5b71-45f6-4ffe-9b22-d459b360a645 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:15.824475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:15.836472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a63e5-e26c-4985-b62b-a5995463b239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:15.837238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a63e5-e26c-4985-b62b-a5995463b239 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:15.837514 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a63e5-e26c-4985-b62b-a5995463b239 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:15.837789 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a63e5-e26c-4985-b62b-a5995463b239 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:15.838494 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a63e5-e26c-4985-b62b-a5995463b239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:15.839551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: WARNING py.warnings [None req-b73a63e5-e26c-4985-b62b-a5995463b239 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:58:15.839551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: warnings.warn(msg) Jul 28 03:58:15.839551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: Jul 28 03:58:15.840443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a63e5-e26c-4985-b62b-a5995463b239 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:15.853893 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 753/1499] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 03:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:58:15.858238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a95c0-4351-4420-95b0-c0620b21981f admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:15.859827 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-6c8a95c0-4351-4420-95b0-c0620b21981f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:15.872262 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a95c0-4351-4420-95b0-c0620b21981f admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:15.900998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:15.976155 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c5ac2-92b2-42e3-906a-67fa61c7f3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:15.977526 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c5ac2-92b2-42e3-906a-67fa61c7f3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:15.978142 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c5ac2-92b2-42e3-906a-67fa61c7f3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:15.978644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c5ac2-92b2-42e3-906a-67fa61c7f3f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:15.979946 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c5ac2-92b2-42e3-906a-67fa61c7f3f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:15.980977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: WARNING py.warnings [None req-5c5c5ac2-92b2-42e3-906a-67fa61c7f3f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:58:15.980977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: warnings.warn(msg) Jul 28 03:58:15.980977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: Jul 28 03:58:15.981885 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c5ac2-92b2-42e3-906a-67fa61c7f3f9 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:15.995638 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 747/1500] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 03:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 03:58:16.000195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a63e5-e26c-4985-b62b-a5995463b239 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:16.004822 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b73a63e5-e26c-4985-b62b-a5995463b239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:16.042105 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a63e5-e26c-4985-b62b-a5995463b239 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:16.143854 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8b237-4464-4082-86bd-cfc6a6a2a499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:16.144449 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8b237-4464-4082-86bd-cfc6a6a2a499 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:16.144754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8b237-4464-4082-86bd-cfc6a6a2a499 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:16.145014 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8b237-4464-4082-86bd-cfc6a6a2a499 admin admin] PATH_INFO: `/v3/projects/b7002a3bc2b64e8c85591fd688183e23/users/a39a966eb91a476e92c4da81ad431ced/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:16.168979 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8b237-4464-4082-86bd-cfc6a6a2a499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7002a3bc2b64e8c85591fd688183e23, user_id=a39a966eb91a476e92c4da81ad431ced, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:16.170040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: WARNING py.warnings [None req-ced8b237-4464-4082-86bd-cfc6a6a2a499 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:58:16.170040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: warnings.warn(msg) Jul 28 03:58:16.170040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: Jul 28 03:58:16.172094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8b237-4464-4082-86bd-cfc6a6a2a499 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:16.284788 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 754/1501] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 03:58:15 2022] PUT /identity/v3/projects/b7002a3bc2b64e8c85591fd688183e23/users/a39a966eb91a476e92c4da81ad431ced/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:58:16.300446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ee171-b548-4bc9-8f36-dad67efd4569 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:16.300812 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ee171-b548-4bc9-8f36-dad67efd4569 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:16.301152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ee171-b548-4bc9-8f36-dad67efd4569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:16.366143 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-561ee171-b548-4bc9-8f36-dad67efd4569 None None] MFA Rules not processed for user `a39a966eb91a476e92c4da81ad431ced`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:58:16.367438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-561ee171-b548-4bc9-8f36-dad67efd4569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:16.465889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 748/1502] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 03:58:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:58:16.484235 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a22425-2aa7-4b72-bf8f-c5c7aca9999d None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:16.484523 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a22425-2aa7-4b72-bf8f-c5c7aca9999d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:16.484821 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a22425-2aa7-4b72-bf8f-c5c7aca9999d None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:16.486205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 755/1503] 10.222.0.64 () {54 vars in 964 bytes} [Thu Jul 28 03:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:58:16.491953 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b5eb1-0bed-4976-bb71-9bdb0c06bd2e None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:16.493442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b5eb1-0bed-4976-bb71-9bdb0c06bd2e None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:16.493735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b5eb1-0bed-4976-bb71-9bdb0c06bd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:16.531943 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:16.582777 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-ee7b5eb1-0bed-4976-bb71-9bdb0c06bd2e None None] MFA Rules not processed for user `dd31134e1f8545b0bbbe3c223b165df1`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:58:16.584130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ee7b5eb1-0bed-4976-bb71-9bdb0c06bd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:16.661706 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 749/1504] 10.222.0.64 () {58 vars in 1061 bytes} [Thu Jul 28 03:58:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:58:16.669785 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a22425-2aa7-4b72-bf8f-c5c7aca9999d None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:16.671306 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-50a22425-2aa7-4b72-bf8f-c5c7aca9999d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:16.721202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:16.774842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a22425-2aa7-4b72-bf8f-c5c7aca9999d None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:16.853319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26ac24-f999-4a6e-a079-3a4475e0e59e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:16.854089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26ac24-f999-4a6e-a079-3a4475e0e59e service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:16.854472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26ac24-f999-4a6e-a079-3a4475e0e59e service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:16.854844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26ac24-f999-4a6e-a079-3a4475e0e59e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:16.856759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-3b26ac24-f999-4a6e-a079-3a4475e0e59e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:16.959975 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26ac24-f999-4a6e-a079-3a4475e0e59e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:16.962005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26ac24-f999-4a6e-a079-3a4475e0e59e service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:16.966157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:16.983218 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 756/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:58:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:58:17.030467 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1d5f1-b96c-4fa1-b2ea-3fad892d2988 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:17.030890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1d5f1-b96c-4fa1-b2ea-3fad892d2988 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:17.031025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1d5f1-b96c-4fa1-b2ea-3fad892d2988 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:17.032403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 750/1506] 10.222.0.64 () {52 vars in 830 bytes} [Thu Jul 28 03:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 03:58:17.036069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26ac24-f999-4a6e-a079-3a4475e0e59e service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:17.037294 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-3b26ac24-f999-4a6e-a079-3a4475e0e59e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:17.140515 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26ac24-f999-4a6e-a079-3a4475e0e59e service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:17.235440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f29444-a347-424d-ae7f-a9b8d912cd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:17.236028 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29444-a347-424d-ae7f-a9b8d912cd21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:17.236308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29444-a347-424d-ae7f-a9b8d912cd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:17.236577 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29444-a347-424d-ae7f-a9b8d912cd21 admin admin] PATH_INFO: `/v3/users/a39a966eb91a476e92c4da81ad431ced` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:17.249913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f29444-a347-424d-ae7f-a9b8d912cd21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a39a966eb91a476e92c4da81ad431ced)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:17.250962 dv-cinder-851279-1-smb devstack@keystone.service[86895]: WARNING py.warnings [None req-41f29444-a347-424d-ae7f-a9b8d912cd21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:58:17.250962 dv-cinder-851279-1-smb devstack@keystone.service[86895]: warnings.warn(msg) Jul 28 03:58:17.250962 dv-cinder-851279-1-smb devstack@keystone.service[86895]: Jul 28 03:58:17.252201 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f29444-a347-424d-ae7f-a9b8d912cd21 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:17.262141 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:17.458354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-41f29444-a347-424d-ae7f-a9b8d912cd21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a39a966eb91a476e92c4da81ad431ced'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:58:17.458895 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-41f29444-a347-424d-ae7f-a9b8d912cd21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a39a966eb91a476e92c4da81ad431ced'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:58:17.520804 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-41f29444-a347-424d-ae7f-a9b8d912cd21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a39a966eb91a476e92c4da81ad431ced'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:58:17.540501 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-41f29444-a347-424d-ae7f-a9b8d912cd21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a39a966eb91a476e92c4da81ad431ced'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:58:17.553180 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-41f29444-a347-424d-ae7f-a9b8d912cd21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a39a966eb91a476e92c4da81ad431ced'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:58:17.560196 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 757/1507] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 03:58:17 2022] DELETE /identity/v3/users/a39a966eb91a476e92c4da81ad431ced => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:58:17.564745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f01074-9cc6-40ce-b80b-127cc3692765 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:17.565025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f01074-9cc6-40ce-b80b-127cc3692765 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:17.565313 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f01074-9cc6-40ce-b80b-127cc3692765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:17.625173 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-f0f01074-9cc6-40ce-b80b-127cc3692765 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 03:58:17.626442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f0f01074-9cc6-40ce-b80b-127cc3692765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:17.704130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:17.716950 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 751/1508] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 03:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 03:58:17.727168 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f29444-a347-424d-ae7f-a9b8d912cd21 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:17.728632 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-41f29444-a347-424d-ae7f-a9b8d912cd21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:17.830055 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f29444-a347-424d-ae7f-a9b8d912cd21 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:17.887873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:17.909031 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba1729-ee54-49cf-bcad-a08379096bd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:17.909666 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba1729-ee54-49cf-bcad-a08379096bd5 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:17.909954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba1729-ee54-49cf-bcad-a08379096bd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:17.910229 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba1729-ee54-49cf-bcad-a08379096bd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:17.912770 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a8ba1729-ee54-49cf-bcad-a08379096bd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:18.023779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba1729-ee54-49cf-bcad-a08379096bd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:18.025235 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba1729-ee54-49cf-bcad-a08379096bd5 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:18.044444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 758/1509] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 03:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 03:58:18.802750 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f01074-9cc6-40ce-b80b-127cc3692765 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 03:58:18.804316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f0f01074-9cc6-40ce-b80b-127cc3692765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 03:58:18.815766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f01074-9cc6-40ce-b80b-127cc3692765 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 03:58:18.918025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7ddee-8e45-4bad-8dd0-7ad326dcf356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 03:58:18.918587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7ddee-8e45-4bad-8dd0-7ad326dcf356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 03:58:18.918871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7ddee-8e45-4bad-8dd0-7ad326dcf356 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 03:58:18.919145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7ddee-8e45-4bad-8dd0-7ad326dcf356 admin admin] PATH_INFO: `/v3/projects/b7002a3bc2b64e8c85591fd688183e23` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 03:58:18.929408 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7ddee-8e45-4bad-8dd0-7ad326dcf356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7002a3bc2b64e8c85591fd688183e23)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 03:58:18.930444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: WARNING py.warnings [None req-78d7ddee-8e45-4bad-8dd0-7ad326dcf356 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:58:18.930444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: warnings.warn(msg) Jul 28 03:58:18.930444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: Jul 28 03:58:18.931688 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7ddee-8e45-4bad-8dd0-7ad326dcf356 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 03:58:19.044005 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-78d7ddee-8e45-4bad-8dd0-7ad326dcf356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7002a3bc2b64e8c85591fd688183e23', 'request_id': 'req-78d7ddee-8e45-4bad-8dd0-7ad326dcf356'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:58:19.057417 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-78d7ddee-8e45-4bad-8dd0-7ad326dcf356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7002a3bc2b64e8c85591fd688183e23', 'request_id': 'req-78d7ddee-8e45-4bad-8dd0-7ad326dcf356'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:58:19.063875 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-78d7ddee-8e45-4bad-8dd0-7ad326dcf356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7002a3bc2b64e8c85591fd688183e23', 'request_id': 'req-78d7ddee-8e45-4bad-8dd0-7ad326dcf356'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:58:19.162211 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-78d7ddee-8e45-4bad-8dd0-7ad326dcf356 admin admin] The token cache is being invalidate because project b7002a3bc2b64e8c85591fd688183e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 03:58:19.162503 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-78d7ddee-8e45-4bad-8dd0-7ad326dcf356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:58:19.162941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-78d7ddee-8e45-4bad-8dd0-7ad326dcf356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 03:58:19.165326 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 752/1510] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 03:58:18 2022] DELETE /identity/v3/projects/b7002a3bc2b64e8c85591fd688183e23 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 03:58:28.042142 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=62 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:29.160183 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:03.323490 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c9828-1143-4b81-a4f2-2c6a05e6cc5d None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:03.324152 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c9828-1143-4b81-a4f2-2c6a05e6cc5d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:03.324152 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c9828-1143-4b81-a4f2-2c6a05e6cc5d None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:03.325489 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 04:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 04:00:03.331169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ce086-0841-48a2-b4cd-86d2b796f4e4 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:03.332574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ce086-0841-48a2-b4cd-86d2b796f4e4 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:03.332574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ce086-0841-48a2-b4cd-86d2b796f4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:03.436482 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-4a9ce086-0841-48a2-b4cd-86d2b796f4e4 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:00:03.438431 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-4a9ce086-0841-48a2-b4cd-86d2b796f4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:00:03.565127 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 04:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:00:03.744615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c9828-1143-4b81-a4f2-2c6a05e6cc5d None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:00:03.747034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-0e9c9828-1143-4b81-a4f2-2c6a05e6cc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:00:03.905556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c9828-1143-4b81-a4f2-2c6a05e6cc5d None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:00:03.914010 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59654a-5e0b-4408-a9ff-4174fd52d17e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:00:03.915817 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59654a-5e0b-4408-a9ff-4174fd52d17e service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:03.915817 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59654a-5e0b-4408-a9ff-4174fd52d17e service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:03.915817 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59654a-5e0b-4408-a9ff-4174fd52d17e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:03.925360 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59654a-5e0b-4408-a9ff-4174fd52d17e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:00:03.927614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59654a-5e0b-4408-a9ff-4174fd52d17e service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:00:03.939586 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 760/1513] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:00:04.850463 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73ccd1-eed1-4136-b8ac-7f80b809e4b9 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:04.851036 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73ccd1-eed1-4136-b8ac-7f80b809e4b9 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:04.851036 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73ccd1-eed1-4136-b8ac-7f80b809e4b9 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:04.852412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 04:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:00:04.858432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a052265-7208-4757-a2be-909c6a72557a None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:04.859094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a052265-7208-4757-a2be-909c6a72557a None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:04.859342 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a052265-7208-4757-a2be-909c6a72557a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:04.883990 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-1a052265-7208-4757-a2be-909c6a72557a None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:00:04.885231 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-1a052265-7208-4757-a2be-909c6a72557a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:00:04.893749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 04:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:00:05.069053 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73ccd1-eed1-4136-b8ac-7f80b809e4b9 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:00:05.086293 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73ccd1-eed1-4136-b8ac-7f80b809e4b9 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:00:05.093154 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c176a-1d4b-4419-b923-4c761aac3424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:00:05.094037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c176a-1d4b-4419-b923-4c761aac3424 service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:05.094322 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c176a-1d4b-4419-b923-4c761aac3424 service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:05.094600 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c176a-1d4b-4419-b923-4c761aac3424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:05.105512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c176a-1d4b-4419-b923-4c761aac3424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:00:05.107133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c176a-1d4b-4419-b923-4c761aac3424 service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:00:05.124180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 755/1516] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:00:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:00:05.570621 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250f6e1-0b50-4a9f-9c7f-74f71cba425a None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:05.570926 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250f6e1-0b50-4a9f-9c7f-74f71cba425a None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:05.571192 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250f6e1-0b50-4a9f-9c7f-74f71cba425a None None] PATH_INFO: `/v3` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:05.572613 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 762/1517] 10.222.0.69 () {54 vars in 925 bytes} [Thu Jul 28 04:00:05 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:00:05.578874 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a292-40a8-4dca-871d-08f7d468e172 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:05.579157 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a292-40a8-4dca-871d-08f7d468e172 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:05.579467 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a292-40a8-4dca-871d-08f7d468e172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:05.658788 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-e344a292-40a8-4dca-871d-08f7d468e172 None None] MFA Rules not processed for user `e91f2584622a48bba21e1bf31c1aef30`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:00:05.660781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e344a292-40a8-4dca-871d-08f7d468e172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:00:05.681944 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:05.775144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 756/1518] 10.222.0.69 () {58 vars in 1015 bytes} [Thu Jul 28 04:00:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:00:09.928401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cd749-30e8-43f9-ac60-b6632c209760 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:09.928964 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cd749-30e8-43f9-ac60-b6632c209760 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:09.928964 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cd749-30e8-43f9-ac60-b6632c209760 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:09.930456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 763/1519] 10.222.0.64 () {54 vars in 961 bytes} [Thu Jul 28 04:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:00:09.936035 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a2e77-a949-4d6f-a01f-adb9517a1728 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:09.936595 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a2e77-a949-4d6f-a01f-adb9517a1728 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:09.936741 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a2e77-a949-4d6f-a01f-adb9517a1728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:09.960472 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-4c8a2e77-a949-4d6f-a01f-adb9517a1728 None None] MFA Rules not processed for user `e91f2584622a48bba21e1bf31c1aef30`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:00:09.961897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-4c8a2e77-a949-4d6f-a01f-adb9517a1728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:00:09.971444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 757/1520] 10.222.0.64 () {58 vars in 1058 bytes} [Thu Jul 28 04:00:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:00:09.980482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cd749-30e8-43f9-ac60-b6632c209760 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:00:09.995625 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cd749-30e8-43f9-ac60-b6632c209760 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:00:10.000772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452533cc-23bb-4a64-afc9-00b48a3be346 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f2584622a48bba21e1bf31c1aef30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:00:10.001413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452533cc-23bb-4a64-afc9-00b48a3be346 service placement] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:10.001687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452533cc-23bb-4a64-afc9-00b48a3be346 service placement] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:10.001956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452533cc-23bb-4a64-afc9-00b48a3be346 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:10.012675 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452533cc-23bb-4a64-afc9-00b48a3be346 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:00:10.014304 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452533cc-23bb-4a64-afc9-00b48a3be346 service placement] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:00:10.029766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 764/1521] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:00:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:00:16.491487 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790ceec-ad12-48aa-8dbb-c449d44edb8f None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:16.492220 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790ceec-ad12-48aa-8dbb-c449d44edb8f None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:16.492220 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790ceec-ad12-48aa-8dbb-c449d44edb8f None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:16.493523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 04:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:00:16.498867 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c754d8-e2f2-4539-9c7f-36ac44acc28c None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:16.499448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c754d8-e2f2-4539-9c7f-36ac44acc28c None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:16.499448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c754d8-e2f2-4539-9c7f-36ac44acc28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:16.521911 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-b3c754d8-e2f2-4539-9c7f-36ac44acc28c None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:00:16.523160 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b3c754d8-e2f2-4539-9c7f-36ac44acc28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:00:16.531894 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 04:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:00:16.689241 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790ceec-ad12-48aa-8dbb-c449d44edb8f None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:00:16.704846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790ceec-ad12-48aa-8dbb-c449d44edb8f None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:00:16.711174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cef6b2-cd4f-4687-bd35-1d8748dd46ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:00:16.711850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cef6b2-cd4f-4687-bd35-1d8748dd46ee service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:16.712141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cef6b2-cd4f-4687-bd35-1d8748dd46ee service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:16.712415 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cef6b2-cd4f-4687-bd35-1d8748dd46ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:16.721708 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cef6b2-cd4f-4687-bd35-1d8748dd46ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:00:16.723597 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cef6b2-cd4f-4687-bd35-1d8748dd46ee service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:00:16.734092 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 759/1524] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:00:17.623306 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124729e0-e334-4f54-9a5b-7afbe324806d None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:17.623896 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124729e0-e334-4f54-9a5b-7afbe324806d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:17.624024 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124729e0-e334-4f54-9a5b-7afbe324806d None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:17.625343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 28 04:00:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:00:17.631275 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8361cd-7eac-4611-8c60-65c000837d8f None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:17.631757 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8361cd-7eac-4611-8c60-65c000837d8f None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:17.631880 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8361cd-7eac-4611-8c60-65c000837d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:17.651111 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-bb8361cd-7eac-4611-8c60-65c000837d8f None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:00:17.652385 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-bb8361cd-7eac-4611-8c60-65c000837d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:00:17.661018 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 28 04:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:00:17.826030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124729e0-e334-4f54-9a5b-7afbe324806d None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:00:17.841347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124729e0-e334-4f54-9a5b-7afbe324806d None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:00:17.846837 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53522d00-9d80-4abb-950f-c55ffe50de64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:00:17.848075 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53522d00-9d80-4abb-950f-c55ffe50de64 service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:17.848355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53522d00-9d80-4abb-950f-c55ffe50de64 service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:17.848721 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53522d00-9d80-4abb-950f-c55ffe50de64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:17.857465 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53522d00-9d80-4abb-950f-c55ffe50de64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:00:17.859053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53522d00-9d80-4abb-950f-c55ffe50de64 service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:00:17.869597 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 767/1527] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:00:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:00:21.933373 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5245a-56ee-4d2b-b4f8-1aa728bb9425 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:21.933926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5245a-56ee-4d2b-b4f8-1aa728bb9425 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:21.933926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5245a-56ee-4d2b-b4f8-1aa728bb9425 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:21.935346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 04:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:00:21.940520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f181ec-ec0c-4e5b-8133-92eb75d4e8d5 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:21.941004 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f181ec-ec0c-4e5b-8133-92eb75d4e8d5 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:21.941759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f181ec-ec0c-4e5b-8133-92eb75d4e8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:21.962308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-41f181ec-ec0c-4e5b-8133-92eb75d4e8d5 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:00:21.963584 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-41f181ec-ec0c-4e5b-8133-92eb75d4e8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:00:21.971976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 04:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:00:22.052007 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5245a-56ee-4d2b-b4f8-1aa728bb9425 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:00:22.053792 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-84a5245a-56ee-4d2b-b4f8-1aa728bb9425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:00:22.148022 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5245a-56ee-4d2b-b4f8-1aa728bb9425 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:00:22.151688 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc748403-b341-42e4-bdc8-4c015b1657fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:00:22.152314 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc748403-b341-42e4-bdc8-4c015b1657fd service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:22.152594 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc748403-b341-42e4-bdc8-4c015b1657fd service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:22.152864 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc748403-b341-42e4-bdc8-4c015b1657fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:22.162684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc748403-b341-42e4-bdc8-4c015b1657fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:00:22.164162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc748403-b341-42e4-bdc8-4c015b1657fd service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:00:22.173638 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 762/1530] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:00:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:00:24.231862 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e183670-8595-45b5-96e1-fca624f810dc None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:24.232442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e183670-8595-45b5-96e1-fca624f810dc None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:24.232442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e183670-8595-45b5-96e1-fca624f810dc None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:24.233764 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 04:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:00:24.240129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb2f04-4446-4d2c-a9a8-6400ca07a171 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:24.244981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb2f04-4446-4d2c-a9a8-6400ca07a171 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:24.244981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb2f04-4446-4d2c-a9a8-6400ca07a171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:24.262271 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-3cfb2f04-4446-4d2c-a9a8-6400ca07a171 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:00:24.263516 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-3cfb2f04-4446-4d2c-a9a8-6400ca07a171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:00:24.272774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 04:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:00:24.310259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e183670-8595-45b5-96e1-fca624f810dc None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:00:24.312197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-3e183670-8595-45b5-96e1-fca624f810dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:00:24.325456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e183670-8595-45b5-96e1-fca624f810dc None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:00:24.329026 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102df1e6-4baa-48c2-bc97-8485ed6bc9ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:00:24.329633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102df1e6-4baa-48c2-bc97-8485ed6bc9ca service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:24.329910 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102df1e6-4baa-48c2-bc97-8485ed6bc9ca service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:24.330179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102df1e6-4baa-48c2-bc97-8485ed6bc9ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:24.339894 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102df1e6-4baa-48c2-bc97-8485ed6bc9ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:00:24.341314 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102df1e6-4baa-48c2-bc97-8485ed6bc9ca service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:00:24.351401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 770/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:00:27.971086 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3a93e-8a6d-4068-aeb0-a64ab990fe95 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:27.971745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3a93e-8a6d-4068-aeb0-a64ab990fe95 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:27.971745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3a93e-8a6d-4068-aeb0-a64ab990fe95 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:27.973677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 04:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:00:27.980066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c6dac-844f-4b67-85fc-b03168697184 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:27.980586 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c6dac-844f-4b67-85fc-b03168697184 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:27.980700 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c6dac-844f-4b67-85fc-b03168697184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:28.001968 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-302c6dac-844f-4b67-85fc-b03168697184 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:00:28.004167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-302c6dac-844f-4b67-85fc-b03168697184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:00:28.017428 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 04:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:00:28.332128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3a93e-8a6d-4068-aeb0-a64ab990fe95 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:00:28.335126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-27c3a93e-8a6d-4068-aeb0-a64ab990fe95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:00:28.403666 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:28.417522 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3a93e-8a6d-4068-aeb0-a64ab990fe95 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:00:28.421240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc742e54-0f1d-4282-8afa-aa48de61a0ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:00:28.421864 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc742e54-0f1d-4282-8afa-aa48de61a0ac service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:28.422148 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc742e54-0f1d-4282-8afa-aa48de61a0ac service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:28.422426 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc742e54-0f1d-4282-8afa-aa48de61a0ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:28.433422 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc742e54-0f1d-4282-8afa-aa48de61a0ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:00:28.434883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc742e54-0f1d-4282-8afa-aa48de61a0ac service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:00:28.446520 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 765/1536] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:00:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:00:30.584154 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543d987-6dc8-4077-966d-7aa5ccef38c5 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:30.584798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543d987-6dc8-4077-966d-7aa5ccef38c5 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:30.584798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543d987-6dc8-4077-966d-7aa5ccef38c5 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:30.586093 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 28 04:00:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 04:00:30.592161 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aaae35-028b-41c2-9c01-04557b055d1c None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:30.592702 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aaae35-028b-41c2-9c01-04557b055d1c None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:30.592806 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aaae35-028b-41c2-9c01-04557b055d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:30.614103 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-07aaae35-028b-41c2-9c01-04557b055d1c None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:00:30.615334 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-07aaae35-028b-41c2-9c01-04557b055d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:00:30.623943 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 28 04:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:00:30.956923 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543d987-6dc8-4077-966d-7aa5ccef38c5 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:00:30.959934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a543d987-6dc8-4077-966d-7aa5ccef38c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:00:30.968017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=84 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:30.975683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543d987-6dc8-4077-966d-7aa5ccef38c5 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:00:30.990513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe97246-fd8e-49e7-8b2b-526f6fcea259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:00:30.990513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe97246-fd8e-49e7-8b2b-526f6fcea259 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:00:30.990513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe97246-fd8e-49e7-8b2b-526f6fcea259 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:00:30.990513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe97246-fd8e-49e7-8b2b-526f6fcea259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:00:30.992759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe97246-fd8e-49e7-8b2b-526f6fcea259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:00:30.994244 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe97246-fd8e-49e7-8b2b-526f6fcea259 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:00:31.005490 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 773/1539] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:00:40.609033 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=11 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:41.013959 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=5 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:09.540100 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69b0c5-a12f-4304-a3cd-9572e8a2ff84 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:09.540804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69b0c5-a12f-4304-a3cd-9572e8a2ff84 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:09.541069 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69b0c5-a12f-4304-a3cd-9572e8a2ff84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:09.593110 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-5c69b0c5-a12f-4304-a3cd-9572e8a2ff84 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:09.595206 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-5c69b0c5-a12f-4304-a3cd-9572e8a2ff84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:09.615524 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 767/1540] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:09.625182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022b7fe-d63e-4c27-a918-6e6aa0756ba4 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:09.625771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022b7fe-d63e-4c27-a918-6e6aa0756ba4 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:09.626207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022b7fe-d63e-4c27-a918-6e6aa0756ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:09.668123 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-6022b7fe-d63e-4c27-a918-6e6aa0756ba4 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:09.670244 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-6022b7fe-d63e-4c27-a918-6e6aa0756ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:09.690976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 774/1541] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:09.696419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69b0c5-a12f-4304-a3cd-9572e8a2ff84 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:09.713691 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69b0c5-a12f-4304-a3cd-9572e8a2ff84 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:09.719512 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22919a84-5857-45f8-9ddf-c65a103cba51 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:09.720002 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22919a84-5857-45f8-9ddf-c65a103cba51 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:09.720631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22919a84-5857-45f8-9ddf-c65a103cba51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:09.725243 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05142c23-7c7a-4d32-9877-795fd462d034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:09.725898 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05142c23-7c7a-4d32-9877-795fd462d034 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:09.726182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05142c23-7c7a-4d32-9877-795fd462d034 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:09.726459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05142c23-7c7a-4d32-9877-795fd462d034 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:09.727987 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05142c23-7c7a-4d32-9877-795fd462d034 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:02:09.728300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05142c23-7c7a-4d32-9877-795fd462d034 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:09.729937 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05142c23-7c7a-4d32-9877-795fd462d034 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:09.744977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 768/1542] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:02:09.754082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05142c23-7c7a-4d32-9877-795fd462d034 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:09.756115 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-22919a84-5857-45f8-9ddf-c65a103cba51 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:09.758538 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-22919a84-5857-45f8-9ddf-c65a103cba51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:09.770266 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05142c23-7c7a-4d32-9877-795fd462d034 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:09.778402 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126260f-8df6-4646-9b4c-b463fd8bef4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:09.778402 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126260f-8df6-4646-9b4c-b463fd8bef4a admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:09.778402 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126260f-8df6-4646-9b4c-b463fd8bef4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:09.778402 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126260f-8df6-4646-9b4c-b463fd8bef4a admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:09.778874 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126260f-8df6-4646-9b4c-b463fd8bef4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:09.778874 dv-cinder-851279-1-smb devstack@keystone.service[86894]: WARNING py.warnings [None req-3126260f-8df6-4646-9b4c-b463fd8bef4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:02:09.778874 dv-cinder-851279-1-smb devstack@keystone.service[86894]: warnings.warn(msg) Jul 28 04:02:09.778874 dv-cinder-851279-1-smb devstack@keystone.service[86894]: Jul 28 04:02:09.780257 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126260f-8df6-4646-9b4c-b463fd8bef4a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:09.784224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 775/1543] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:09.805925 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acff37-2cc2-44ac-be14-083251d62bfb None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:09.806383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acff37-2cc2-44ac-be14-083251d62bfb None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:09.806863 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acff37-2cc2-44ac-be14-083251d62bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:09.873510 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-80acff37-2cc2-44ac-be14-083251d62bfb None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:09.874870 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-80acff37-2cc2-44ac-be14-083251d62bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:09.896943 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 769/1544] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:09 2022] POST /identity/v3/projects => generated 357 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:02:09.898092 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 776/1545] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:09.904823 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126260f-8df6-4646-9b4c-b463fd8bef4a admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:09.905143 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1072df3-bb7b-498b-9c43-08292f7a251a None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:09.905512 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1072df3-bb7b-498b-9c43-08292f7a251a None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:09.905780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1072df3-bb7b-498b-9c43-08292f7a251a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:09.953626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-c1072df3-bb7b-498b-9c43-08292f7a251a None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:09.954900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c1072df3-bb7b-498b-9c43-08292f7a251a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:10.078043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 777/1546] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:10.079041 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1072df3-bb7b-498b-9c43-08292f7a251a None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:10.099053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1072df3-bb7b-498b-9c43-08292f7a251a None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:10.120106 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126260f-8df6-4646-9b4c-b463fd8bef4a admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:10.126296 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190edb46-73df-4010-89e0-dacb891f4434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:10.126971 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190edb46-73df-4010-89e0-dacb891f4434 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:10.127258 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190edb46-73df-4010-89e0-dacb891f4434 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:10.128346 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190edb46-73df-4010-89e0-dacb891f4434 admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:10.129200 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190edb46-73df-4010-89e0-dacb891f4434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:02:10.129502 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190edb46-73df-4010-89e0-dacb891f4434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:10.131461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: WARNING py.warnings [None req-190edb46-73df-4010-89e0-dacb891f4434 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:02:10.131461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: warnings.warn(msg) Jul 28 04:02:10.131461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: Jul 28 04:02:10.131461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190edb46-73df-4010-89e0-dacb891f4434 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:10.136612 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd838a-a993-4e8e-8d78-65d62faaaf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:10.137634 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd838a-a993-4e8e-8d78-65d62faaaf4a admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:10.138110 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd838a-a993-4e8e-8d78-65d62faaaf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:10.138596 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd838a-a993-4e8e-8d78-65d62faaaf4a admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:10.139818 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd838a-a993-4e8e-8d78-65d62faaaf4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:10.144034 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd838a-a993-4e8e-8d78-65d62faaaf4a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:10.157806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 778/1547] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:02:10.159414 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638d757-8740-4dba-8724-d9eb4b27ca24 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:10.159980 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638d757-8740-4dba-8724-d9eb4b27ca24 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:10.160268 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638d757-8740-4dba-8724-d9eb4b27ca24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:10.197875 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-6638d757-8740-4dba-8724-d9eb4b27ca24 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:10.199175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-6638d757-8740-4dba-8724-d9eb4b27ca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:10.219084 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 779/1548] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:10.220361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638d757-8740-4dba-8724-d9eb4b27ca24 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:10.233621 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638d757-8740-4dba-8724-d9eb4b27ca24 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:10.240190 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f53647-f465-4d60-aca5-f6f9cbbbdc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:10.241067 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f53647-f465-4d60-aca5-f6f9cbbbdc60 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:10.241343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f53647-f465-4d60-aca5-f6f9cbbbdc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:10.241756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f53647-f465-4d60-aca5-f6f9cbbbdc60 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:10.255566 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f53647-f465-4d60-aca5-f6f9cbbbdc60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:10.255566 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f53647-f465-4d60-aca5-f6f9cbbbdc60 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:10.268006 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 770/1549] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:09 2022] POST /identity/v3/users => generated 279 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:10.268006 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd838a-a993-4e8e-8d78-65d62faaaf4a admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:10.302394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd838a-a993-4e8e-8d78-65d62faaaf4a admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:10.312408 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88282db1-bc1a-43de-8d6c-bf1875a022bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:10.313175 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88282db1-bc1a-43de-8d6c-bf1875a022bf admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:10.313543 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88282db1-bc1a-43de-8d6c-bf1875a022bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:10.313823 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88282db1-bc1a-43de-8d6c-bf1875a022bf admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:10.314547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88282db1-bc1a-43de-8d6c-bf1875a022bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:02:10.314936 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88282db1-bc1a-43de-8d6c-bf1875a022bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:10.317665 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88282db1-bc1a-43de-8d6c-bf1875a022bf admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:10.349339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 771/1550] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:02:10.350162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88282db1-bc1a-43de-8d6c-bf1875a022bf admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:10.368412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88282db1-bc1a-43de-8d6c-bf1875a022bf admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:10.373630 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cb463-6930-4dcb-9cc6-ebd729d3c240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:10.374401 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cb463-6930-4dcb-9cc6-ebd729d3c240 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:10.374736 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cb463-6930-4dcb-9cc6-ebd729d3c240 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:10.375076 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cb463-6930-4dcb-9cc6-ebd729d3c240 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:10.375837 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700cb463-6930-4dcb-9cc6-ebd729d3c240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:10.376254 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 780/1551] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:10 2022] POST /identity/v3/projects => generated 367 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:10.377125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f53647-f465-4d60-aca5-f6f9cbbbdc60 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:10.378164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700cb463-6930-4dcb-9cc6-ebd729d3c240 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:10.401259 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 772/1552] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:10.401849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cb463-6930-4dcb-9cc6-ebd729d3c240 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:10.419176 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cb463-6930-4dcb-9cc6-ebd729d3c240 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:10.505455 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f53647-f465-4d60-aca5-f6f9cbbbdc60 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:10.518990 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6efbae-7b26-452e-92f9-8dfdb608e8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:10.519688 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6efbae-7b26-452e-92f9-8dfdb608e8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:10.519971 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6efbae-7b26-452e-92f9-8dfdb608e8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:10.520244 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6efbae-7b26-452e-92f9-8dfdb608e8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:10.520933 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6efbae-7b26-452e-92f9-8dfdb608e8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:10.523191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6efbae-7b26-452e-92f9-8dfdb608e8d5 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:10.578313 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b609325-f93d-46bf-908a-191c3eaa4f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:10.579192 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609325-f93d-46bf-908a-191c3eaa4f15 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:10.579393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609325-f93d-46bf-908a-191c3eaa4f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:10.579779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609325-f93d-46bf-908a-191c3eaa4f15 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:10.580381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b609325-f93d-46bf-908a-191c3eaa4f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:10.583070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b609325-f93d-46bf-908a-191c3eaa4f15 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:10.670752 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 781/1553] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:10 2022] POST /identity/v3/projects => generated 375 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:10.673798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6efbae-7b26-452e-92f9-8dfdb608e8d5 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:10.702593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 773/1554] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:10 2022] POST /identity/v3/users => generated 284 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:10.702593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07914cf-8b90-47a6-a0c3-796ced117aff None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:10.702593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07914cf-8b90-47a6-a0c3-796ced117aff None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:10.702593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07914cf-8b90-47a6-a0c3-796ced117aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:10.713337 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:10.733977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-b07914cf-8b90-47a6-a0c3-796ced117aff None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:10.735562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b07914cf-8b90-47a6-a0c3-796ced117aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:10.737431 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:10.806023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6efbae-7b26-452e-92f9-8dfdb608e8d5 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:10.813449 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d60ed-719c-424e-85c8-444f56a9fb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:10.814103 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 774/1555] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:10.814408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d60ed-719c-424e-85c8-444f56a9fb00 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:10.814873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d60ed-719c-424e-85c8-444f56a9fb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:10.815599 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfe5ab-cc1b-4d18-be70-8ba0cdaf87e7 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:10.815957 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfe5ab-cc1b-4d18-be70-8ba0cdaf87e7 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:10.829304 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d60ed-719c-424e-85c8-444f56a9fb00 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:10.829538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfe5ab-cc1b-4d18-be70-8ba0cdaf87e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:10.829691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d60ed-719c-424e-85c8-444f56a9fb00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:10.829691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d60ed-719c-424e-85c8-444f56a9fb00 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:10.831875 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 782/1556] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:10.833275 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230da06-ba1b-42c4-bf16-8273eb6abd6a None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:10.833597 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230da06-ba1b-42c4-bf16-8273eb6abd6a None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:10.834038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230da06-ba1b-42c4-bf16-8273eb6abd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:10.843775 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-82dfe5ab-cc1b-4d18-be70-8ba0cdaf87e7 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:10.845154 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-82dfe5ab-cc1b-4d18-be70-8ba0cdaf87e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:10.855480 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 775/1557] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:10.857082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7822720-5196-41a2-803a-0001c0b1e804 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:10.857470 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7822720-5196-41a2-803a-0001c0b1e804 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:10.857744 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7822720-5196-41a2-803a-0001c0b1e804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:10.866126 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-e230da06-ba1b-42c4-bf16-8273eb6abd6a None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:10.869047 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e230da06-ba1b-42c4-bf16-8273eb6abd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:10.883026 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-a7822720-5196-41a2-803a-0001c0b1e804 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:10.884282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 783/1558] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:10.884424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a7822720-5196-41a2-803a-0001c0b1e804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:10.885530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230da06-ba1b-42c4-bf16-8273eb6abd6a None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:10.901576 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 776/1559] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:10.902116 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230da06-ba1b-42c4-bf16-8273eb6abd6a None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:10.902510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7822720-5196-41a2-803a-0001c0b1e804 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:10.917041 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82829730-62c9-44c9-acb1-a42be79230f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:10.917873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7822720-5196-41a2-803a-0001c0b1e804 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:10.918221 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82829730-62c9-44c9-acb1-a42be79230f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:10.918501 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82829730-62c9-44c9-acb1-a42be79230f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:10.918773 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82829730-62c9-44c9-acb1-a42be79230f3 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:10.919598 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82829730-62c9-44c9-acb1-a42be79230f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:10.920623 dv-cinder-851279-1-smb devstack@keystone.service[86895]: WARNING py.warnings [None req-82829730-62c9-44c9-acb1-a42be79230f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:02:10.920623 dv-cinder-851279-1-smb devstack@keystone.service[86895]: warnings.warn(msg) Jul 28 04:02:10.920623 dv-cinder-851279-1-smb devstack@keystone.service[86895]: Jul 28 04:02:10.921932 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82829730-62c9-44c9-acb1-a42be79230f3 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:10.924012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78fc87-8029-45d0-b88c-b7658d6aa43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:10.925363 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78fc87-8029-45d0-b88c-b7658d6aa43e admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:10.925683 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78fc87-8029-45d0-b88c-b7658d6aa43e admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:10.925966 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78fc87-8029-45d0-b88c-b7658d6aa43e admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:10.926684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78fc87-8029-45d0-b88c-b7658d6aa43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:10.928439 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78fc87-8029-45d0-b88c-b7658d6aa43e admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:10.946586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 777/1560] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:10.952984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aa608-b198-44be-9294-9c63b7f9bb30 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:10.952984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aa608-b198-44be-9294-9c63b7f9bb30 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:10.952984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aa608-b198-44be-9294-9c63b7f9bb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:10.980180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-031aa608-b198-44be-9294-9c63b7f9bb30 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:10.981509 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-031aa608-b198-44be-9294-9c63b7f9bb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:10.991192 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 778/1561] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:10.992631 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642f884-33de-4dca-b605-d1d8457d896e None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:10.993035 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642f884-33de-4dca-b605-d1d8457d896e None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:10.993275 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642f884-33de-4dca-b605-d1d8457d896e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:11.017651 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-1642f884-33de-4dca-b605-d1d8457d896e None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:11.019980 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-1642f884-33de-4dca-b605-d1d8457d896e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:11.029144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 779/1562] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:11.029996 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642f884-33de-4dca-b605-d1d8457d896e None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:11.041292 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642f884-33de-4dca-b605-d1d8457d896e None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:11.046377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406217e6-7a6b-4e8d-b0ce-2f77da5a1a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:11.047181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406217e6-7a6b-4e8d-b0ce-2f77da5a1a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:11.047561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406217e6-7a6b-4e8d-b0ce-2f77da5a1a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:11.047884 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406217e6-7a6b-4e8d-b0ce-2f77da5a1a3a admin admin] PATH_INFO: `/v3/projects/984f291b87a84fc18e2b5468772372d2/users/271e08095d264d34b4bc8fe0cd0bbc31/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:11.066581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406217e6-7a6b-4e8d-b0ce-2f77da5a1a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=984f291b87a84fc18e2b5468772372d2, user_id=271e08095d264d34b4bc8fe0cd0bbc31, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:11.067727 dv-cinder-851279-1-smb devstack@keystone.service[86894]: WARNING py.warnings [None req-406217e6-7a6b-4e8d-b0ce-2f77da5a1a3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:02:11.067727 dv-cinder-851279-1-smb devstack@keystone.service[86894]: warnings.warn(msg) Jul 28 04:02:11.067727 dv-cinder-851279-1-smb devstack@keystone.service[86894]: Jul 28 04:02:11.069789 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406217e6-7a6b-4e8d-b0ce-2f77da5a1a3a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:11.103372 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 784/1563] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:10 2022] POST /identity/v3/users => generated 288 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:11.104720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064ea90-7aec-411f-96ce-e23c0ef57c4e None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:11.105009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064ea90-7aec-411f-96ce-e23c0ef57c4e None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:11.105295 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064ea90-7aec-411f-96ce-e23c0ef57c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:11.129384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-d064ea90-7aec-411f-96ce-e23c0ef57c4e None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:11.130670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d064ea90-7aec-411f-96ce-e23c0ef57c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:11.141628 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 785/1564] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:11.146158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d456d79-41c9-465a-96ae-b62695907d55 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:11.146158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d456d79-41c9-465a-96ae-b62695907d55 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:11.146158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d456d79-41c9-465a-96ae-b62695907d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:11.164609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-5d456d79-41c9-465a-96ae-b62695907d55 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:11.165816 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-5d456d79-41c9-465a-96ae-b62695907d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:11.173896 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 786/1565] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:11.175156 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ec8c5-d79b-4f6c-b17d-fa2768224da8 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:11.175469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ec8c5-d79b-4f6c-b17d-fa2768224da8 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:11.175745 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ec8c5-d79b-4f6c-b17d-fa2768224da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:11.194896 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-446ec8c5-d79b-4f6c-b17d-fa2768224da8 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:11.196144 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-446ec8c5-d79b-4f6c-b17d-fa2768224da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:11.204180 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 787/1566] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:11.205072 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ec8c5-d79b-4f6c-b17d-fa2768224da8 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:11.215746 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ec8c5-d79b-4f6c-b17d-fa2768224da8 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:11.221185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29ffde-cffe-4023-82cc-d6bd94256067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:11.222778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29ffde-cffe-4023-82cc-d6bd94256067 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:11.223228 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29ffde-cffe-4023-82cc-d6bd94256067 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:11.223712 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29ffde-cffe-4023-82cc-d6bd94256067 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:11.224870 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29ffde-cffe-4023-82cc-d6bd94256067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:11.227653 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29ffde-cffe-4023-82cc-d6bd94256067 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:11.233190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 780/1567] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:11 2022] PUT /identity/v3/projects/984f291b87a84fc18e2b5468772372d2/users/271e08095d264d34b4bc8fe0cd0bbc31/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:11.235223 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7670e-d41f-4685-aed8-7843365892d6 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:11.236562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7670e-d41f-4685-aed8-7843365892d6 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:11.237640 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7670e-d41f-4685-aed8-7843365892d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:11.250055 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 788/1568] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:11.250931 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29ffde-cffe-4023-82cc-d6bd94256067 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:11.262402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29ffde-cffe-4023-82cc-d6bd94256067 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:11.264913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-4fc7670e-d41f-4685-aed8-7843365892d6 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:11.266177 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-4fc7670e-d41f-4685-aed8-7843365892d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:11.330155 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14644515-b4aa-43b1-8e82-d1f80f5e0042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:11.331174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14644515-b4aa-43b1-8e82-d1f80f5e0042 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:11.331708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14644515-b4aa-43b1-8e82-d1f80f5e0042 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:11.332036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14644515-b4aa-43b1-8e82-d1f80f5e0042 admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:11.332975 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14644515-b4aa-43b1-8e82-d1f80f5e0042 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:02:11.333325 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14644515-b4aa-43b1-8e82-d1f80f5e0042 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:11.337693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 781/1569] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:11.337693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7670e-d41f-4685-aed8-7843365892d6 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:11.338014 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14644515-b4aa-43b1-8e82-d1f80f5e0042 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:11.346899 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7670e-d41f-4685-aed8-7843365892d6 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:11.350798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 789/1570] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:02:11.350798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14644515-b4aa-43b1-8e82-d1f80f5e0042 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:11.359639 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6c87f-5394-4643-93bd-5d3fc2b7e524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:11.359639 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6c87f-5394-4643-93bd-5d3fc2b7e524 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:11.359639 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6c87f-5394-4643-93bd-5d3fc2b7e524 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:11.359639 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6c87f-5394-4643-93bd-5d3fc2b7e524 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:11.359993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6c87f-5394-4643-93bd-5d3fc2b7e524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:11.359993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6c87f-5394-4643-93bd-5d3fc2b7e524 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:11.366792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14644515-b4aa-43b1-8e82-d1f80f5e0042 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:11.368250 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 782/1571] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:11.369275 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6c87f-5394-4643-93bd-5d3fc2b7e524 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:11.372564 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99e523-ab0a-4efe-879f-44f10b024a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:11.373189 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99e523-ab0a-4efe-879f-44f10b024a02 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:11.373470 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99e523-ab0a-4efe-879f-44f10b024a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:11.373742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99e523-ab0a-4efe-879f-44f10b024a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:11.374438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99e523-ab0a-4efe-879f-44f10b024a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:02:11.374811 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99e523-ab0a-4efe-879f-44f10b024a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:11.376460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99e523-ab0a-4efe-879f-44f10b024a02 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:11.379259 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6c87f-5394-4643-93bd-5d3fc2b7e524 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:11.384433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bd954-2b5b-4db4-ad40-31a37083ba78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:11.392466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bd954-2b5b-4db4-ad40-31a37083ba78 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:11.392466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bd954-2b5b-4db4-ad40-31a37083ba78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:11.392466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bd954-2b5b-4db4-ad40-31a37083ba78 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:11.392466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bd954-2b5b-4db4-ad40-31a37083ba78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:02:11.392466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bd954-2b5b-4db4-ad40-31a37083ba78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:11.392466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bd954-2b5b-4db4-ad40-31a37083ba78 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:11.393079 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 790/1572] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:02:11.393079 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99e523-ab0a-4efe-879f-44f10b024a02 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:11.402809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99e523-ab0a-4efe-879f-44f10b024a02 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:11.407090 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 783/1573] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:02:11.408442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510694de-783b-4604-8e4f-3a40301e59b7 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:11.409406 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510694de-783b-4604-8e4f-3a40301e59b7 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:11.409770 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510694de-783b-4604-8e4f-3a40301e59b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:11.415448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a47e6-9550-4bc3-b35b-3e8a6bdc3433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:11.416231 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a47e6-9550-4bc3-b35b-3e8a6bdc3433 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:11.416577 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a47e6-9550-4bc3-b35b-3e8a6bdc3433 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:11.416901 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a47e6-9550-4bc3-b35b-3e8a6bdc3433 admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:11.417753 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a47e6-9550-4bc3-b35b-3e8a6bdc3433 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:02:11.418085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a47e6-9550-4bc3-b35b-3e8a6bdc3433 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:11.419892 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a47e6-9550-4bc3-b35b-3e8a6bdc3433 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:11.439402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 791/1574] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:02:11.439402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a47e6-9550-4bc3-b35b-3e8a6bdc3433 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:11.448975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-510694de-783b-4604-8e4f-3a40301e59b7 None None] MFA Rules not processed for user `271e08095d264d34b4bc8fe0cd0bbc31`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:11.450215 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-510694de-783b-4604-8e4f-3a40301e59b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:11.452265 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a47e6-9550-4bc3-b35b-3e8a6bdc3433 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:11.458005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40088fc-d9ea-4508-a9f4-280e24e2f231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:11.458689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40088fc-d9ea-4508-a9f4-280e24e2f231 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:11.459002 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40088fc-d9ea-4508-a9f4-280e24e2f231 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:11.459308 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:11.459489 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40088fc-d9ea-4508-a9f4-280e24e2f231 admin admin] PATH_INFO: `/v3/projects/eec535f25ffb4c67ada7fd0816643a33/users/6798f81e54c54b179a85cfae02230ccf/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:11.475217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40088fc-d9ea-4508-a9f4-280e24e2f231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec535f25ffb4c67ada7fd0816643a33, user_id=6798f81e54c54b179a85cfae02230ccf, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:11.477922 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40088fc-d9ea-4508-a9f4-280e24e2f231 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:11.516869 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 784/1575] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:11 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:11.529633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510694de-783b-4604-8e4f-3a40301e59b7 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:11.529633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510694de-783b-4604-8e4f-3a40301e59b7 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:11.532584 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3938949-f37b-4580-b3c6-dcd38a1b4e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:11.533190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3938949-f37b-4580-b3c6-dcd38a1b4e23 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:11.533471 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3938949-f37b-4580-b3c6-dcd38a1b4e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:11.534424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3938949-f37b-4580-b3c6-dcd38a1b4e23 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:11.535127 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3938949-f37b-4580-b3c6-dcd38a1b4e23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:02:11.535464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3938949-f37b-4580-b3c6-dcd38a1b4e23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:11.537184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3938949-f37b-4580-b3c6-dcd38a1b4e23 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:11.548625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 785/1576] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:02:11.550145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3938949-f37b-4580-b3c6-dcd38a1b4e23 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:11.560082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3938949-f37b-4580-b3c6-dcd38a1b4e23 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:11.564569 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e5f8a-ce18-4b1a-ae55-88d792a9599f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:11.565226 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e5f8a-ce18-4b1a-ae55-88d792a9599f admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:11.565583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e5f8a-ce18-4b1a-ae55-88d792a9599f admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:11.565775 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e5f8a-ce18-4b1a-ae55-88d792a9599f admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:11.566431 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e5f8a-ce18-4b1a-ae55-88d792a9599f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:11.568366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e5f8a-ce18-4b1a-ae55-88d792a9599f admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:11.611333 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 792/1577] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:11 2022] PUT /identity/v3/projects/eec535f25ffb4c67ada7fd0816643a33/users/6798f81e54c54b179a85cfae02230ccf/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:11.612839 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40088fc-d9ea-4508-a9f4-280e24e2f231 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:11.622958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:11.682490 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40088fc-d9ea-4508-a9f4-280e24e2f231 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:11.687071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 786/1578] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:11 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:11.687538 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02f224-a4e5-4dda-a3ec-40a7b81c73c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:11.687785 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e5f8a-ce18-4b1a-ae55-88d792a9599f admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:11.688376 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02f224-a4e5-4dda-a3ec-40a7b81c73c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:11.688376 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02f224-a4e5-4dda-a3ec-40a7b81c73c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:11.688376 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02f224-a4e5-4dda-a3ec-40a7b81c73c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:11.689020 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02f224-a4e5-4dda-a3ec-40a7b81c73c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:11.691547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02f224-a4e5-4dda-a3ec-40a7b81c73c7 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:11.702337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 793/1579] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:11.703053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02f224-a4e5-4dda-a3ec-40a7b81c73c7 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:11.716336 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02f224-a4e5-4dda-a3ec-40a7b81c73c7 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:11.760676 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e5f8a-ce18-4b1a-ae55-88d792a9599f admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:11.766202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f770481-4c2d-4971-a10f-122e7a945532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:11.766880 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f770481-4c2d-4971-a10f-122e7a945532 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:11.767207 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f770481-4c2d-4971-a10f-122e7a945532 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:11.767535 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f770481-4c2d-4971-a10f-122e7a945532 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:11.768295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f770481-4c2d-4971-a10f-122e7a945532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:11.770287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f770481-4c2d-4971-a10f-122e7a945532 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:11.792688 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd4bf3-dd42-4808-8efa-4ec83813f019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:11.793351 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd4bf3-dd42-4808-8efa-4ec83813f019 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:11.793628 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd4bf3-dd42-4808-8efa-4ec83813f019 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:11.793904 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd4bf3-dd42-4808-8efa-4ec83813f019 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:11.794645 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd4bf3-dd42-4808-8efa-4ec83813f019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:11.796662 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd4bf3-dd42-4808-8efa-4ec83813f019 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:11.858596 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 787/1580] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:11 2022] POST /identity/v3/projects => generated 365 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:11.860147 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f770481-4c2d-4971-a10f-122e7a945532 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:11.926292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 794/1581] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:11 2022] POST /identity/v3/projects => generated 377 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:11.928500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd4bf3-dd42-4808-8efa-4ec83813f019 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:11.937819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f770481-4c2d-4971-a10f-122e7a945532 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:11.944285 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:12.025104 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd4bf3-dd42-4808-8efa-4ec83813f019 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:12.027557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529801a4-aa1a-4f5e-b36d-de31ea707982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:12.028198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529801a4-aa1a-4f5e-b36d-de31ea707982 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:12.028473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529801a4-aa1a-4f5e-b36d-de31ea707982 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:12.028794 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529801a4-aa1a-4f5e-b36d-de31ea707982 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:12.029440 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529801a4-aa1a-4f5e-b36d-de31ea707982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:12.031441 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529801a4-aa1a-4f5e-b36d-de31ea707982 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:12.032532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f92f52-6be7-4c83-92fe-55b326ed1b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:12.033453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f92f52-6be7-4c83-92fe-55b326ed1b78 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:12.034512 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f92f52-6be7-4c83-92fe-55b326ed1b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:12.034996 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f92f52-6be7-4c83-92fe-55b326ed1b78 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:12.036270 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f92f52-6be7-4c83-92fe-55b326ed1b78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:12.039276 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f92f52-6be7-4c83-92fe-55b326ed1b78 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:12.126826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 788/1582] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:11 2022] POST /identity/v3/projects => generated 385 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:12.128860 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529801a4-aa1a-4f5e-b36d-de31ea707982 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:12.167741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 795/1583] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:11 2022] POST /identity/v3/projects => generated 357 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:12.173759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d66ddf-6dfd-4b6d-ba1c-63be353aa5c7 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:12.173759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d66ddf-6dfd-4b6d-ba1c-63be353aa5c7 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:12.173759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d66ddf-6dfd-4b6d-ba1c-63be353aa5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:12.210141 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-e5d66ddf-6dfd-4b6d-ba1c-63be353aa5c7 None None] MFA Rules not processed for user `6798f81e54c54b179a85cfae02230ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:12.211299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e5d66ddf-6dfd-4b6d-ba1c-63be353aa5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:12.215788 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:12.252924 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529801a4-aa1a-4f5e-b36d-de31ea707982 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:12.313159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 796/1584] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:12.314608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d66ddf-6dfd-4b6d-ba1c-63be353aa5c7 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:12.326205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a334f06-235f-4163-813f-8fbe2bfca574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:12.327108 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a334f06-235f-4163-813f-8fbe2bfca574 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:12.327429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a334f06-235f-4163-813f-8fbe2bfca574 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:12.327858 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a334f06-235f-4163-813f-8fbe2bfca574 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:12.328549 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a334f06-235f-4163-813f-8fbe2bfca574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:12.331585 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a334f06-235f-4163-813f-8fbe2bfca574 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:12.398757 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d66ddf-6dfd-4b6d-ba1c-63be353aa5c7 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:12.403849 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13f169-def5-4d42-85f7-1d08166309eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:12.404504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13f169-def5-4d42-85f7-1d08166309eb admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:12.404786 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13f169-def5-4d42-85f7-1d08166309eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:12.405065 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13f169-def5-4d42-85f7-1d08166309eb admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:12.405756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13f169-def5-4d42-85f7-1d08166309eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:12.407761 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13f169-def5-4d42-85f7-1d08166309eb admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:12.443395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 789/1585] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:12 2022] POST /identity/v3/projects => generated 379 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:12.444372 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a334f06-235f-4163-813f-8fbe2bfca574 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:12.473603 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:12.506601 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 797/1586] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:12 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:12.506601 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13f169-def5-4d42-85f7-1d08166309eb admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:12.515831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a334f06-235f-4163-813f-8fbe2bfca574 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:12.516781 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13f169-def5-4d42-85f7-1d08166309eb admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:12.520972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e53aa2-eb8a-4686-889a-47f7c8b4d6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:12.521680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e53aa2-eb8a-4686-889a-47f7c8b4d6a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:12.521960 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e53aa2-eb8a-4686-889a-47f7c8b4d6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:12.522238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e53aa2-eb8a-4686-889a-47f7c8b4d6a6 admin admin] PATH_INFO: `/v3/projects/f2f313db993240f193a0d63e322eb22a/users/4e5804bdad25436294440cd1d30d2c8c/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:12.525883 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2178b7a-8e82-42c7-8e3a-63c7e6eff28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:12.526827 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2178b7a-8e82-42c7-8e3a-63c7e6eff28b admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:12.527110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2178b7a-8e82-42c7-8e3a-63c7e6eff28b admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:12.527561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2178b7a-8e82-42c7-8e3a-63c7e6eff28b admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:12.528392 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2178b7a-8e82-42c7-8e3a-63c7e6eff28b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:12.530927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2178b7a-8e82-42c7-8e3a-63c7e6eff28b admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:12.541379 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e53aa2-eb8a-4686-889a-47f7c8b4d6a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f313db993240f193a0d63e322eb22a, user_id=4e5804bdad25436294440cd1d30d2c8c, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:12.546406 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e53aa2-eb8a-4686-889a-47f7c8b4d6a6 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:12.649691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 798/1587] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:12 2022] POST /identity/v3/users => generated 283 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:12.650528 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2178b7a-8e82-42c7-8e3a-63c7e6eff28b admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:12.660248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 790/1588] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:12 2022] PUT /identity/v3/projects/f2f313db993240f193a0d63e322eb22a/users/4e5804bdad25436294440cd1d30d2c8c/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:12.663112 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2178b7a-8e82-42c7-8e3a-63c7e6eff28b admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:12.663303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e53aa2-eb8a-4686-889a-47f7c8b4d6a6 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:12.729614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eaf574-c893-4f5a-8c5e-69ad800ebcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:12.730271 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaf574-c893-4f5a-8c5e-69ad800ebcac admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:12.730559 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaf574-c893-4f5a-8c5e-69ad800ebcac admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:12.730856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaf574-c893-4f5a-8c5e-69ad800ebcac admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:12.731601 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eaf574-c893-4f5a-8c5e-69ad800ebcac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:12.733598 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eaf574-c893-4f5a-8c5e-69ad800ebcac admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:12.744744 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e53aa2-eb8a-4686-889a-47f7c8b4d6a6 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:12.750341 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0aa6a4-de06-4f6e-b3f6-04a3a224c739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:12.750984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aa6a4-de06-4f6e-b3f6-04a3a224c739 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:12.751266 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aa6a4-de06-4f6e-b3f6-04a3a224c739 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:12.751581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aa6a4-de06-4f6e-b3f6-04a3a224c739 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:12.760177 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0aa6a4-de06-4f6e-b3f6-04a3a224c739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:12.760177 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0aa6a4-de06-4f6e-b3f6-04a3a224c739 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:12.849927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 799/1589] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:12 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:12.850782 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eaf574-c893-4f5a-8c5e-69ad800ebcac admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:12.863538 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eaf574-c893-4f5a-8c5e-69ad800ebcac admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:12.868353 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577e818-d82f-44a7-806d-7d87d8168261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:12.868997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577e818-d82f-44a7-806d-7d87d8168261 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:12.869279 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577e818-d82f-44a7-806d-7d87d8168261 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:12.869555 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577e818-d82f-44a7-806d-7d87d8168261 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:12.870238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577e818-d82f-44a7-806d-7d87d8168261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:12.872244 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577e818-d82f-44a7-806d-7d87d8168261 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:12.880495 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:12.885075 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 791/1590] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:12 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:12.885950 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0aa6a4-de06-4f6e-b3f6-04a3a224c739 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:12.946714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0aa6a4-de06-4f6e-b3f6-04a3a224c739 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:12.950697 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0e5df-f917-47e9-a754-cc1ea671cb3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:12.951370 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0e5df-f917-47e9-a754-cc1ea671cb3a service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:12.951689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0e5df-f917-47e9-a754-cc1ea671cb3a service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:12.951965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0e5df-f917-47e9-a754-cc1ea671cb3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:12.988059 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 800/1591] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:12 2022] POST /identity/v3/users => generated 285 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:12.991757 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577e818-d82f-44a7-806d-7d87d8168261 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:13.002052 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577e818-d82f-44a7-806d-7d87d8168261 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:13.009536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d39dd-ad57-48e0-bcc0-410386579354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:13.010177 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d39dd-ad57-48e0-bcc0-410386579354 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:13.010456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d39dd-ad57-48e0-bcc0-410386579354 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:13.010738 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d39dd-ad57-48e0-bcc0-410386579354 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:13.011436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d39dd-ad57-48e0-bcc0-410386579354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:13.013465 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d39dd-ad57-48e0-bcc0-410386579354 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:13.028849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:13.043093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0e5df-f917-47e9-a754-cc1ea671cb3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:13.044665 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0e5df-f917-47e9-a754-cc1ea671cb3a service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:13.056315 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 792/1592] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:13.057260 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0e5df-f917-47e9-a754-cc1ea671cb3a service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:13.068677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0e5df-f917-47e9-a754-cc1ea671cb3a service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:13.073568 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d914840-cf10-46c8-a79a-8d17a6d9fb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:13.074213 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d914840-cf10-46c8-a79a-8d17a6d9fb9e admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:13.074557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d914840-cf10-46c8-a79a-8d17a6d9fb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:13.074796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d914840-cf10-46c8-a79a-8d17a6d9fb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:13.075547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d914840-cf10-46c8-a79a-8d17a6d9fb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:13.077189 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d914840-cf10-46c8-a79a-8d17a6d9fb9e admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:13.095713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 793/1593] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:13.095713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d914840-cf10-46c8-a79a-8d17a6d9fb9e admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:13.104634 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d914840-cf10-46c8-a79a-8d17a6d9fb9e admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:13.109614 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c22c9-dcbe-4409-9ef4-cc02e442b852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:13.110237 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c22c9-dcbe-4409-9ef4-cc02e442b852 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:13.110523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c22c9-dcbe-4409-9ef4-cc02e442b852 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:13.110801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c22c9-dcbe-4409-9ef4-cc02e442b852 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:13.111553 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c22c9-dcbe-4409-9ef4-cc02e442b852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:13.113889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c22c9-dcbe-4409-9ef4-cc02e442b852 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:13.120955 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 801/1594] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:12 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:13.136008 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75360c74-979f-49fd-a89f-54261b63d387 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:13.136008 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75360c74-979f-49fd-a89f-54261b63d387 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:13.136008 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75360c74-979f-49fd-a89f-54261b63d387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:13.136523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 794/1595] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:13.136523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c22c9-dcbe-4409-9ef4-cc02e442b852 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:13.137585 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c22c9-dcbe-4409-9ef4-cc02e442b852 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:13.143485 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95930e19-55dc-48bc-9e93-8d7416dbfdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:13.144066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95930e19-55dc-48bc-9e93-8d7416dbfdce admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:13.144358 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95930e19-55dc-48bc-9e93-8d7416dbfdce admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:13.144639 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95930e19-55dc-48bc-9e93-8d7416dbfdce admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:13.145348 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95930e19-55dc-48bc-9e93-8d7416dbfdce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:13.147071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95930e19-55dc-48bc-9e93-8d7416dbfdce admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:13.161918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-75360c74-979f-49fd-a89f-54261b63d387 None None] MFA Rules not processed for user `4e5804bdad25436294440cd1d30d2c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:13.163727 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-75360c74-979f-49fd-a89f-54261b63d387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:13.164576 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 795/1596] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:13.166213 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95930e19-55dc-48bc-9e93-8d7416dbfdce admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:13.179878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95930e19-55dc-48bc-9e93-8d7416dbfdce admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:13.188553 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d8d28-84c1-43f4-9b1c-998ff76dd809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:13.190237 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d8d28-84c1-43f4-9b1c-998ff76dd809 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:13.190525 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d8d28-84c1-43f4-9b1c-998ff76dd809 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:13.191006 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d8d28-84c1-43f4-9b1c-998ff76dd809 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:13.192268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d8d28-84c1-43f4-9b1c-998ff76dd809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:13.195217 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d8d28-84c1-43f4-9b1c-998ff76dd809 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:13.217462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 796/1597] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:13.217462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d8d28-84c1-43f4-9b1c-998ff76dd809 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:13.235367 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d8d28-84c1-43f4-9b1c-998ff76dd809 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:13.244907 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fb91e-434e-43e6-9912-f0c6304fd72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:13.244907 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fb91e-434e-43e6-9912-f0c6304fd72f admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:13.244907 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fb91e-434e-43e6-9912-f0c6304fd72f admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:13.244907 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fb91e-434e-43e6-9912-f0c6304fd72f admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:13.245637 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fb91e-434e-43e6-9912-f0c6304fd72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:13.247356 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fb91e-434e-43e6-9912-f0c6304fd72f admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:13.261130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 797/1598] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:13.262040 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fb91e-434e-43e6-9912-f0c6304fd72f admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:13.280522 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fb91e-434e-43e6-9912-f0c6304fd72f admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:13.285117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 802/1599] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:13.286560 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75360c74-979f-49fd-a89f-54261b63d387 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:13.287676 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9342ba-30bc-4333-8017-0c1a60f7b4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:13.288336 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9342ba-30bc-4333-8017-0c1a60f7b4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:13.288626 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9342ba-30bc-4333-8017-0c1a60f7b4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:13.288955 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9342ba-30bc-4333-8017-0c1a60f7b4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:13.289694 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9342ba-30bc-4333-8017-0c1a60f7b4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:13.292266 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9342ba-30bc-4333-8017-0c1a60f7b4e7 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:13.304046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 798/1600] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:13.305065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9342ba-30bc-4333-8017-0c1a60f7b4e7 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:13.313916 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75360c74-979f-49fd-a89f-54261b63d387 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:13.317852 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9342ba-30bc-4333-8017-0c1a60f7b4e7 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:13.321930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdc0d1-ba96-4992-8178-c19bdeff4898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:13.322968 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdc0d1-ba96-4992-8178-c19bdeff4898 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:13.323457 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdc0d1-ba96-4992-8178-c19bdeff4898 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:13.323916 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccdc0d1-ba96-4992-8178-c19bdeff4898 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:13.325129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0f1be-052e-4f08-b2ab-e05bf5562650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:13.325359 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccdc0d1-ba96-4992-8178-c19bdeff4898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:13.325925 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0f1be-052e-4f08-b2ab-e05bf5562650 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:13.326282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0f1be-052e-4f08-b2ab-e05bf5562650 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:13.326632 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0f1be-052e-4f08-b2ab-e05bf5562650 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:13.327484 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0f1be-052e-4f08-b2ab-e05bf5562650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:13.328364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccdc0d1-ba96-4992-8178-c19bdeff4898 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:13.329408 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0f1be-052e-4f08-b2ab-e05bf5562650 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:13.348309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 799/1601] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:13.348309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0f1be-052e-4f08-b2ab-e05bf5562650 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:13.358921 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0f1be-052e-4f08-b2ab-e05bf5562650 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:13.371771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 803/1602] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:13.371771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdc0d1-ba96-4992-8178-c19bdeff4898 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:13.373202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3defd2d-036a-4cc0-b9cd-686a8484191a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:13.374301 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3defd2d-036a-4cc0-b9cd-686a8484191a admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:13.374818 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3defd2d-036a-4cc0-b9cd-686a8484191a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:13.374994 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3defd2d-036a-4cc0-b9cd-686a8484191a admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:13.376560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3defd2d-036a-4cc0-b9cd-686a8484191a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:13.380163 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3defd2d-036a-4cc0-b9cd-686a8484191a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:13.400042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 800/1603] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:13.400042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3defd2d-036a-4cc0-b9cd-686a8484191a admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:13.400480 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccdc0d1-ba96-4992-8178-c19bdeff4898 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:13.406083 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3defd2d-036a-4cc0-b9cd-686a8484191a admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:13.406562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb9ea5-6b24-4371-9185-d0c41eddbdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:13.407280 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb9ea5-6b24-4371-9185-d0c41eddbdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:13.407771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb9ea5-6b24-4371-9185-d0c41eddbdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:13.408113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb9ea5-6b24-4371-9185-d0c41eddbdc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:13.409560 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb9ea5-6b24-4371-9185-d0c41eddbdc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:13.411434 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb9ea5-6b24-4371-9185-d0c41eddbdc6 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:13.412747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3c643-da60-4eb2-b595-d9b17178790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:13.413564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3c643-da60-4eb2-b595-d9b17178790a admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:13.413910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3c643-da60-4eb2-b595-d9b17178790a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:13.414260 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3c643-da60-4eb2-b595-d9b17178790a admin admin] PATH_INFO: `/v3/projects/4e3d1fa7c0cd4588b503fee6392efab1/users/8c19511384c346c6b02faa4ef5d1c837/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:13.428787 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 804/1604] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:13.429740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb9ea5-6b24-4371-9185-d0c41eddbdc6 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:13.433857 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3c643-da60-4eb2-b595-d9b17178790a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3d1fa7c0cd4588b503fee6392efab1, user_id=8c19511384c346c6b02faa4ef5d1c837, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:13.436764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3c643-da60-4eb2-b595-d9b17178790a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:13.443009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb9ea5-6b24-4371-9185-d0c41eddbdc6 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:13.456957 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324111b-cb47-4598-9332-c4dc8b97b1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:13.456957 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324111b-cb47-4598-9332-c4dc8b97b1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:13.456957 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324111b-cb47-4598-9332-c4dc8b97b1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:13.456957 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324111b-cb47-4598-9332-c4dc8b97b1c4 admin admin] PATH_INFO: `/v3/projects/94dcff837ea64eb582ed08b78b7aeed7/users/19dbbaf75bf74faf96e0c382572b3645/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:13.473033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324111b-cb47-4598-9332-c4dc8b97b1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94dcff837ea64eb582ed08b78b7aeed7, user_id=19dbbaf75bf74faf96e0c382572b3645, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:13.475872 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324111b-cb47-4598-9332-c4dc8b97b1c4 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:13.617822 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 805/1605] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:13 2022] PUT /identity/v3/projects/94dcff837ea64eb582ed08b78b7aeed7/users/19dbbaf75bf74faf96e0c382572b3645/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:13.618191 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 801/1606] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:13 2022] PUT /identity/v3/projects/4e3d1fa7c0cd4588b503fee6392efab1/users/8c19511384c346c6b02faa4ef5d1c837/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:13.619169 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324111b-cb47-4598-9332-c4dc8b97b1c4 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:13.619564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa264f8-ea6d-4ffd-a634-d659ec6bccbe None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:13.619856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa264f8-ea6d-4ffd-a634-d659ec6bccbe None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:13.620133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa264f8-ea6d-4ffd-a634-d659ec6bccbe None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:13.621822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 802/1607] 10.222.0.64 () {54 vars in 962 bytes} [Thu Jul 28 04:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:02:13.622567 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa264f8-ea6d-4ffd-a634-d659ec6bccbe None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:13.691829 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324111b-cb47-4598-9332-c4dc8b97b1c4 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:13.700044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406733b-2adc-4b49-a882-bfbf69858f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:13.700697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406733b-2adc-4b49-a882-bfbf69858f1a admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:13.700979 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406733b-2adc-4b49-a882-bfbf69858f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:13.701329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406733b-2adc-4b49-a882-bfbf69858f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:13.701985 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406733b-2adc-4b49-a882-bfbf69858f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:13.704423 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa264f8-ea6d-4ffd-a634-d659ec6bccbe None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:13.705082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406733b-2adc-4b49-a882-bfbf69858f1a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:13.710928 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91b9a9-4f6d-41e3-a284-7d567c5b1b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:13.711658 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91b9a9-4f6d-41e3-a284-7d567c5b1b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:13.711945 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91b9a9-4f6d-41e3-a284-7d567c5b1b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:13.712230 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91b9a9-4f6d-41e3-a284-7d567c5b1b08 admin admin] PATH_INFO: `/v3/projects/6c8e0e3f6b684839b1453b092d4acf5a/users/b99f5b243186467b8f6972d01c6c63ae/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:13.718845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 806/1608] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:13.723042 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406733b-2adc-4b49-a882-bfbf69858f1a admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:13.734831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406733b-2adc-4b49-a882-bfbf69858f1a admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:13.737128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91b9a9-4f6d-41e3-a284-7d567c5b1b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c8e0e3f6b684839b1453b092d4acf5a, user_id=b99f5b243186467b8f6972d01c6c63ae, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:13.740383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60864a-4b06-43d8-9719-33e7e81d266c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:13.740573 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91b9a9-4f6d-41e3-a284-7d567c5b1b08 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:13.741138 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60864a-4b06-43d8-9719-33e7e81d266c admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:13.741614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60864a-4b06-43d8-9719-33e7e81d266c admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:13.741951 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60864a-4b06-43d8-9719-33e7e81d266c admin admin] PATH_INFO: `/v3/projects/8a055fb7397a4ab69829b214c0a7f136/users/239971f05a0b4ba4874c167c26927c98/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:13.752183 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:13.760045 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60864a-4b06-43d8-9719-33e7e81d266c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a055fb7397a4ab69829b214c0a7f136, user_id=239971f05a0b4ba4874c167c26927c98, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:13.762919 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60864a-4b06-43d8-9719-33e7e81d266c admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:13.880618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 803/1609] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:13 2022] PUT /identity/v3/projects/6c8e0e3f6b684839b1453b092d4acf5a/users/b99f5b243186467b8f6972d01c6c63ae/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:13.881456 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91b9a9-4f6d-41e3-a284-7d567c5b1b08 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:13.901026 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 807/1610] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:13 2022] PUT /identity/v3/projects/8a055fb7397a4ab69829b214c0a7f136/users/239971f05a0b4ba4874c167c26927c98/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:13.901909 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60864a-4b06-43d8-9719-33e7e81d266c admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:13.934385 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:13.983181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91b9a9-4f6d-41e3-a284-7d567c5b1b08 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:13.986552 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60864a-4b06-43d8-9719-33e7e81d266c admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:13.989132 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f501dc0-8b30-45ef-9722-e6824cff6a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:13.989890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f501dc0-8b30-45ef-9722-e6824cff6a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:13.990247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f501dc0-8b30-45ef-9722-e6824cff6a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:13.990592 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f501dc0-8b30-45ef-9722-e6824cff6a24 admin admin] PATH_INFO: `/v3/projects/c2aaa893884440db9d577a7cde4cecbf/users/414b0f1addcc487fb2834b16d7047923/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:13.992096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d48bf-e170-46f1-84d6-3a12ccbebf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:13.992735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d48bf-e170-46f1-84d6-3a12ccbebf72 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:13.993018 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d48bf-e170-46f1-84d6-3a12ccbebf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:13.993300 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d48bf-e170-46f1-84d6-3a12ccbebf72 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:13.994011 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d48bf-e170-46f1-84d6-3a12ccbebf72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:13.995744 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d48bf-e170-46f1-84d6-3a12ccbebf72 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:14.008224 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f501dc0-8b30-45ef-9722-e6824cff6a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2aaa893884440db9d577a7cde4cecbf, user_id=414b0f1addcc487fb2834b16d7047923, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:14.010281 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 808/1611] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:14.011007 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f501dc0-8b30-45ef-9722-e6824cff6a24 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:14.011779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e740ad-05a4-4855-a7f7-7c5f4cdcfecf None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:14.012074 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e740ad-05a4-4855-a7f7-7c5f4cdcfecf None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:14.012354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e740ad-05a4-4855-a7f7-7c5f4cdcfecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:14.052927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-f4e740ad-05a4-4855-a7f7-7c5f4cdcfecf None None] MFA Rules not processed for user `5133abf4c32a45b0b2188f71496c572b`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:14.054164 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f4e740ad-05a4-4855-a7f7-7c5f4cdcfecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:14.105285 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 804/1612] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:13 2022] PUT /identity/v3/projects/c2aaa893884440db9d577a7cde4cecbf/users/414b0f1addcc487fb2834b16d7047923/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:14.106989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e5b10-818b-4e27-a3c5-8915cae0aea8 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:14.107465 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e5b10-818b-4e27-a3c5-8915cae0aea8 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:14.107919 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e5b10-818b-4e27-a3c5-8915cae0aea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:14.146351 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 809/1613] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Jul 28 04:02:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:14.147191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e740ad-05a4-4855-a7f7-7c5f4cdcfecf None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:14.159720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e740ad-05a4-4855-a7f7-7c5f4cdcfecf None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:14.163650 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-403e5b10-818b-4e27-a3c5-8915cae0aea8 None None] MFA Rules not processed for user `19dbbaf75bf74faf96e0c382572b3645`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:14.165670 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-403e5b10-818b-4e27-a3c5-8915cae0aea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:14.244207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d037c0c-3a3c-4cb0-97ad-e1d3743fe85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:14.244893 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d037c0c-3a3c-4cb0-97ad-e1d3743fe85b admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:14.246211 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d037c0c-3a3c-4cb0-97ad-e1d3743fe85b admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:14.246211 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d037c0c-3a3c-4cb0-97ad-e1d3743fe85b admin admin] PATH_INFO: `/v3/projects/b698854e481144e482c549f8e02d4969/users/4f91caa3c691497d828f6a91c1a4c4ce/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:14.250357 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:14.263711 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d037c0c-3a3c-4cb0-97ad-e1d3743fe85b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b698854e481144e482c549f8e02d4969, user_id=4f91caa3c691497d828f6a91c1a4c4ce, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:14.268330 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d037c0c-3a3c-4cb0-97ad-e1d3743fe85b admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:14.274795 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 805/1614] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:14.276858 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94629d49-7a14-4d2f-ba00-58e51a38a9fd None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:14.277371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94629d49-7a14-4d2f-ba00-58e51a38a9fd None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:14.277856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94629d49-7a14-4d2f-ba00-58e51a38a9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:14.323844 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-94629d49-7a14-4d2f-ba00-58e51a38a9fd None None] MFA Rules not processed for user `b99f5b243186467b8f6972d01c6c63ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:14.325376 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-94629d49-7a14-4d2f-ba00-58e51a38a9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:14.414043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 810/1615] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:14 2022] PUT /identity/v3/projects/b698854e481144e482c549f8e02d4969/users/4f91caa3c691497d828f6a91c1a4c4ce/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:14.414043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d9499-0102-47f3-b0f6-9ead67aa3d7b None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:14.414043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d9499-0102-47f3-b0f6-9ead67aa3d7b None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:14.414043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d9499-0102-47f3-b0f6-9ead67aa3d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:14.438381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 806/1616] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:14.439608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94629d49-7a14-4d2f-ba00-58e51a38a9fd None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:14.452024 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-7a2d9499-0102-47f3-b0f6-9ead67aa3d7b None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:14.452495 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94629d49-7a14-4d2f-ba00-58e51a38a9fd None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:14.454278 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-7a2d9499-0102-47f3-b0f6-9ead67aa3d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:14.477967 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:14.520375 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b8dc4-4cc7-433e-a651-5f152598cb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:14.521269 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b8dc4-4cc7-433e-a651-5f152598cb91 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:14.521551 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b8dc4-4cc7-433e-a651-5f152598cb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:14.521830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b8dc4-4cc7-433e-a651-5f152598cb91 admin admin] PATH_INFO: `/v3/projects/4e3d1fa7c0cd4588b503fee6392efab1/users/8c19511384c346c6b02faa4ef5d1c837/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:14.524067 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b8dc4-4cc7-433e-a651-5f152598cb91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3d1fa7c0cd4588b503fee6392efab1, user_id=8c19511384c346c6b02faa4ef5d1c837, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:14.526925 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b8dc4-4cc7-433e-a651-5f152598cb91 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:14.539338 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 807/1617] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:14 2022] PUT /identity/v3/projects/4e3d1fa7c0cd4588b503fee6392efab1/users/8c19511384c346c6b02faa4ef5d1c837/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:14.541668 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f6462-ec93-4851-b859-54a774715bdd None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:14.542080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f6462-ec93-4851-b859-54a774715bdd None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:14.542569 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f6462-ec93-4851-b859-54a774715bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:14.554920 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 811/1618] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:14.559466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d9499-0102-47f3-b0f6-9ead67aa3d7b None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:14.587239 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-d14f6462-ec93-4851-b859-54a774715bdd None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:14.589182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-d14f6462-ec93-4851-b859-54a774715bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:14.659159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d9499-0102-47f3-b0f6-9ead67aa3d7b None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:14.669179 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 808/1619] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:14.669978 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f6462-ec93-4851-b859-54a774715bdd None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:14.682811 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f6462-ec93-4851-b859-54a774715bdd None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:14.687945 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a3397-f52c-4fa6-8651-5fe4993baee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:14.688638 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a3397-f52c-4fa6-8651-5fe4993baee9 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:14.689042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a3397-f52c-4fa6-8651-5fe4993baee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:14.689421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a3397-f52c-4fa6-8651-5fe4993baee9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:14.690768 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a3397-f52c-4fa6-8651-5fe4993baee9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:14.693137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a3397-f52c-4fa6-8651-5fe4993baee9 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:14.748320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cd8cc-f3c6-48e9-91f2-327b5fd094cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:14.749012 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cd8cc-f3c6-48e9-91f2-327b5fd094cc service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:14.749246 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cd8cc-f3c6-48e9-91f2-327b5fd094cc service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:14.749527 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cd8cc-f3c6-48e9-91f2-327b5fd094cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:14.773255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:14.795549 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 809/1620] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:14 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:14.796905 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77521581-16e7-4455-ad67-0093dbfe7542 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:14.797200 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77521581-16e7-4455-ad67-0093dbfe7542 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:14.797482 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77521581-16e7-4455-ad67-0093dbfe7542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:14.820157 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-77521581-16e7-4455-ad67-0093dbfe7542 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:14.821455 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-77521581-16e7-4455-ad67-0093dbfe7542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:14.835080 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cd8cc-f3c6-48e9-91f2-327b5fd094cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:14.837110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cd8cc-f3c6-48e9-91f2-327b5fd094cc service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:14.853973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 812/1621] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:14.855193 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cd8cc-f3c6-48e9-91f2-327b5fd094cc service nova] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:14.872073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cd8cc-f3c6-48e9-91f2-327b5fd094cc service nova] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:14.919910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 810/1622] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:14.924930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9c01e-3902-472d-8d72-cbf95e850c8a None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:14.925356 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9c01e-3902-472d-8d72-cbf95e850c8a None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:14.925811 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9c01e-3902-472d-8d72-cbf95e850c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:14.950105 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a90bec-0e5b-4208-a3f2-ae22c0fdcd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:14.950576 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a90bec-0e5b-4208-a3f2-ae22c0fdcd75 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:14.950948 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a90bec-0e5b-4208-a3f2-ae22c0fdcd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:14.951361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a90bec-0e5b-4208-a3f2-ae22c0fdcd75 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:14.952132 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a90bec-0e5b-4208-a3f2-ae22c0fdcd75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:14.954124 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a90bec-0e5b-4208-a3f2-ae22c0fdcd75 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:14.960494 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-4bd9c01e-3902-472d-8d72-cbf95e850c8a None None] MFA Rules not processed for user `8c19511384c346c6b02faa4ef5d1c837`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:14.962386 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-4bd9c01e-3902-472d-8d72-cbf95e850c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:15.000263 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:15.045373 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 811/1623] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:14 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:15.046418 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9c01e-3902-472d-8d72-cbf95e850c8a None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:15.063368 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 813/1624] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:14 2022] POST /identity/v3/projects => generated 363 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:15.065601 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a90bec-0e5b-4208-a3f2-ae22c0fdcd75 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:15.123143 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9c01e-3902-472d-8d72-cbf95e850c8a None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:15.144991 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a90bec-0e5b-4208-a3f2-ae22c0fdcd75 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:15.149405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187574e1-b5e6-4fc3-8628-662708683a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:15.150193 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187574e1-b5e6-4fc3-8628-662708683a2c service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:15.150537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187574e1-b5e6-4fc3-8628-662708683a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:15.150885 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187574e1-b5e6-4fc3-8628-662708683a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:15.185748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71a8f7-87ff-4360-a50e-885a06b7569e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:15.186536 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71a8f7-87ff-4360-a50e-885a06b7569e service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:15.186699 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71a8f7-87ff-4360-a50e-885a06b7569e service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:15.186989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71a8f7-87ff-4360-a50e-885a06b7569e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:15.225191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:15.227307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187574e1-b5e6-4fc3-8628-662708683a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:15.229042 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187574e1-b5e6-4fc3-8628-662708683a2c service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:15.240577 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 814/1625] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:15.250386 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187574e1-b5e6-4fc3-8628-662708683a2c service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:15.253880 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187574e1-b5e6-4fc3-8628-662708683a2c service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:15.259768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fef8b9-742b-412e-a8e1-10e52ec43e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:15.260310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fef8b9-742b-412e-a8e1-10e52ec43e40 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:15.260607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fef8b9-742b-412e-a8e1-10e52ec43e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:15.260883 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fef8b9-742b-412e-a8e1-10e52ec43e40 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:15.261558 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fef8b9-742b-412e-a8e1-10e52ec43e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:15.263529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fef8b9-742b-412e-a8e1-10e52ec43e40 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:15.290158 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71a8f7-87ff-4360-a50e-885a06b7569e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:15.291959 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71a8f7-87ff-4360-a50e-885a06b7569e service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:15.303233 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 812/1626] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:15.304212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71a8f7-87ff-4360-a50e-885a06b7569e service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:15.312858 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71a8f7-87ff-4360-a50e-885a06b7569e service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:15.318266 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6909b2-13d0-41a0-a7bb-7bf6f6a3a1a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:15.322260 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6909b2-13d0-41a0-a7bb-7bf6f6a3a1a4 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:15.322260 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6909b2-13d0-41a0-a7bb-7bf6f6a3a1a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:15.322260 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6909b2-13d0-41a0-a7bb-7bf6f6a3a1a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:15.329788 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6909b2-13d0-41a0-a7bb-7bf6f6a3a1a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:15.331925 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6909b2-13d0-41a0-a7bb-7bf6f6a3a1a4 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:15.343734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 813/1627] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:15.344784 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6909b2-13d0-41a0-a7bb-7bf6f6a3a1a4 service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:15.381225 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:15.382687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 815/1628] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:15 2022] POST /identity/v3/users => generated 297 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:15.383658 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fef8b9-742b-412e-a8e1-10e52ec43e40 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:15.394841 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fef8b9-742b-412e-a8e1-10e52ec43e40 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:15.405969 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40f278-2af5-44d7-9df4-813527793098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:15.409697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40f278-2af5-44d7-9df4-813527793098 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:15.416276 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40f278-2af5-44d7-9df4-813527793098 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:15.416276 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40f278-2af5-44d7-9df4-813527793098 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:15.416276 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40f278-2af5-44d7-9df4-813527793098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:15.416276 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40f278-2af5-44d7-9df4-813527793098 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:15.463177 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6909b2-13d0-41a0-a7bb-7bf6f6a3a1a4 service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:15.468543 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccf2e3-4d3f-40cd-a3b5-ba71a4de3fee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:15.469450 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccf2e3-4d3f-40cd-a3b5-ba71a4de3fee service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:15.469932 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccf2e3-4d3f-40cd-a3b5-ba71a4de3fee service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:15.470386 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccf2e3-4d3f-40cd-a3b5-ba71a4de3fee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:15.547761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbccf2e3-4d3f-40cd-a3b5-ba71a4de3fee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:15.550513 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbccf2e3-4d3f-40cd-a3b5-ba71a4de3fee service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:15.569318 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 814/1629] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:15 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:15.569318 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccf2e3-4d3f-40cd-a3b5-ba71a4de3fee service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:15.576357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccf2e3-4d3f-40cd-a3b5-ba71a4de3fee service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:15.582875 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd7eb2-e475-4219-94c6-2d5fea905c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:15.583345 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd7eb2-e475-4219-94c6-2d5fea905c9c admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:15.583788 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd7eb2-e475-4219-94c6-2d5fea905c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:15.584155 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd7eb2-e475-4219-94c6-2d5fea905c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:15.585285 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd7eb2-e475-4219-94c6-2d5fea905c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:15.587495 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd7eb2-e475-4219-94c6-2d5fea905c9c admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:15.598109 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 816/1630] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:15 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:15.598109 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11779e-1d11-42b1-b8a0-da0453aec9e8 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:15.598109 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11779e-1d11-42b1-b8a0-da0453aec9e8 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:15.598459 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11779e-1d11-42b1-b8a0-da0453aec9e8 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:15.600008 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 817/1631] 10.222.0.64 () {54 vars in 912 bytes} [Thu Jul 28 04:02:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:02:15.601051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b70d9-9c99-4d7a-a666-b1d511b29c70 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:15.601348 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b70d9-9c99-4d7a-a666-b1d511b29c70 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:15.601626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b70d9-9c99-4d7a-a666-b1d511b29c70 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:15.603186 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 818/1632] 10.222.0.64 () {54 vars in 962 bytes} [Thu Jul 28 04:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:02:15.607821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 815/1633] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:15.608566 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b70d9-9c99-4d7a-a666-b1d511b29c70 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:15.609256 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2264771-ec11-4c19-8c01-c1631e34272e None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:15.609547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2264771-ec11-4c19-8c01-c1631e34272e None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:15.609818 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2264771-ec11-4c19-8c01-c1631e34272e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:15.626285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b70d9-9c99-4d7a-a666-b1d511b29c70 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:15.632519 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b32e1b-e046-490e-9bee-81940364132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:15.632759 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-e2264771-ec11-4c19-8c01-c1631e34272e None None] MFA Rules not processed for user `5133abf4c32a45b0b2188f71496c572b`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:15.633399 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b32e1b-e046-490e-9bee-81940364132e admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:15.633770 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b32e1b-e046-490e-9bee-81940364132e admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:15.634536 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e2264771-ec11-4c19-8c01-c1631e34272e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:15.634685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b32e1b-e046-490e-9bee-81940364132e admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:15.635313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b32e1b-e046-490e-9bee-81940364132e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:15.637060 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b32e1b-e046-490e-9bee-81940364132e admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:15.651096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 819/1634] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:15.655974 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c27607-64fc-433d-aa45-2a6b2b9854a9 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:15.656339 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c27607-64fc-433d-aa45-2a6b2b9854a9 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:15.657057 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c27607-64fc-433d-aa45-2a6b2b9854a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:15.688816 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-79c27607-64fc-433d-aa45-2a6b2b9854a9 None None] MFA Rules not processed for user `5133abf4c32a45b0b2188f71496c572b`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:15.690862 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-79c27607-64fc-433d-aa45-2a6b2b9854a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:15.730541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 816/1635] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 28 04:02:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:15.731705 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2264771-ec11-4c19-8c01-c1631e34272e None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:15.751242 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2264771-ec11-4c19-8c01-c1631e34272e None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:15.757789 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812bbeb-b29b-4ccb-a9d8-89973799ae1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:15.759162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812bbeb-b29b-4ccb-a9d8-89973799ae1a admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:15.759725 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812bbeb-b29b-4ccb-a9d8-89973799ae1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:15.760078 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812bbeb-b29b-4ccb-a9d8-89973799ae1a admin admin] PATH_INFO: `/v3/projects/dee22a9595b742fcb867aee7f83dac5f/users/ca6962fd156d44539c208ce4b1f1da86/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:15.786929 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812bbeb-b29b-4ccb-a9d8-89973799ae1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee22a9595b742fcb867aee7f83dac5f, user_id=ca6962fd156d44539c208ce4b1f1da86, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:15.791499 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 820/1636] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Jul 28 04:02:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:15.792120 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812bbeb-b29b-4ccb-a9d8-89973799ae1a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:15.792739 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c27607-64fc-433d-aa45-2a6b2b9854a9 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:15.805033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c27607-64fc-433d-aa45-2a6b2b9854a9 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:15.810390 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96615c6f-6b2c-4f64-995e-3be31bce564a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:15.811156 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96615c6f-6b2c-4f64-995e-3be31bce564a admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:15.811555 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96615c6f-6b2c-4f64-995e-3be31bce564a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:15.811904 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96615c6f-6b2c-4f64-995e-3be31bce564a admin admin] PATH_INFO: `/v3/projects/c1f381758cdd44aaa821043271f95458/users/1761d231a11947fda5894e1ff6b0f1df/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:15.828224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96615c6f-6b2c-4f64-995e-3be31bce564a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f381758cdd44aaa821043271f95458, user_id=1761d231a11947fda5894e1ff6b0f1df, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:15.831745 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96615c6f-6b2c-4f64-995e-3be31bce564a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:15.881873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 817/1637] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:15 2022] PUT /identity/v3/projects/dee22a9595b742fcb867aee7f83dac5f/users/ca6962fd156d44539c208ce4b1f1da86/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:15.881873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812bbeb-b29b-4ccb-a9d8-89973799ae1a admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:15.926676 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 821/1638] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:15 2022] PUT /identity/v3/projects/c1f381758cdd44aaa821043271f95458/users/1761d231a11947fda5894e1ff6b0f1df/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:15.928648 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:15.930954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e2639-7d04-46d6-acd1-dd7054840385 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:15.931248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e2639-7d04-46d6-acd1-dd7054840385 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:15.931613 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e2639-7d04-46d6-acd1-dd7054840385 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:15.933380 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 822/1639] 10.222.0.64 () {54 vars in 912 bytes} [Thu Jul 28 04:02:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:02:15.934211 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e2639-7d04-46d6-acd1-dd7054840385 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:15.979765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812bbeb-b29b-4ccb-a9d8-89973799ae1a admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:16.019717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e2639-7d04-46d6-acd1-dd7054840385 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:16.030839 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5df5b-4fb4-483e-a4a4-9be1d2a9ad7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:16.032203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5df5b-4fb4-483e-a4a4-9be1d2a9ad7f service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:16.033141 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5df5b-4fb4-483e-a4a4-9be1d2a9ad7f service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:16.040048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5df5b-4fb4-483e-a4a4-9be1d2a9ad7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:16.043305 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d2d1f-85ee-4cf4-8cc4-be7446f639ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:16.043982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d2d1f-85ee-4cf4-8cc4-be7446f639ef service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:16.044267 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d2d1f-85ee-4cf4-8cc4-be7446f639ef service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:16.044543 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d2d1f-85ee-4cf4-8cc4-be7446f639ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:16.086211 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:16.119678 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5df5b-4fb4-483e-a4a4-9be1d2a9ad7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:16.121134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5df5b-4fb4-483e-a4a4-9be1d2a9ad7f service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:16.132939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 823/1640] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:15 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:16.133841 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5df5b-4fb4-483e-a4a4-9be1d2a9ad7f service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:16.140130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d2d1f-85ee-4cf4-8cc4-be7446f639ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:16.142585 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d2d1f-85ee-4cf4-8cc4-be7446f639ef service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:16.160711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 818/1641] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:16.162717 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d2d1f-85ee-4cf4-8cc4-be7446f639ef service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:16.249008 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5df5b-4fb4-483e-a4a4-9be1d2a9ad7f service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:16.252882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d2d1f-85ee-4cf4-8cc4-be7446f639ef service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:16.258821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b983357-33cb-49dc-ab40-01696acd0209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:16.259664 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b983357-33cb-49dc-ab40-01696acd0209 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:16.260137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b983357-33cb-49dc-ab40-01696acd0209 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:16.260494 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b983357-33cb-49dc-ab40-01696acd0209 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:16.261328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b983357-33cb-49dc-ab40-01696acd0209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:16.263166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b983357-33cb-49dc-ab40-01696acd0209 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:16.278756 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 819/1642] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:16.284720 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cbb9f-6dd6-4e3b-97a3-dd9c6df0b017 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:16.284720 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cbb9f-6dd6-4e3b-97a3-dd9c6df0b017 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:16.284720 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cbb9f-6dd6-4e3b-97a3-dd9c6df0b017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:16.285144 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383973e-0549-4e4c-b4f6-893fb96a311c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:16.285144 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383973e-0549-4e4c-b4f6-893fb96a311c admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:16.285144 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383973e-0549-4e4c-b4f6-893fb96a311c admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:16.285144 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383973e-0549-4e4c-b4f6-893fb96a311c admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:16.286031 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383973e-0549-4e4c-b4f6-893fb96a311c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:16.288181 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383973e-0549-4e4c-b4f6-893fb96a311c admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:16.308762 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 824/1643] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:16.315620 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383973e-0549-4e4c-b4f6-893fb96a311c admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:16.329994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383973e-0549-4e4c-b4f6-893fb96a311c admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:16.342331 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-df9cbb9f-6dd6-4e3b-97a3-dd9c6df0b017 None None] MFA Rules not processed for user `5133abf4c32a45b0b2188f71496c572b`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:16.343179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cbacb-f5f5-427b-8461-636aee7103fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:16.346538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-df9cbb9f-6dd6-4e3b-97a3-dd9c6df0b017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:16.347702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cbacb-f5f5-427b-8461-636aee7103fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:16.638929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cbacb-f5f5-427b-8461-636aee7103fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:16.638929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cbacb-f5f5-427b-8461-636aee7103fa admin admin] PATH_INFO: `/v3/projects/c1f381758cdd44aaa821043271f95458/users/1761d231a11947fda5894e1ff6b0f1df/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:16.638929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cbacb-f5f5-427b-8461-636aee7103fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f381758cdd44aaa821043271f95458, user_id=1761d231a11947fda5894e1ff6b0f1df, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:16.670814 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 820/1644] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 28 04:02:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:16.670814 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cbb9f-6dd6-4e3b-97a3-dd9c6df0b017 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:16.672171 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cbacb-f5f5-427b-8461-636aee7103fa admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:16.672473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cbb9f-6dd6-4e3b-97a3-dd9c6df0b017 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:16.672642 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 825/1645] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:16 2022] PUT /identity/v3/projects/c1f381758cdd44aaa821043271f95458/users/1761d231a11947fda5894e1ff6b0f1df/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:16.672856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:16.673100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d041d-5d70-4fc3-a30d-4c671ab6e74c None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:16.673100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d041d-5d70-4fc3-a30d-4c671ab6e74c None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:16.673100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d041d-5d70-4fc3-a30d-4c671ab6e74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:16.673100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-1f7d041d-5d70-4fc3-a30d-4c671ab6e74c None None] MFA Rules not processed for user `1761d231a11947fda5894e1ff6b0f1df`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:16.673100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-1f7d041d-5d70-4fc3-a30d-4c671ab6e74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:16.673490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfde603-f438-4a17-a513-6b2c66b0c1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:16.673490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfde603-f438-4a17-a513-6b2c66b0c1fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:16.673490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfde603-f438-4a17-a513-6b2c66b0c1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:16.673490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfde603-f438-4a17-a513-6b2c66b0c1fa admin admin] PATH_INFO: `/v3/projects/dee22a9595b742fcb867aee7f83dac5f/users/ca6962fd156d44539c208ce4b1f1da86/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:16.674783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfde603-f438-4a17-a513-6b2c66b0c1fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee22a9595b742fcb867aee7f83dac5f, user_id=ca6962fd156d44539c208ce4b1f1da86, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:16.674783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfde603-f438-4a17-a513-6b2c66b0c1fa admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:16.674783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 821/1646] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:16 2022] PUT /identity/v3/projects/dee22a9595b742fcb867aee7f83dac5f/users/ca6962fd156d44539c208ce4b1f1da86/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:16.674783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689716f9-a6f8-4423-824b-3edd27e611ff None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:16.674783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689716f9-a6f8-4423-824b-3edd27e611ff None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:16.674783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689716f9-a6f8-4423-824b-3edd27e611ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:16.675365 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-689716f9-a6f8-4423-824b-3edd27e611ff None None] MFA Rules not processed for user `ca6962fd156d44539c208ce4b1f1da86`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:16.675365 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-689716f9-a6f8-4423-824b-3edd27e611ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:16.675571 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 826/1647] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:16 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:16.705085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 822/1648] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:02:17.033524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d041d-5d70-4fc3-a30d-4c671ab6e74c None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:17.102677 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d041d-5d70-4fc3-a30d-4c671ab6e74c None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:17.160772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b7a51-2977-476c-a2d3-b09295e928a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:17.161443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b7a51-2977-476c-a2d3-b09295e928a0 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:17.161721 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b7a51-2977-476c-a2d3-b09295e928a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:17.161991 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b7a51-2977-476c-a2d3-b09295e928a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:17.167990 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:17.254488 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b7a51-2977-476c-a2d3-b09295e928a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:17.259549 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b7a51-2977-476c-a2d3-b09295e928a0 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:17.271183 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 827/1649] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:17.309244 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689716f9-a6f8-4423-824b-3edd27e611ff None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:17.336178 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689716f9-a6f8-4423-824b-3edd27e611ff None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:17.344410 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592fe29-5dab-4103-8cfa-a26de1a0bc26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:17.347964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592fe29-5dab-4103-8cfa-a26de1a0bc26 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:17.348421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592fe29-5dab-4103-8cfa-a26de1a0bc26 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:17.349801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592fe29-5dab-4103-8cfa-a26de1a0bc26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:17.363000 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b7a51-2977-476c-a2d3-b09295e928a0 service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:17.379383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b7a51-2977-476c-a2d3-b09295e928a0 service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:17.384816 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49a318-ec06-469b-99c4-a1159ae49334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:17.385532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49a318-ec06-469b-99c4-a1159ae49334 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:17.386029 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49a318-ec06-469b-99c4-a1159ae49334 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:17.386310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49a318-ec06-469b-99c4-a1159ae49334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:17.399839 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49a318-ec06-469b-99c4-a1159ae49334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:17.401740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49a318-ec06-469b-99c4-a1159ae49334 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:17.413691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 828/1650] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:17.460741 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592fe29-5dab-4103-8cfa-a26de1a0bc26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:17.460741 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592fe29-5dab-4103-8cfa-a26de1a0bc26 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:17.472162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 823/1651] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:17 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:18.021089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49a318-ec06-469b-99c4-a1159ae49334 service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:18.030787 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592fe29-5dab-4103-8cfa-a26de1a0bc26 service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:18.045069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49a318-ec06-469b-99c4-a1159ae49334 service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:18.061530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34556b3b-d559-4350-b70a-7a8956478524 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:18.063513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34556b3b-d559-4350-b70a-7a8956478524 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:18.064721 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34556b3b-d559-4350-b70a-7a8956478524 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:18.066396 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34556b3b-d559-4350-b70a-7a8956478524 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:18.087920 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:18.153853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592fe29-5dab-4103-8cfa-a26de1a0bc26 service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:18.157936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34556b3b-d559-4350-b70a-7a8956478524 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:18.159851 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34556b3b-d559-4350-b70a-7a8956478524 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:18.162526 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c701db7-00cf-4622-ba59-666f927f542d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:18.163433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c701db7-00cf-4622-ba59-666f927f542d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:18.163778 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c701db7-00cf-4622-ba59-666f927f542d admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:18.164000 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c701db7-00cf-4622-ba59-666f927f542d admin admin] PATH_INFO: `/v3/users/4e5804bdad25436294440cd1d30d2c8c` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:18.165486 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c701db7-00cf-4622-ba59-666f927f542d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e5804bdad25436294440cd1d30d2c8c)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:18.167756 dv-cinder-851279-1-smb devstack@keystone.service[86894]: WARNING py.warnings [None req-0c701db7-00cf-4622-ba59-666f927f542d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:02:18.167756 dv-cinder-851279-1-smb devstack@keystone.service[86894]: warnings.warn(msg) Jul 28 04:02:18.167756 dv-cinder-851279-1-smb devstack@keystone.service[86894]: Jul 28 04:02:18.169741 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c701db7-00cf-4622-ba59-666f927f542d admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:18.185316 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 829/1652] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:18.550622 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0c701db7-00cf-4622-ba59-666f927f542d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e5804bdad25436294440cd1d30d2c8c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:18.551754 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0c701db7-00cf-4622-ba59-666f927f542d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e5804bdad25436294440cd1d30d2c8c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:18.625997 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0c701db7-00cf-4622-ba59-666f927f542d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e5804bdad25436294440cd1d30d2c8c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:18.669824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0c701db7-00cf-4622-ba59-666f927f542d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e5804bdad25436294440cd1d30d2c8c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:18.745729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0c701db7-00cf-4622-ba59-666f927f542d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e5804bdad25436294440cd1d30d2c8c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:18.753907 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 824/1653] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:02:18 2022] DELETE /identity/v3/users/4e5804bdad25436294440cd1d30d2c8c => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:02:18.761175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dc173-b827-4dca-951a-e9e2dd72d824 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:18.761942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dc173-b827-4dca-951a-e9e2dd72d824 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:18.762325 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dc173-b827-4dca-951a-e9e2dd72d824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:18.801892 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-f79dc173-b827-4dca-951a-e9e2dd72d824 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:18.803683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f79dc173-b827-4dca-951a-e9e2dd72d824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:18.827523 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:18.912174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 830/1654] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:19.047168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c701db7-00cf-4622-ba59-666f927f542d admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:19.047168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0c701db7-00cf-4622-ba59-666f927f542d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:19.170463 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c701db7-00cf-4622-ba59-666f927f542d admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:19.177260 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d145c-f95b-4292-88a0-bc4678369f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:19.180607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d145c-f95b-4292-88a0-bc4678369f53 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:19.180607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d145c-f95b-4292-88a0-bc4678369f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:19.180607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d145c-f95b-4292-88a0-bc4678369f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:19.203845 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d145c-f95b-4292-88a0-bc4678369f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:19.206472 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d145c-f95b-4292-88a0-bc4678369f53 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:19.235491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 825/1655] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:19.590145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79dc173-b827-4dca-951a-e9e2dd72d824 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:19.594254 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f79dc173-b827-4dca-951a-e9e2dd72d824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:19.623467 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79dc173-b827-4dca-951a-e9e2dd72d824 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:19.639959 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703664a-ac1a-4ef1-bd62-3187c48092ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:19.640880 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703664a-ac1a-4ef1-bd62-3187c48092ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:19.641326 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703664a-ac1a-4ef1-bd62-3187c48092ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:19.641809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703664a-ac1a-4ef1-bd62-3187c48092ce admin admin] PATH_INFO: `/v3/users/b99f5b243186467b8f6972d01c6c63ae` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:19.644815 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703664a-ac1a-4ef1-bd62-3187c48092ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b99f5b243186467b8f6972d01c6c63ae)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:19.651557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703664a-ac1a-4ef1-bd62-3187c48092ce admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:19.996846 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1703664a-ac1a-4ef1-bd62-3187c48092ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b99f5b243186467b8f6972d01c6c63ae'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:19.996846 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1703664a-ac1a-4ef1-bd62-3187c48092ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b99f5b243186467b8f6972d01c6c63ae'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:20.069481 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1703664a-ac1a-4ef1-bd62-3187c48092ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b99f5b243186467b8f6972d01c6c63ae'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:20.105856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1703664a-ac1a-4ef1-bd62-3187c48092ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b99f5b243186467b8f6972d01c6c63ae'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:20.128605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1703664a-ac1a-4ef1-bd62-3187c48092ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b99f5b243186467b8f6972d01c6c63ae'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:20.145332 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 831/1656] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:02:19 2022] DELETE /identity/v3/users/b99f5b243186467b8f6972d01c6c63ae => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:20.149860 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70c615-ddf2-4186-b712-1332e5513994 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:20.152338 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70c615-ddf2-4186-b712-1332e5513994 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:20.152338 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70c615-ddf2-4186-b712-1332e5513994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:20.187463 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-ea70c615-ddf2-4186-b712-1332e5513994 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:20.188727 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ea70c615-ddf2-4186-b712-1332e5513994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:20.305519 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:20.354068 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 826/1657] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:20.453324 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703664a-ac1a-4ef1-bd62-3187c48092ce admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:20.454835 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-1703664a-ac1a-4ef1-bd62-3187c48092ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:20.561290 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703664a-ac1a-4ef1-bd62-3187c48092ce admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:20.573727 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc7729-67b6-41e8-a299-c518c49821bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:20.574698 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70c615-ddf2-4186-b712-1332e5513994 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:20.576396 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ea70c615-ddf2-4186-b712-1332e5513994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:20.579047 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc7729-67b6-41e8-a299-c518c49821bc service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:20.579383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc7729-67b6-41e8-a299-c518c49821bc service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:20.579658 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc7729-67b6-41e8-a299-c518c49821bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:20.636599 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc7729-67b6-41e8-a299-c518c49821bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:20.638987 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70c615-ddf2-4186-b712-1332e5513994 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:20.639806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc7729-67b6-41e8-a299-c518c49821bc service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:20.654419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f2936-f65a-4df5-b32f-d30f614b057c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:20.655898 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f2936-f65a-4df5-b32f-d30f614b057c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:20.655898 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f2936-f65a-4df5-b32f-d30f614b057c admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:20.656418 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f2936-f65a-4df5-b32f-d30f614b057c admin admin] PATH_INFO: `/v3/projects/f2f313db993240f193a0d63e322eb22a` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:20.662445 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f2936-f65a-4df5-b32f-d30f614b057c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f313db993240f193a0d63e322eb22a)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:20.664708 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f2936-f65a-4df5-b32f-d30f614b057c admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:20.676148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 832/1658] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:20.880546 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-928f2936-f65a-4df5-b32f-d30f614b057c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f313db993240f193a0d63e322eb22a', 'request_id': 'req-928f2936-f65a-4df5-b32f-d30f614b057c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:20.894786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-928f2936-f65a-4df5-b32f-d30f614b057c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f313db993240f193a0d63e322eb22a', 'request_id': 'req-928f2936-f65a-4df5-b32f-d30f614b057c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:20.916570 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-928f2936-f65a-4df5-b32f-d30f614b057c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f313db993240f193a0d63e322eb22a', 'request_id': 'req-928f2936-f65a-4df5-b32f-d30f614b057c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:21.032751 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-928f2936-f65a-4df5-b32f-d30f614b057c admin admin] The token cache is being invalidate because project f2f313db993240f193a0d63e322eb22a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:02:21.032947 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-928f2936-f65a-4df5-b32f-d30f614b057c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:21.034542 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-928f2936-f65a-4df5-b32f-d30f614b057c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:21.036571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 827/1659] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:02:20 2022] DELETE /identity/v3/projects/f2f313db993240f193a0d63e322eb22a => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:21.041453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23792d81-ca70-4ce2-93c2-a95631789a45 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:21.041817 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23792d81-ca70-4ce2-93c2-a95631789a45 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:21.042266 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23792d81-ca70-4ce2-93c2-a95631789a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:21.072589 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-23792d81-ca70-4ce2-93c2-a95631789a45 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:21.072589 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-23792d81-ca70-4ce2-93c2-a95631789a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:21.145675 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:21.206416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 833/1660] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:21.209709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b13c61-f298-45ba-8b36-bd193a41ce25 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:21.210199 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b13c61-f298-45ba-8b36-bd193a41ce25 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:21.210287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b13c61-f298-45ba-8b36-bd193a41ce25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:21.237711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-e8b13c61-f298-45ba-8b36-bd193a41ce25 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:21.239447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e8b13c61-f298-45ba-8b36-bd193a41ce25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:21.297254 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 828/1661] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:21.302202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23792d81-ca70-4ce2-93c2-a95631789a45 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:21.325353 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23792d81-ca70-4ce2-93c2-a95631789a45 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:21.333085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fed2e-4021-44a6-9054-0694a35389c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:21.334143 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fed2e-4021-44a6-9054-0694a35389c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:21.335415 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fed2e-4021-44a6-9054-0694a35389c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:21.335816 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fed2e-4021-44a6-9054-0694a35389c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:21.338932 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fed2e-4021-44a6-9054-0694a35389c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:02:21.340008 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fed2e-4021-44a6-9054-0694a35389c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:21.346094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fed2e-4021-44a6-9054-0694a35389c3 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:21.386295 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 834/1662] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:02:21.390828 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b13c61-f298-45ba-8b36-bd193a41ce25 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:21.408833 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b13c61-f298-45ba-8b36-bd193a41ce25 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:21.413706 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a03abc-a8b4-4ea3-a963-2688754be2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:21.414360 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a03abc-a8b4-4ea3-a963-2688754be2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:21.414643 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a03abc-a8b4-4ea3-a963-2688754be2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:21.416364 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a03abc-a8b4-4ea3-a963-2688754be2c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:21.421408 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a03abc-a8b4-4ea3-a963-2688754be2c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:21.423702 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a03abc-a8b4-4ea3-a963-2688754be2c4 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:21.583554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 829/1663] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:21 2022] POST /identity/v3/projects => generated 405 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:21.585153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fed2e-4021-44a6-9054-0694a35389c3 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:21.604672 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fed2e-4021-44a6-9054-0694a35389c3 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:21.747057 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca657ec-012c-4b87-8a8c-e0f0dfed472f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:21.750333 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca657ec-012c-4b87-8a8c-e0f0dfed472f admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:21.750833 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca657ec-012c-4b87-8a8c-e0f0dfed472f admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:21.751310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca657ec-012c-4b87-8a8c-e0f0dfed472f admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:21.757431 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca657ec-012c-4b87-8a8c-e0f0dfed472f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:21.764604 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca657ec-012c-4b87-8a8c-e0f0dfed472f admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:21.892456 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a03abc-a8b4-4ea3-a963-2688754be2c4 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:21.900691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 835/1664] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:21 2022] POST /identity/v3/users => generated 303 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:21.913354 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a03abc-a8b4-4ea3-a963-2688754be2c4 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:21.934348 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e47d6-0d63-441c-b2df-e6fca23c9fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:21.935771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e47d6-0d63-441c-b2df-e6fca23c9fcc admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:21.937274 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e47d6-0d63-441c-b2df-e6fca23c9fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:21.937866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e47d6-0d63-441c-b2df-e6fca23c9fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:21.949546 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e47d6-0d63-441c-b2df-e6fca23c9fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:21.951597 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e47d6-0d63-441c-b2df-e6fca23c9fcc admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:22.016282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 830/1665] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:22.019991 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca657ec-012c-4b87-8a8c-e0f0dfed472f admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:22.053052 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca657ec-012c-4b87-8a8c-e0f0dfed472f admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:22.060902 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dccdce-430f-4438-a295-604a3e37277f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:22.062400 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dccdce-430f-4438-a295-604a3e37277f admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:22.066189 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dccdce-430f-4438-a295-604a3e37277f admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:22.066189 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dccdce-430f-4438-a295-604a3e37277f admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:22.067722 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dccdce-430f-4438-a295-604a3e37277f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:22.081176 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dccdce-430f-4438-a295-604a3e37277f admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:22.151037 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 836/1666] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:22.155968 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e47d6-0d63-441c-b2df-e6fca23c9fcc admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:22.177873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e47d6-0d63-441c-b2df-e6fca23c9fcc admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:22.206615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e26f8-f71e-4e98-b962-f8d5cc1905bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:22.207618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e26f8-f71e-4e98-b962-f8d5cc1905bb admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:22.207909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e26f8-f71e-4e98-b962-f8d5cc1905bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:22.212083 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e26f8-f71e-4e98-b962-f8d5cc1905bb admin admin] PATH_INFO: `/v3/projects/8cdff8394b16486f9ea997476aa82d37/users/91d5891ba10646dbbf576ee8605a53b1/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:22.264096 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e26f8-f71e-4e98-b962-f8d5cc1905bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cdff8394b16486f9ea997476aa82d37, user_id=91d5891ba10646dbbf576ee8605a53b1, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:22.273474 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e26f8-f71e-4e98-b962-f8d5cc1905bb admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:22.548535 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661df77-d4a3-420a-b83c-60603a6171e0 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:22.548729 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661df77-d4a3-420a-b83c-60603a6171e0 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:22.549542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661df77-d4a3-420a-b83c-60603a6171e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:22.549934 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 831/1667] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:22 2022] PUT /identity/v3/projects/8cdff8394b16486f9ea997476aa82d37/users/91d5891ba10646dbbf576ee8605a53b1/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:22.608364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-a661df77-d4a3-420a-b83c-60603a6171e0 None None] MFA Rules not processed for user `91d5891ba10646dbbf576ee8605a53b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:22.610631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a661df77-d4a3-420a-b83c-60603a6171e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:22.730757 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 837/1668] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:22 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:02:22.733101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e26f8-f71e-4e98-b962-f8d5cc1905bb admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:22.750006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661df77-d4a3-420a-b83c-60603a6171e0 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:22.754082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a661df77-d4a3-420a-b83c-60603a6171e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:22.958163 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e26f8-f71e-4e98-b962-f8d5cc1905bb admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:22.979111 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9ae06-1707-409a-8cbe-8dc35cbb609d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:22.980085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9ae06-1707-409a-8cbe-8dc35cbb609d admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:22.980531 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9ae06-1707-409a-8cbe-8dc35cbb609d admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:22.981141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9ae06-1707-409a-8cbe-8dc35cbb609d admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:22.984166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9ae06-1707-409a-8cbe-8dc35cbb609d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:22.990800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f9ae06-1707-409a-8cbe-8dc35cbb609d admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:22.997563 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661df77-d4a3-420a-b83c-60603a6171e0 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:23.013491 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2833eb9-6e54-430d-825c-ddc9769e3a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:23.014370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2833eb9-6e54-430d-825c-ddc9769e3a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:23.018271 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2833eb9-6e54-430d-825c-ddc9769e3a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:23.018271 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2833eb9-6e54-430d-825c-ddc9769e3a5d admin admin] PATH_INFO: `/v3/projects/6c8e0e3f6b684839b1453b092d4acf5a` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:23.020217 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:23.020385 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2833eb9-6e54-430d-825c-ddc9769e3a5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c8e0e3f6b684839b1453b092d4acf5a)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:23.021643 dv-cinder-851279-1-smb devstack@keystone.service[86895]: WARNING py.warnings [None req-f2833eb9-6e54-430d-825c-ddc9769e3a5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:02:23.021643 dv-cinder-851279-1-smb devstack@keystone.service[86895]: warnings.warn(msg) Jul 28 04:02:23.021643 dv-cinder-851279-1-smb devstack@keystone.service[86895]: Jul 28 04:02:23.025177 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2833eb9-6e54-430d-825c-ddc9769e3a5d admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:23.153918 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 832/1669] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:22 2022] POST /identity/v3/projects => generated 405 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:02:23.165434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9ae06-1707-409a-8cbe-8dc35cbb609d admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:23.235335 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-f2833eb9-6e54-430d-825c-ddc9769e3a5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c8e0e3f6b684839b1453b092d4acf5a', 'request_id': 'req-f2833eb9-6e54-430d-825c-ddc9769e3a5d'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:23.311738 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-f2833eb9-6e54-430d-825c-ddc9769e3a5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c8e0e3f6b684839b1453b092d4acf5a', 'request_id': 'req-f2833eb9-6e54-430d-825c-ddc9769e3a5d'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:23.321007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-f2833eb9-6e54-430d-825c-ddc9769e3a5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c8e0e3f6b684839b1453b092d4acf5a', 'request_id': 'req-f2833eb9-6e54-430d-825c-ddc9769e3a5d'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:23.356557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9ae06-1707-409a-8cbe-8dc35cbb609d admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:23.363264 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-f2833eb9-6e54-430d-825c-ddc9769e3a5d admin admin] The token cache is being invalidate because project 6c8e0e3f6b684839b1453b092d4acf5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:02:23.363738 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-f2833eb9-6e54-430d-825c-ddc9769e3a5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:23.369399 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-f2833eb9-6e54-430d-825c-ddc9769e3a5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:23.374671 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 838/1670] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:02:22 2022] DELETE /identity/v3/projects/6c8e0e3f6b684839b1453b092d4acf5a => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:23.378239 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2833eb9-6e54-430d-825c-ddc9769e3a5d admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:23.379224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f2833eb9-6e54-430d-825c-ddc9769e3a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:23.397864 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:23.494496 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb5fd4-80ee-4a5f-a465-8b81569fff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:23.495984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb5fd4-80ee-4a5f-a465-8b81569fff8f admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:23.500519 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb5fd4-80ee-4a5f-a465-8b81569fff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:23.502490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb5fd4-80ee-4a5f-a465-8b81569fff8f admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:23.504883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb5fd4-80ee-4a5f-a465-8b81569fff8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:23.513793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb5fd4-80ee-4a5f-a465-8b81569fff8f admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:23.528380 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2833eb9-6e54-430d-825c-ddc9769e3a5d admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:23.535938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b9866-29e1-4ebf-b6da-15d596fca6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:23.537011 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b9866-29e1-4ebf-b6da-15d596fca6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:23.540396 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b9866-29e1-4ebf-b6da-15d596fca6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:23.541101 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b9866-29e1-4ebf-b6da-15d596fca6a8 admin admin] PATH_INFO: `/v3/users/1761d231a11947fda5894e1ff6b0f1df` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:23.542680 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b9866-29e1-4ebf-b6da-15d596fca6a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1761d231a11947fda5894e1ff6b0f1df)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:23.549717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b9866-29e1-4ebf-b6da-15d596fca6a8 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:23.639888 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 833/1671] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:23 2022] POST /identity/v3/users => generated 309 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:02:23.642116 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb5fd4-80ee-4a5f-a465-8b81569fff8f admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:23.659104 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-5cdb5fd4-80ee-4a5f-a465-8b81569fff8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:23.699367 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb5fd4-80ee-4a5f-a465-8b81569fff8f admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:23.707366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd028d0-ba56-4f07-aeac-44eb5ef2bb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:23.709144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd028d0-ba56-4f07-aeac-44eb5ef2bb10 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:23.709797 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd028d0-ba56-4f07-aeac-44eb5ef2bb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:23.710304 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd028d0-ba56-4f07-aeac-44eb5ef2bb10 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:23.718083 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd028d0-ba56-4f07-aeac-44eb5ef2bb10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:23.721367 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd028d0-ba56-4f07-aeac-44eb5ef2bb10 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:23.745766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 834/1672] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:23.755812 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd028d0-ba56-4f07-aeac-44eb5ef2bb10 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:23.775631 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd028d0-ba56-4f07-aeac-44eb5ef2bb10 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:23.790386 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746ff91-dfa1-40eb-9dd4-7a34def352a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:23.791420 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746ff91-dfa1-40eb-9dd4-7a34def352a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:23.792307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746ff91-dfa1-40eb-9dd4-7a34def352a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:23.792910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746ff91-dfa1-40eb-9dd4-7a34def352a3 admin admin] PATH_INFO: `/v3/projects/b2a74b68c05345a69311de67bde2a00f/users/fde2c30c2b654dd4b624ec334aee498d/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:23.822546 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746ff91-dfa1-40eb-9dd4-7a34def352a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a74b68c05345a69311de67bde2a00f, user_id=fde2c30c2b654dd4b624ec334aee498d, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:23.822546 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746ff91-dfa1-40eb-9dd4-7a34def352a3 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:23.921202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 835/1673] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:23 2022] PUT /identity/v3/projects/b2a74b68c05345a69311de67bde2a00f/users/fde2c30c2b654dd4b624ec334aee498d/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:23.931389 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746ff91-dfa1-40eb-9dd4-7a34def352a3 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:23.954876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-3f9b9866-29e1-4ebf-b6da-15d596fca6a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1761d231a11947fda5894e1ff6b0f1df'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:23.957226 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-3f9b9866-29e1-4ebf-b6da-15d596fca6a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1761d231a11947fda5894e1ff6b0f1df'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:24.056476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-3f9b9866-29e1-4ebf-b6da-15d596fca6a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1761d231a11947fda5894e1ff6b0f1df'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:24.083172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-3f9b9866-29e1-4ebf-b6da-15d596fca6a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1761d231a11947fda5894e1ff6b0f1df'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:24.100859 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-3f9b9866-29e1-4ebf-b6da-15d596fca6a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1761d231a11947fda5894e1ff6b0f1df'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:24.135768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 839/1674] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:02:23 2022] DELETE /identity/v3/users/1761d231a11947fda5894e1ff6b0f1df => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:24.146660 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746ff91-dfa1-40eb-9dd4-7a34def352a3 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:24.416797 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a1a45-7dc9-4318-9279-e9644e37021e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:24.416797 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a1a45-7dc9-4318-9279-e9644e37021e admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:24.416797 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a1a45-7dc9-4318-9279-e9644e37021e admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:24.416797 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a1a45-7dc9-4318-9279-e9644e37021e admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:24.420574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a1a45-7dc9-4318-9279-e9644e37021e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:24.425313 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a1a45-7dc9-4318-9279-e9644e37021e admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:24.491866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 836/1675] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 561 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:24.497221 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b9866-29e1-4ebf-b6da-15d596fca6a8 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:24.498915 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-3f9b9866-29e1-4ebf-b6da-15d596fca6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:24.522089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b9866-29e1-4ebf-b6da-15d596fca6a8 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:24.547121 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec763e1-1d81-47e0-afd9-05b0bf28aed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:24.547792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec763e1-1d81-47e0-afd9-05b0bf28aed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:24.548205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec763e1-1d81-47e0-afd9-05b0bf28aed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:24.548506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec763e1-1d81-47e0-afd9-05b0bf28aed3 admin admin] PATH_INFO: `/v3/projects/b2a74b68c05345a69311de67bde2a00f/users/fde2c30c2b654dd4b624ec334aee498d/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:24.554423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec763e1-1d81-47e0-afd9-05b0bf28aed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a74b68c05345a69311de67bde2a00f, user_id=fde2c30c2b654dd4b624ec334aee498d, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:24.560402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec763e1-1d81-47e0-afd9-05b0bf28aed3 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:24.591519 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 840/1676] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:24 2022] PUT /identity/v3/projects/b2a74b68c05345a69311de67bde2a00f/users/fde2c30c2b654dd4b624ec334aee498d/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:24.600837 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756c6a9-5259-4f3d-b821-1d2b4b6db3d2 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:24.601347 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756c6a9-5259-4f3d-b821-1d2b4b6db3d2 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:24.601835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756c6a9-5259-4f3d-b821-1d2b4b6db3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:24.664481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-8756c6a9-5259-4f3d-b821-1d2b4b6db3d2 None None] MFA Rules not processed for user `fde2c30c2b654dd4b624ec334aee498d`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:24.667122 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-8756c6a9-5259-4f3d-b821-1d2b4b6db3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:24.730932 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:24.907415 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:24.923612 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 837/1677] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:24 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:24.947004 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec763e1-1d81-47e0-afd9-05b0bf28aed3 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:24.954009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-bec763e1-1d81-47e0-afd9-05b0bf28aed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:25.144861 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec763e1-1d81-47e0-afd9-05b0bf28aed3 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:25.162503 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c7e72-dfd5-4bed-9f4d-24ab74760685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:25.166873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c7e72-dfd5-4bed-9f4d-24ab74760685 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:25.167312 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c7e72-dfd5-4bed-9f4d-24ab74760685 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:25.168806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c7e72-dfd5-4bed-9f4d-24ab74760685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:25.219149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c7e72-dfd5-4bed-9f4d-24ab74760685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:25.229555 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c7e72-dfd5-4bed-9f4d-24ab74760685 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:25.320189 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 841/1678] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:24 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:25.682456 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756c6a9-5259-4f3d-b821-1d2b4b6db3d2 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:25.847652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756c6a9-5259-4f3d-b821-1d2b4b6db3d2 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:25.868522 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f3e48-04b3-403b-b0e7-c3ff998fa891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:25.868912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f3e48-04b3-403b-b0e7-c3ff998fa891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:25.869198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f3e48-04b3-403b-b0e7-c3ff998fa891 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:25.869477 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f3e48-04b3-403b-b0e7-c3ff998fa891 admin admin] PATH_INFO: `/v3/users/91d5891ba10646dbbf576ee8605a53b1` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:25.884317 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f3e48-04b3-403b-b0e7-c3ff998fa891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d5891ba10646dbbf576ee8605a53b1)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:25.886553 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f3e48-04b3-403b-b0e7-c3ff998fa891 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:26.169681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-378f3e48-04b3-403b-b0e7-c3ff998fa891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d5891ba10646dbbf576ee8605a53b1'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:26.172891 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-378f3e48-04b3-403b-b0e7-c3ff998fa891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d5891ba10646dbbf576ee8605a53b1'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:26.193279 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c7e72-dfd5-4bed-9f4d-24ab74760685 service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:26.195678 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-cb1c7e72-dfd5-4bed-9f4d-24ab74760685 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:26.224975 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c7e72-dfd5-4bed-9f4d-24ab74760685 service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:26.252822 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aebfc8-eb05-48de-a3ad-bf9c03e55d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:26.253502 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aebfc8-eb05-48de-a3ad-bf9c03e55d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:26.253849 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aebfc8-eb05-48de-a3ad-bf9c03e55d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:26.254041 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aebfc8-eb05-48de-a3ad-bf9c03e55d1d admin admin] PATH_INFO: `/v3/projects/c1f381758cdd44aaa821043271f95458` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:26.262257 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aebfc8-eb05-48de-a3ad-bf9c03e55d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f381758cdd44aaa821043271f95458)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:26.265504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aebfc8-eb05-48de-a3ad-bf9c03e55d1d admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:26.277108 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-378f3e48-04b3-403b-b0e7-c3ff998fa891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d5891ba10646dbbf576ee8605a53b1'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:26.286597 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-378f3e48-04b3-403b-b0e7-c3ff998fa891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d5891ba10646dbbf576ee8605a53b1'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:26.344085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-378f3e48-04b3-403b-b0e7-c3ff998fa891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d5891ba10646dbbf576ee8605a53b1'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:26.374664 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 838/1679] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:02:25 2022] DELETE /identity/v3/users/91d5891ba10646dbbf576ee8605a53b1 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:26.380878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb3aad-4e75-4e2d-b980-53e8433e1179 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:26.381279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb3aad-4e75-4e2d-b980-53e8433e1179 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:26.381394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb3aad-4e75-4e2d-b980-53e8433e1179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:26.467856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:26.478977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-f2bb3aad-4e75-4e2d-b980-53e8433e1179 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:26.488992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f2bb3aad-4e75-4e2d-b980-53e8433e1179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:26.594652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-51aebfc8-eb05-48de-a3ad-bf9c03e55d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f381758cdd44aaa821043271f95458', 'request_id': 'req-51aebfc8-eb05-48de-a3ad-bf9c03e55d1d'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:26.645670 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 839/1680] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:26.662941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb3aad-4e75-4e2d-b980-53e8433e1179 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:26.665055 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f2bb3aad-4e75-4e2d-b980-53e8433e1179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:26.702644 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-51aebfc8-eb05-48de-a3ad-bf9c03e55d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f381758cdd44aaa821043271f95458', 'request_id': 'req-51aebfc8-eb05-48de-a3ad-bf9c03e55d1d'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:26.711456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-51aebfc8-eb05-48de-a3ad-bf9c03e55d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f381758cdd44aaa821043271f95458', 'request_id': 'req-51aebfc8-eb05-48de-a3ad-bf9c03e55d1d'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:26.738415 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-51aebfc8-eb05-48de-a3ad-bf9c03e55d1d admin admin] The token cache is being invalidate because project c1f381758cdd44aaa821043271f95458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:02:26.741155 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-51aebfc8-eb05-48de-a3ad-bf9c03e55d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:26.747733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-51aebfc8-eb05-48de-a3ad-bf9c03e55d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:26.748003 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 842/1681] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:02:26 2022] DELETE /identity/v3/projects/c1f381758cdd44aaa821043271f95458 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:02:26.753385 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b25a5-9901-4949-b911-fb53fa3905f2 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:26.753801 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b25a5-9901-4949-b911-fb53fa3905f2 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:26.756338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b25a5-9901-4949-b911-fb53fa3905f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:26.817559 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-949b25a5-9901-4949-b911-fb53fa3905f2 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:26.817962 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb3aad-4e75-4e2d-b980-53e8433e1179 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:26.832883 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-949b25a5-9901-4949-b911-fb53fa3905f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:26.885683 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edd829-dc54-4493-af86-66b26a2344d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:26.886862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edd829-dc54-4493-af86-66b26a2344d5 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:26.887545 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edd829-dc54-4493-af86-66b26a2344d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:26.888045 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edd829-dc54-4493-af86-66b26a2344d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:26.890734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b8edd829-dc54-4493-af86-66b26a2344d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:26.989340 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 843/1682] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:26.998804 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc8625-7294-4bbf-8ee1-e5889a35c75c None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:26.999452 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc8625-7294-4bbf-8ee1-e5889a35c75c None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:26.999928 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc8625-7294-4bbf-8ee1-e5889a35c75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:27.000071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8edd829-dc54-4493-af86-66b26a2344d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:27.001831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8edd829-dc54-4493-af86-66b26a2344d5 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:27.032184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 840/1683] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:02:27.046797 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-23cc8625-7294-4bbf-8ee1-e5889a35c75c None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:27.051475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-23cc8625-7294-4bbf-8ee1-e5889a35c75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:27.079282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 844/1684] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:02:27.082407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edd829-dc54-4493-af86-66b26a2344d5 service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:27.101071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edd829-dc54-4493-af86-66b26a2344d5 service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:27.103814 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186083ee-4ad1-48d7-81e9-d6184ae5bfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:27.104692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186083ee-4ad1-48d7-81e9-d6184ae5bfaa admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:27.106239 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186083ee-4ad1-48d7-81e9-d6184ae5bfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:27.106655 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186083ee-4ad1-48d7-81e9-d6184ae5bfaa admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:27.107616 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186083ee-4ad1-48d7-81e9-d6184ae5bfaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:02:27.108054 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186083ee-4ad1-48d7-81e9-d6184ae5bfaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:27.110448 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186083ee-4ad1-48d7-81e9-d6184ae5bfaa admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:27.127733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 841/1685] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:02:27.132816 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc8625-7294-4bbf-8ee1-e5889a35c75c None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:27.152476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc8625-7294-4bbf-8ee1-e5889a35c75c None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:27.168711 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58409705-1ecf-4b67-9a8b-666f1d886f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:27.169454 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58409705-1ecf-4b67-9a8b-666f1d886f0a admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:27.169737 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58409705-1ecf-4b67-9a8b-666f1d886f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:27.170065 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58409705-1ecf-4b67-9a8b-666f1d886f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:27.172292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58409705-1ecf-4b67-9a8b-666f1d886f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:27.177103 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58409705-1ecf-4b67-9a8b-666f1d886f0a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:27.251213 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:27.295314 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 845/1686] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:27 2022] POST /identity/v3/projects => generated 363 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:27.297490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186083ee-4ad1-48d7-81e9-d6184ae5bfaa admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:27.310050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186083ee-4ad1-48d7-81e9-d6184ae5bfaa admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:27.537441 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a064bc6-8fd1-480f-a13c-92416d06c216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:27.538453 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a064bc6-8fd1-480f-a13c-92416d06c216 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:27.538917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a064bc6-8fd1-480f-a13c-92416d06c216 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:27.539401 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a064bc6-8fd1-480f-a13c-92416d06c216 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:27.542510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a064bc6-8fd1-480f-a13c-92416d06c216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:27.547356 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a064bc6-8fd1-480f-a13c-92416d06c216 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:27.686017 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 842/1687] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:27 2022] POST /identity/v3/users => generated 282 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:27.691873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58409705-1ecf-4b67-9a8b-666f1d886f0a admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:27.730631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58409705-1ecf-4b67-9a8b-666f1d886f0a admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:27.766508 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64d0e1-3d7c-43c5-9e6b-da715aa0bb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:27.767160 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64d0e1-3d7c-43c5-9e6b-da715aa0bb25 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:27.767477 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64d0e1-3d7c-43c5-9e6b-da715aa0bb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:27.769850 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64d0e1-3d7c-43c5-9e6b-da715aa0bb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:27.770734 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64d0e1-3d7c-43c5-9e6b-da715aa0bb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:27.772514 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64d0e1-3d7c-43c5-9e6b-da715aa0bb25 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:27.812060 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 846/1688] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:02:27.816788 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a064bc6-8fd1-480f-a13c-92416d06c216 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:27.834712 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a064bc6-8fd1-480f-a13c-92416d06c216 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:27.850569 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6f2cb-2ff7-405d-9e16-5f988656c103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:27.852631 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6f2cb-2ff7-405d-9e16-5f988656c103 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:27.854157 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6f2cb-2ff7-405d-9e16-5f988656c103 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:27.854662 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6f2cb-2ff7-405d-9e16-5f988656c103 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:27.859497 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6f2cb-2ff7-405d-9e16-5f988656c103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:27.864876 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6f2cb-2ff7-405d-9e16-5f988656c103 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:27.889045 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 843/1689] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:27.891298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64d0e1-3d7c-43c5-9e6b-da715aa0bb25 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:27.954336 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64d0e1-3d7c-43c5-9e6b-da715aa0bb25 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:27.985837 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec0acb-c137-429e-acb1-94abf61362e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:27.999926 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec0acb-c137-429e-acb1-94abf61362e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:28.002616 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec0acb-c137-429e-acb1-94abf61362e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:28.008923 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec0acb-c137-429e-acb1-94abf61362e0 admin admin] PATH_INFO: `/v3/projects/a4b5c48224624f3798fffaa63ccbe97e/users/c9096c0061d94e849ea4bd31fb55d13b/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:28.087142 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec0acb-c137-429e-acb1-94abf61362e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b5c48224624f3798fffaa63ccbe97e, user_id=c9096c0061d94e849ea4bd31fb55d13b, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:28.091581 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec0acb-c137-429e-acb1-94abf61362e0 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:28.206852 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 847/1690] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:27 2022] PUT /identity/v3/projects/a4b5c48224624f3798fffaa63ccbe97e/users/c9096c0061d94e849ea4bd31fb55d13b/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:28.221197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4791e5a-b363-4770-a609-e25036f2b1a3 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:28.221529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4791e5a-b363-4770-a609-e25036f2b1a3 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:28.221767 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4791e5a-b363-4770-a609-e25036f2b1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:28.403167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-e4791e5a-b363-4770-a609-e25036f2b1a3 None None] MFA Rules not processed for user `c9096c0061d94e849ea4bd31fb55d13b`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:28.411095 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e4791e5a-b363-4770-a609-e25036f2b1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:28.593254 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:28.632932 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 844/1691] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:28.637594 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec0acb-c137-429e-acb1-94abf61362e0 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:28.865486 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec0acb-c137-429e-acb1-94abf61362e0 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:28.876780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136b8e2-19a6-4d32-856d-f278c23bde86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:28.880989 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136b8e2-19a6-4d32-856d-f278c23bde86 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:28.881523 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136b8e2-19a6-4d32-856d-f278c23bde86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:28.882264 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136b8e2-19a6-4d32-856d-f278c23bde86 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:28.883302 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136b8e2-19a6-4d32-856d-f278c23bde86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:28.888354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136b8e2-19a6-4d32-856d-f278c23bde86 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:28.919335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4791e5a-b363-4770-a609-e25036f2b1a3 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:28.920936 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e4791e5a-b363-4770-a609-e25036f2b1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:28.965461 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4791e5a-b363-4770-a609-e25036f2b1a3 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:28.978710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e16de-843f-45e1-8729-0b157566fa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:28.979178 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e16de-843f-45e1-8729-0b157566fa8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:28.979495 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e16de-843f-45e1-8729-0b157566fa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:28.979773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e16de-843f-45e1-8729-0b157566fa8d admin admin] PATH_INFO: `/v3/projects/8cdff8394b16486f9ea997476aa82d37` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:28.996346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e16de-843f-45e1-8729-0b157566fa8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cdff8394b16486f9ea997476aa82d37)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:29.000141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e16de-843f-45e1-8729-0b157566fa8d admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:29.021125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 848/1692] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:28 2022] POST /identity/v3/projects => generated 365 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:29.027219 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88709547-fe11-4ca9-b7ac-c50901df9737 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:29.036647 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88709547-fe11-4ca9-b7ac-c50901df9737 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:29.038194 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88709547-fe11-4ca9-b7ac-c50901df9737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:29.109859 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-88709547-fe11-4ca9-b7ac-c50901df9737 None None] MFA Rules not processed for user `414b0f1addcc487fb2834b16d7047923`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:29.112134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-88709547-fe11-4ca9-b7ac-c50901df9737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:29.204779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-7a4e16de-843f-45e1-8729-0b157566fa8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cdff8394b16486f9ea997476aa82d37', 'request_id': 'req-7a4e16de-843f-45e1-8729-0b157566fa8d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:29.226701 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-7a4e16de-843f-45e1-8729-0b157566fa8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cdff8394b16486f9ea997476aa82d37', 'request_id': 'req-7a4e16de-843f-45e1-8729-0b157566fa8d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:29.239106 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-7a4e16de-843f-45e1-8729-0b157566fa8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cdff8394b16486f9ea997476aa82d37', 'request_id': 'req-7a4e16de-843f-45e1-8729-0b157566fa8d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:29.281828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 849/1693] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:29.286247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88709547-fe11-4ca9-b7ac-c50901df9737 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:29.355464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-7a4e16de-843f-45e1-8729-0b157566fa8d admin admin] The token cache is being invalidate because project 8cdff8394b16486f9ea997476aa82d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:02:29.356405 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-7a4e16de-843f-45e1-8729-0b157566fa8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:29.357445 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-7a4e16de-843f-45e1-8729-0b157566fa8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:29.361715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 845/1694] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:02:28 2022] DELETE /identity/v3/projects/8cdff8394b16486f9ea997476aa82d37 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:29.362595 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e16de-843f-45e1-8729-0b157566fa8d admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:29.367931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-7a4e16de-843f-45e1-8729-0b157566fa8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:29.445074 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88709547-fe11-4ca9-b7ac-c50901df9737 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:29.591254 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a15b7-483e-421c-a02d-20477688ba74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:29.592111 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e16de-843f-45e1-8729-0b157566fa8d admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:29.592457 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a15b7-483e-421c-a02d-20477688ba74 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:29.592753 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a15b7-483e-421c-a02d-20477688ba74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:29.593038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a15b7-483e-421c-a02d-20477688ba74 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:29.594343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a15b7-483e-421c-a02d-20477688ba74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:29.597442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a15b7-483e-421c-a02d-20477688ba74 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:29.603744 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369dcbe-ccd0-4506-84b5-35ef06b7acef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:29.604831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369dcbe-ccd0-4506-84b5-35ef06b7acef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:29.605350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369dcbe-ccd0-4506-84b5-35ef06b7acef admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:29.607081 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369dcbe-ccd0-4506-84b5-35ef06b7acef admin admin] PATH_INFO: `/v3/users/6798f81e54c54b179a85cfae02230ccf` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:29.609656 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369dcbe-ccd0-4506-84b5-35ef06b7acef admin admin] RBAC: Authorizing `identity:delete_user(user_id=6798f81e54c54b179a85cfae02230ccf)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:29.613813 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369dcbe-ccd0-4506-84b5-35ef06b7acef admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:29.699956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 850/1695] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:29 2022] POST /identity/v3/users => generated 289 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:29.700957 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a15b7-483e-421c-a02d-20477688ba74 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:29.706599 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-824a15b7-483e-421c-a02d-20477688ba74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:29.889284 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-6369dcbe-ccd0-4506-84b5-35ef06b7acef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6798f81e54c54b179a85cfae02230ccf'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:29.890237 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-6369dcbe-ccd0-4506-84b5-35ef06b7acef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6798f81e54c54b179a85cfae02230ccf'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:29.954556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a15b7-483e-421c-a02d-20477688ba74 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:29.963258 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d8628-9bec-4be7-aad7-b75475d5e948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:29.964240 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d8628-9bec-4be7-aad7-b75475d5e948 service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:29.975392 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d8628-9bec-4be7-aad7-b75475d5e948 service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:29.975392 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d8628-9bec-4be7-aad7-b75475d5e948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:29.975392 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-327d8628-9bec-4be7-aad7-b75475d5e948 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:29.997828 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-6369dcbe-ccd0-4506-84b5-35ef06b7acef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6798f81e54c54b179a85cfae02230ccf'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:30.012078 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-6369dcbe-ccd0-4506-84b5-35ef06b7acef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6798f81e54c54b179a85cfae02230ccf'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:30.070851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-6369dcbe-ccd0-4506-84b5-35ef06b7acef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6798f81e54c54b179a85cfae02230ccf'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:30.081840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 846/1696] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:02:29 2022] DELETE /identity/v3/users/6798f81e54c54b179a85cfae02230ccf => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:30.082965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369dcbe-ccd0-4506-84b5-35ef06b7acef admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:30.083709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d8628-9bec-4be7-aad7-b75475d5e948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:30.086393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-6369dcbe-ccd0-4506-84b5-35ef06b7acef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:30.087538 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d8628-9bec-4be7-aad7-b75475d5e948 service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:30.114606 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 851/1697] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:30.115650 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d8628-9bec-4be7-aad7-b75475d5e948 service nova] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:30.120637 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-327d8628-9bec-4be7-aad7-b75475d5e948 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:30.135091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:30.181205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d8628-9bec-4be7-aad7-b75475d5e948 service nova] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:30.260807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369dcbe-ccd0-4506-84b5-35ef06b7acef admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:30.267157 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0f206-19cd-4586-bdd4-56b53066b3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:30.268907 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0f206-19cd-4586-bdd4-56b53066b3c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:30.269486 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0f206-19cd-4586-bdd4-56b53066b3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:30.270058 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0f206-19cd-4586-bdd4-56b53066b3c8 admin admin] PATH_INFO: `/v3/users/fde2c30c2b654dd4b624ec334aee498d` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:30.271814 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0f206-19cd-4586-bdd4-56b53066b3c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde2c30c2b654dd4b624ec334aee498d)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:30.277158 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0f206-19cd-4586-bdd4-56b53066b3c8 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:30.412897 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c001a7f-dfa4-4eec-909c-908499e1b0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:30.414382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c001a7f-dfa4-4eec-909c-908499e1b0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:30.414382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c001a7f-dfa4-4eec-909c-908499e1b0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:30.414610 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c001a7f-dfa4-4eec-909c-908499e1b0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:30.415266 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c001a7f-dfa4-4eec-909c-908499e1b0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:30.417703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c001a7f-dfa4-4eec-909c-908499e1b0c6 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:30.444441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 852/1698] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:30.445690 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b345ac-2eee-4752-b819-877fced565a8 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:30.445948 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b345ac-2eee-4752-b819-877fced565a8 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:30.446250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b345ac-2eee-4752-b819-877fced565a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:30.487390 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-d1b345ac-2eee-4752-b819-877fced565a8 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:30.495156 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d1b345ac-2eee-4752-b819-877fced565a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:30.554736 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 853/1699] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:30.556015 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b345ac-2eee-4752-b819-877fced565a8 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:30.575295 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b345ac-2eee-4752-b819-877fced565a8 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:30.585917 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9240102-41e8-4dc0-ac28-55d9ff7e41fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:30.589814 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9240102-41e8-4dc0-ac28-55d9ff7e41fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:30.589814 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9240102-41e8-4dc0-ac28-55d9ff7e41fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:30.589814 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9240102-41e8-4dc0-ac28-55d9ff7e41fc admin admin] PATH_INFO: `/v3/projects/103510845800404387e0333b55803b30/users/28728cec49c7474ca774c38cc8080dd6/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:30.595942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-72d0f206-19cd-4586-bdd4-56b53066b3c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde2c30c2b654dd4b624ec334aee498d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:30.597474 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-72d0f206-19cd-4586-bdd4-56b53066b3c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde2c30c2b654dd4b624ec334aee498d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:30.615377 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9240102-41e8-4dc0-ac28-55d9ff7e41fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=103510845800404387e0333b55803b30, user_id=28728cec49c7474ca774c38cc8080dd6, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:30.619928 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9240102-41e8-4dc0-ac28-55d9ff7e41fc admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:30.711279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-72d0f206-19cd-4586-bdd4-56b53066b3c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde2c30c2b654dd4b624ec334aee498d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:30.720169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-72d0f206-19cd-4586-bdd4-56b53066b3c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde2c30c2b654dd4b624ec334aee498d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:30.728811 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 854/1700] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:30 2022] PUT /identity/v3/projects/103510845800404387e0333b55803b30/users/28728cec49c7474ca774c38cc8080dd6/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:30.729900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9240102-41e8-4dc0-ac28-55d9ff7e41fc admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:30.746230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b9240102-41e8-4dc0-ac28-55d9ff7e41fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:30.770528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-72d0f206-19cd-4586-bdd4-56b53066b3c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde2c30c2b654dd4b624ec334aee498d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:30.811586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 847/1701] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:02:30 2022] DELETE /identity/v3/users/fde2c30c2b654dd4b624ec334aee498d => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:30.826489 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0f206-19cd-4586-bdd4-56b53066b3c8 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:30.837357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-72d0f206-19cd-4586-bdd4-56b53066b3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:30.918290 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9240102-41e8-4dc0-ac28-55d9ff7e41fc admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:31.025884 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0f206-19cd-4586-bdd4-56b53066b3c8 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:31.040097 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5ef20-a0f4-4aff-abae-8054e9a27622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:31.040765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5ef20-a0f4-4aff-abae-8054e9a27622 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:31.042956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5ef20-a0f4-4aff-abae-8054e9a27622 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:31.043375 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5ef20-a0f4-4aff-abae-8054e9a27622 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:31.044975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5ef20-a0f4-4aff-abae-8054e9a27622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:31.047423 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5ef20-a0f4-4aff-abae-8054e9a27622 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:31.051019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a1b53-6c21-4c93-a6a8-2b75520a88bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:31.051935 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a1b53-6c21-4c93-a6a8-2b75520a88bc service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:31.052332 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a1b53-6c21-4c93-a6a8-2b75520a88bc service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:31.052632 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a1b53-6c21-4c93-a6a8-2b75520a88bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:31.068524 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 848/1702] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:31.071628 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e72a1b53-6c21-4c93-a6a8-2b75520a88bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:31.074561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5ef20-a0f4-4aff-abae-8054e9a27622 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:31.101872 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5ef20-a0f4-4aff-abae-8054e9a27622 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:31.111044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a1b53-6c21-4c93-a6a8-2b75520a88bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:31.112474 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a1b53-6c21-4c93-a6a8-2b75520a88bc service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:31.118221 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6539d-ee9d-4044-8e90-c39e8db32db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:31.121263 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6539d-ee9d-4044-8e90-c39e8db32db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:31.121841 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6539d-ee9d-4044-8e90-c39e8db32db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:31.122368 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6539d-ee9d-4044-8e90-c39e8db32db5 admin admin] PATH_INFO: `/v3/projects/103510845800404387e0333b55803b30/users/28728cec49c7474ca774c38cc8080dd6/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:31.128116 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 855/1703] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:31.128380 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a1b53-6c21-4c93-a6a8-2b75520a88bc service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:31.130470 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e72a1b53-6c21-4c93-a6a8-2b75520a88bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:31.137959 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6539d-ee9d-4044-8e90-c39e8db32db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=103510845800404387e0333b55803b30, user_id=28728cec49c7474ca774c38cc8080dd6, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:31.141456 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6539d-ee9d-4044-8e90-c39e8db32db5 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:31.156035 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a1b53-6c21-4c93-a6a8-2b75520a88bc service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:31.178242 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 849/1704] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:31 2022] PUT /identity/v3/projects/103510845800404387e0333b55803b30/users/28728cec49c7474ca774c38cc8080dd6/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:31.199773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f07b76-f40c-4874-97e0-410e1b0222fc None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:31.200396 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f07b76-f40c-4874-97e0-410e1b0222fc None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:31.212483 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f07b76-f40c-4874-97e0-410e1b0222fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:31.288477 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-28f07b76-f40c-4874-97e0-410e1b0222fc None None] MFA Rules not processed for user `28728cec49c7474ca774c38cc8080dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:31.289935 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-28f07b76-f40c-4874-97e0-410e1b0222fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:31.353371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac4e31-ed94-4160-9f0a-1bcbab59c078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:31.354401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac4e31-ed94-4160-9f0a-1bcbab59c078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:31.354743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac4e31-ed94-4160-9f0a-1bcbab59c078 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:31.355074 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac4e31-ed94-4160-9f0a-1bcbab59c078 admin admin] PATH_INFO: `/v3/users/19dbbaf75bf74faf96e0c382572b3645` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:31.357084 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac4e31-ed94-4160-9f0a-1bcbab59c078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19dbbaf75bf74faf96e0c382572b3645)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:31.359172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac4e31-ed94-4160-9f0a-1bcbab59c078 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:31.466471 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 850/1705] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:02:31.466471 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da3a85-57b0-4578-9c7d-e3716c8ccb8b None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:31.469985 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da3a85-57b0-4578-9c7d-e3716c8ccb8b None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:31.470370 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:31.471240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da3a85-57b0-4578-9c7d-e3716c8ccb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:31.533462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-c8da3a85-57b0-4578-9c7d-e3716c8ccb8b None None] MFA Rules not processed for user `4f91caa3c691497d828f6a91c1a4c4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:31.535117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c8da3a85-57b0-4578-9c7d-e3716c8ccb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:31.614164 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-06ac4e31-ed94-4160-9f0a-1bcbab59c078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19dbbaf75bf74faf96e0c382572b3645'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:31.617801 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-06ac4e31-ed94-4160-9f0a-1bcbab59c078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19dbbaf75bf74faf96e0c382572b3645'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:31.661920 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 851/1706] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:31.663125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da3a85-57b0-4578-9c7d-e3716c8ccb8b None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:31.665299 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c8da3a85-57b0-4578-9c7d-e3716c8ccb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:31.702247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-06ac4e31-ed94-4160-9f0a-1bcbab59c078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19dbbaf75bf74faf96e0c382572b3645'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:31.811532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-06ac4e31-ed94-4160-9f0a-1bcbab59c078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19dbbaf75bf74faf96e0c382572b3645'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:31.850360 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-06ac4e31-ed94-4160-9f0a-1bcbab59c078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19dbbaf75bf74faf96e0c382572b3645'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:31.885583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da3a85-57b0-4578-9c7d-e3716c8ccb8b None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:31.889003 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 856/1707] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:02:31 2022] DELETE /identity/v3/users/19dbbaf75bf74faf96e0c382572b3645 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:31.889003 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d0b39-725f-47c2-aa15-ef183a31ec22 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:31.893938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d0b39-725f-47c2-aa15-ef183a31ec22 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:31.894640 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d0b39-725f-47c2-aa15-ef183a31ec22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:31.946696 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:32.013110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-921d0b39-725f-47c2-aa15-ef183a31ec22 None None] MFA Rules not processed for user `4f91caa3c691497d828f6a91c1a4c4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:32.015184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-921d0b39-725f-47c2-aa15-ef183a31ec22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:32.094932 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91b402-1e9f-4614-852f-7d2b64458f45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:32.096379 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91b402-1e9f-4614-852f-7d2b64458f45 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:32.096868 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91b402-1e9f-4614-852f-7d2b64458f45 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:32.097325 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91b402-1e9f-4614-852f-7d2b64458f45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:32.101284 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-6d91b402-1e9f-4614-852f-7d2b64458f45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:32.171854 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 857/1708] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:32.175363 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a87f23-d66f-4f5e-8749-930c727d8fad None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:32.177368 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a87f23-d66f-4f5e-8749-930c727d8fad None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:32.188734 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a87f23-d66f-4f5e-8749-930c727d8fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:32.216210 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91b402-1e9f-4614-852f-7d2b64458f45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:32.219438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91b402-1e9f-4614-852f-7d2b64458f45 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:32.235066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 852/1709] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:32.236140 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91b402-1e9f-4614-852f-7d2b64458f45 service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:32.238125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-6d91b402-1e9f-4614-852f-7d2b64458f45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:32.276066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-58a87f23-d66f-4f5e-8749-930c727d8fad None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:32.277485 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-58a87f23-d66f-4f5e-8749-930c727d8fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:32.338111 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91b402-1e9f-4614-852f-7d2b64458f45 service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:32.343997 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71999e46-c02d-4138-a00c-bbb4c4f4a202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:32.344678 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71999e46-c02d-4138-a00c-bbb4c4f4a202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:32.349489 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71999e46-c02d-4138-a00c-bbb4c4f4a202 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:32.349489 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71999e46-c02d-4138-a00c-bbb4c4f4a202 admin admin] PATH_INFO: `/v3/projects/eec535f25ffb4c67ada7fd0816643a33` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:32.349489 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71999e46-c02d-4138-a00c-bbb4c4f4a202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec535f25ffb4c67ada7fd0816643a33)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:32.349954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71999e46-c02d-4138-a00c-bbb4c4f4a202 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:32.421828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 858/1710] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:32.422859 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a87f23-d66f-4f5e-8749-930c727d8fad None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:32.426595 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-58a87f23-d66f-4f5e-8749-930c727d8fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:32.553363 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-71999e46-c02d-4138-a00c-bbb4c4f4a202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec535f25ffb4c67ada7fd0816643a33', 'request_id': 'req-71999e46-c02d-4138-a00c-bbb4c4f4a202'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:32.571971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-71999e46-c02d-4138-a00c-bbb4c4f4a202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec535f25ffb4c67ada7fd0816643a33', 'request_id': 'req-71999e46-c02d-4138-a00c-bbb4c4f4a202'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:32.604799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-71999e46-c02d-4138-a00c-bbb4c4f4a202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec535f25ffb4c67ada7fd0816643a33', 'request_id': 'req-71999e46-c02d-4138-a00c-bbb4c4f4a202'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:32.645643 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a87f23-d66f-4f5e-8749-930c727d8fad None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:32.710417 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-71999e46-c02d-4138-a00c-bbb4c4f4a202 admin admin] The token cache is being invalidate because project eec535f25ffb4c67ada7fd0816643a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:02:32.713572 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-71999e46-c02d-4138-a00c-bbb4c4f4a202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:32.716992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-71999e46-c02d-4138-a00c-bbb4c4f4a202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:32.720253 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 853/1711] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:02:32 2022] DELETE /identity/v3/projects/eec535f25ffb4c67ada7fd0816643a33 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:32.721158 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71999e46-c02d-4138-a00c-bbb4c4f4a202 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:32.726062 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-71999e46-c02d-4138-a00c-bbb4c4f4a202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:32.795902 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc61c1-69fa-40a5-8ced-a980831f7774 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:32.799301 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc61c1-69fa-40a5-8ced-a980831f7774 service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:32.799301 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc61c1-69fa-40a5-8ced-a980831f7774 service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:32.799301 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc61c1-69fa-40a5-8ced-a980831f7774 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:32.799565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-92bc61c1-69fa-40a5-8ced-a980831f7774 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:32.878369 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71999e46-c02d-4138-a00c-bbb4c4f4a202 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:32.883995 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b142f-7643-49e5-b2fc-f0092c5585e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:32.884741 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b142f-7643-49e5-b2fc-f0092c5585e7 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:32.885099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b142f-7643-49e5-b2fc-f0092c5585e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:32.885450 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b142f-7643-49e5-b2fc-f0092c5585e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:32.887671 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-2a2b142f-7643-49e5-b2fc-f0092c5585e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:32.890929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc61c1-69fa-40a5-8ced-a980831f7774 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:32.892497 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc61c1-69fa-40a5-8ced-a980831f7774 service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:32.905544 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 859/1712] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:32.906448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc61c1-69fa-40a5-8ced-a980831f7774 service nova] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:32.908508 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-92bc61c1-69fa-40a5-8ced-a980831f7774 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:32.973813 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:32.992392 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc61c1-69fa-40a5-8ced-a980831f7774 service nova] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:32.994432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b142f-7643-49e5-b2fc-f0092c5585e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:33.005263 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b142f-7643-49e5-b2fc-f0092c5585e7 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:33.005353 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8008848-0e93-408e-9e44-05197b33573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:33.005353 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8008848-0e93-408e-9e44-05197b33573b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:33.005353 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8008848-0e93-408e-9e44-05197b33573b admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:33.005353 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8008848-0e93-408e-9e44-05197b33573b admin admin] PATH_INFO: `/v3/projects/b2a74b68c05345a69311de67bde2a00f` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:33.005657 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8008848-0e93-408e-9e44-05197b33573b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2a74b68c05345a69311de67bde2a00f)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:33.005657 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8008848-0e93-408e-9e44-05197b33573b admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:33.027962 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 854/1713] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:33.029247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b142f-7643-49e5-b2fc-f0092c5585e7 service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:33.042358 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-2a2b142f-7643-49e5-b2fc-f0092c5585e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:33.170317 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b142f-7643-49e5-b2fc-f0092c5585e7 service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:33.180122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-a8008848-0e93-408e-9e44-05197b33573b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2a74b68c05345a69311de67bde2a00f', 'request_id': 'req-a8008848-0e93-408e-9e44-05197b33573b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:33.273318 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-a8008848-0e93-408e-9e44-05197b33573b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2a74b68c05345a69311de67bde2a00f', 'request_id': 'req-a8008848-0e93-408e-9e44-05197b33573b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:33.281475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-a8008848-0e93-408e-9e44-05197b33573b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2a74b68c05345a69311de67bde2a00f', 'request_id': 'req-a8008848-0e93-408e-9e44-05197b33573b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:33.324187 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-a8008848-0e93-408e-9e44-05197b33573b admin admin] The token cache is being invalidate because project b2a74b68c05345a69311de67bde2a00f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:02:33.324435 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-a8008848-0e93-408e-9e44-05197b33573b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:33.327526 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-a8008848-0e93-408e-9e44-05197b33573b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:33.338988 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 860/1714] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:02:32 2022] DELETE /identity/v3/projects/b2a74b68c05345a69311de67bde2a00f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:33.344194 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305858c0-cfd6-404b-aa22-79a882f99709 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:33.345237 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305858c0-cfd6-404b-aa22-79a882f99709 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:33.345713 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305858c0-cfd6-404b-aa22-79a882f99709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:33.350721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf9cf9-b374-4fc9-8599-c491211c1aea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:33.352959 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf9cf9-b374-4fc9-8599-c491211c1aea service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:33.353380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf9cf9-b374-4fc9-8599-c491211c1aea service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:33.356413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf9cf9-b374-4fc9-8599-c491211c1aea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:33.364355 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-aecf9cf9-b374-4fc9-8599-c491211c1aea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:33.434793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-305858c0-cfd6-404b-aa22-79a882f99709 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:33.439129 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-305858c0-cfd6-404b-aa22-79a882f99709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:33.455630 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:33.484701 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf9cf9-b374-4fc9-8599-c491211c1aea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:33.489041 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf9cf9-b374-4fc9-8599-c491211c1aea service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:33.522977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 855/1715] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:33 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:33.527164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20049905-cf93-488b-8559-b14f1a29efe2 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:33.527481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20049905-cf93-488b-8559-b14f1a29efe2 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:33.529561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20049905-cf93-488b-8559-b14f1a29efe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:33.652801 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 861/1716] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:33.660716 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-20049905-cf93-488b-8559-b14f1a29efe2 None None] MFA Rules not processed for user `239971f05a0b4ba4874c167c26927c98`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:33.660716 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-20049905-cf93-488b-8559-b14f1a29efe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:33.666865 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e035476-3512-40d8-b064-ad2cd707e7e5 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:33.667160 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e035476-3512-40d8-b064-ad2cd707e7e5 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:33.667475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e035476-3512-40d8-b064-ad2cd707e7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:33.711532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-8e035476-3512-40d8-b064-ad2cd707e7e5 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:33.714232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-8e035476-3512-40d8-b064-ad2cd707e7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:33.751301 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 862/1717] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:33.753674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38161ca8-6f54-4a52-8f50-d37a36ac5b9f None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:33.758580 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38161ca8-6f54-4a52-8f50-d37a36ac5b9f None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:33.759140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38161ca8-6f54-4a52-8f50-d37a36ac5b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:33.810321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-38161ca8-6f54-4a52-8f50-d37a36ac5b9f None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:33.812568 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-38161ca8-6f54-4a52-8f50-d37a36ac5b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:33.824906 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 863/1718] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:33.832285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ead3f-ff2d-4328-a500-320250e9a237 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:33.832876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ead3f-ff2d-4328-a500-320250e9a237 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:33.833323 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ead3f-ff2d-4328-a500-320250e9a237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:33.879995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-345ead3f-ff2d-4328-a500-320250e9a237 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:33.881113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-345ead3f-ff2d-4328-a500-320250e9a237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:33.909958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 864/1719] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:33.912248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54773c-1d39-4100-b252-4f9003994461 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:33.912875 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54773c-1d39-4100-b252-4f9003994461 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:33.913160 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54773c-1d39-4100-b252-4f9003994461 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:33.914747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 865/1720] 10.222.0.64 () {54 vars in 912 bytes} [Thu Jul 28 04:02:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:02:33.915612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54773c-1d39-4100-b252-4f9003994461 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:33.929326 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 856/1721] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:33.933406 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20049905-cf93-488b-8559-b14f1a29efe2 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:33.937658 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54773c-1d39-4100-b252-4f9003994461 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:33.938892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-20049905-cf93-488b-8559-b14f1a29efe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:33.946023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3487892-c347-4005-8801-129e165cec87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:33.946985 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3487892-c347-4005-8801-129e165cec87 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:33.947533 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3487892-c347-4005-8801-129e165cec87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:33.947866 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3487892-c347-4005-8801-129e165cec87 admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:33.948716 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3487892-c347-4005-8801-129e165cec87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:02:33.949218 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3487892-c347-4005-8801-129e165cec87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:33.951419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3487892-c347-4005-8801-129e165cec87 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:33.969997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 866/1722] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:02:33.971105 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3487892-c347-4005-8801-129e165cec87 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:33.983900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3487892-c347-4005-8801-129e165cec87 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:33.990473 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea277e-d91d-46b9-b5e0-2a1f704638c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:33.991219 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea277e-d91d-46b9-b5e0-2a1f704638c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:33.991846 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea277e-d91d-46b9-b5e0-2a1f704638c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:33.992195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea277e-d91d-46b9-b5e0-2a1f704638c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:33.993037 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea277e-d91d-46b9-b5e0-2a1f704638c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:02:33.993415 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea277e-d91d-46b9-b5e0-2a1f704638c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:33.996736 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea277e-d91d-46b9-b5e0-2a1f704638c6 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:34.018191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 867/1723] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:02:34.019778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283978fb-6d78-4405-ab67-1fe8fb751ccb None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:34.020394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283978fb-6d78-4405-ab67-1fe8fb751ccb None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:34.020872 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283978fb-6d78-4405-ab67-1fe8fb751ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:34.072495 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-283978fb-6d78-4405-ab67-1fe8fb751ccb None None] MFA Rules not processed for user `03742c23cae849d9bf4ce0b432edd1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:34.074037 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-283978fb-6d78-4405-ab67-1fe8fb751ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:34.151104 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20049905-cf93-488b-8559-b14f1a29efe2 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:34.164450 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ee216-889e-416a-a71f-c944b03bf5c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:34.165112 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ee216-889e-416a-a71f-c944b03bf5c3 service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:34.165399 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ee216-889e-416a-a71f-c944b03bf5c3 service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:34.168189 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ee216-889e-416a-a71f-c944b03bf5c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:34.210386 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ee216-889e-416a-a71f-c944b03bf5c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:34.215646 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ee216-889e-416a-a71f-c944b03bf5c3 service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:34.235537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 868/1724] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 28 04:02:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:34.250046 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283978fb-6d78-4405-ab67-1fe8fb751ccb None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:34.264520 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 857/1725] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:34.267369 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ee216-889e-416a-a71f-c944b03bf5c3 service nova] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:34.278640 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283978fb-6d78-4405-ab67-1fe8fb751ccb None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:34.296649 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ee216-889e-416a-a71f-c944b03bf5c3 service nova] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:34.301773 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e02e2d-7c11-446d-8f1e-94f4cf4a1612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:34.302438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e02e2d-7c11-446d-8f1e-94f4cf4a1612 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:34.302722 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e02e2d-7c11-446d-8f1e-94f4cf4a1612 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:34.307922 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e02e2d-7c11-446d-8f1e-94f4cf4a1612 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:34.307922 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e02e2d-7c11-446d-8f1e-94f4cf4a1612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:34.311138 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e02e2d-7c11-446d-8f1e-94f4cf4a1612 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:34.322549 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd998cfe-052c-4ad4-a8ea-2862c159edf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:34.323351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd998cfe-052c-4ad4-a8ea-2862c159edf2 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:34.323652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd998cfe-052c-4ad4-a8ea-2862c159edf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:34.323933 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd998cfe-052c-4ad4-a8ea-2862c159edf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:34.328317 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd998cfe-052c-4ad4-a8ea-2862c159edf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:34.343786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd998cfe-052c-4ad4-a8ea-2862c159edf2 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:34.497136 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 869/1726] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:34 2022] POST /identity/v3/projects => generated 377 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:34.498715 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e02e2d-7c11-446d-8f1e-94f4cf4a1612 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:34.505551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-14e02e2d-7c11-446d-8f1e-94f4cf4a1612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:34.553565 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 858/1727] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:34 2022] POST /identity/v3/projects => generated 371 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:34.556854 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd998cfe-052c-4ad4-a8ea-2862c159edf2 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:34.560427 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-fd998cfe-052c-4ad4-a8ea-2862c159edf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:34.663589 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd998cfe-052c-4ad4-a8ea-2862c159edf2 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:34.666105 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e02e2d-7c11-446d-8f1e-94f4cf4a1612 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:34.670072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9b9ca-aed0-40e6-95c0-6407220cfdd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:34.670994 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9b9ca-aed0-40e6-95c0-6407220cfdd9 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:34.671569 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9b9ca-aed0-40e6-95c0-6407220cfdd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:34.672114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9b9ca-aed0-40e6-95c0-6407220cfdd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:34.683012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9b9ca-aed0-40e6-95c0-6407220cfdd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:34.685560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9b9ca-aed0-40e6-95c0-6407220cfdd9 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:34.699929 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 859/1728] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:34.700945 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9b9ca-aed0-40e6-95c0-6407220cfdd9 service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:34.761465 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b7b4b-4b43-4a00-9ec2-6423fb675a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:34.762292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b7b4b-4b43-4a00-9ec2-6423fb675a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:34.762685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b7b4b-4b43-4a00-9ec2-6423fb675a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:34.763145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b7b4b-4b43-4a00-9ec2-6423fb675a88 admin admin] PATH_INFO: `/v3/projects/94dcff837ea64eb582ed08b78b7aeed7` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:34.764575 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b7b4b-4b43-4a00-9ec2-6423fb675a88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94dcff837ea64eb582ed08b78b7aeed7)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:34.766684 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b7b4b-4b43-4a00-9ec2-6423fb675a88 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:34.932100 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9b9ca-aed0-40e6-95c0-6407220cfdd9 service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:34.940382 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746f3f9-22b6-413c-847e-36d9850c1f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:34.941423 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746f3f9-22b6-413c-847e-36d9850c1f63 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:34.941910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746f3f9-22b6-413c-847e-36d9850c1f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:34.942365 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746f3f9-22b6-413c-847e-36d9850c1f63 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:34.943794 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746f3f9-22b6-413c-847e-36d9850c1f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:34.946067 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746f3f9-22b6-413c-847e-36d9850c1f63 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:34.962951 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:35.058128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-a37b7b4b-4b43-4a00-9ec2-6423fb675a88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94dcff837ea64eb582ed08b78b7aeed7', 'request_id': 'req-a37b7b4b-4b43-4a00-9ec2-6423fb675a88'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:35.059765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 860/1729] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:34 2022] POST /identity/v3/users => generated 289 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:35.061670 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746f3f9-22b6-413c-847e-36d9850c1f63 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:35.093699 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746f3f9-22b6-413c-847e-36d9850c1f63 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:35.199605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-a37b7b4b-4b43-4a00-9ec2-6423fb675a88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94dcff837ea64eb582ed08b78b7aeed7', 'request_id': 'req-a37b7b4b-4b43-4a00-9ec2-6423fb675a88'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:35.206776 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-a37b7b4b-4b43-4a00-9ec2-6423fb675a88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94dcff837ea64eb582ed08b78b7aeed7', 'request_id': 'req-a37b7b4b-4b43-4a00-9ec2-6423fb675a88'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:35.230896 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-a37b7b4b-4b43-4a00-9ec2-6423fb675a88 admin admin] The token cache is being invalidate because project 94dcff837ea64eb582ed08b78b7aeed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:02:35.231518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-a37b7b4b-4b43-4a00-9ec2-6423fb675a88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:35.245036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-a37b7b4b-4b43-4a00-9ec2-6423fb675a88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:35.256849 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 870/1730] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:02:34 2022] DELETE /identity/v3/projects/94dcff837ea64eb582ed08b78b7aeed7 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:35.257459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:35.262074 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b7b4b-4b43-4a00-9ec2-6423fb675a88 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:35.268791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a37b7b4b-4b43-4a00-9ec2-6423fb675a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:35.285537 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86c773-f8ba-421b-8c1d-b43820dde451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:35.292203 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86c773-f8ba-421b-8c1d-b43820dde451 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:35.295425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86c773-f8ba-421b-8c1d-b43820dde451 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:35.295425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86c773-f8ba-421b-8c1d-b43820dde451 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:35.295425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86c773-f8ba-421b-8c1d-b43820dde451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:35.307402 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86c773-f8ba-421b-8c1d-b43820dde451 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:35.323071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b7b4b-4b43-4a00-9ec2-6423fb675a88 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:35.337633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3f3db-ef0e-45b9-aaae-0d40c9409706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:35.338521 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3f3db-ef0e-45b9-aaae-0d40c9409706 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:35.338812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3f3db-ef0e-45b9-aaae-0d40c9409706 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:35.339092 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3f3db-ef0e-45b9-aaae-0d40c9409706 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:35.341068 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3f3db-ef0e-45b9-aaae-0d40c9409706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:35.345165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3f3db-ef0e-45b9-aaae-0d40c9409706 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:35.367431 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 871/1731] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:35.367431 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3f3db-ef0e-45b9-aaae-0d40c9409706 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:35.368904 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-75e3f3db-ef0e-45b9-aaae-0d40c9409706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:35.409662 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3f3db-ef0e-45b9-aaae-0d40c9409706 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:35.416461 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 861/1732] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:35 2022] POST /identity/v3/users => generated 286 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:35.417915 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86c773-f8ba-421b-8c1d-b43820dde451 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:35.437137 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe2037-5ce5-413f-aced-5a6ea66a2b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:35.438868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe2037-5ce5-413f-aced-5a6ea66a2b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:35.438868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe2037-5ce5-413f-aced-5a6ea66a2b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:35.438868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe2037-5ce5-413f-aced-5a6ea66a2b55 admin admin] PATH_INFO: `/v3/users/ca6962fd156d44539c208ce4b1f1da86` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:35.445634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe2037-5ce5-413f-aced-5a6ea66a2b55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca6962fd156d44539c208ce4b1f1da86)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:35.450407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe2037-5ce5-413f-aced-5a6ea66a2b55 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:35.458477 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86c773-f8ba-421b-8c1d-b43820dde451 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:35.480399 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee813ec-05b0-42bc-a5e2-3cf2aaa3ab34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:35.481069 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee813ec-05b0-42bc-a5e2-3cf2aaa3ab34 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:35.481357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee813ec-05b0-42bc-a5e2-3cf2aaa3ab34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:35.481638 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee813ec-05b0-42bc-a5e2-3cf2aaa3ab34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:35.482367 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee813ec-05b0-42bc-a5e2-3cf2aaa3ab34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:35.491361 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee813ec-05b0-42bc-a5e2-3cf2aaa3ab34 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:35.535129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 862/1733] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:35.535129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee813ec-05b0-42bc-a5e2-3cf2aaa3ab34 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:35.540152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-7ee813ec-05b0-42bc-a5e2-3cf2aaa3ab34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:35.571137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee813ec-05b0-42bc-a5e2-3cf2aaa3ab34 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:35.586613 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea60e5-32fe-490c-9c92-45bc445c04b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:35.587518 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea60e5-32fe-490c-9c92-45bc445c04b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:35.587813 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea60e5-32fe-490c-9c92-45bc445c04b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:35.588134 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea60e5-32fe-490c-9c92-45bc445c04b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:35.588808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea60e5-32fe-490c-9c92-45bc445c04b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:35.590603 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea60e5-32fe-490c-9c92-45bc445c04b4 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:35.617618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 863/1734] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:35.618382 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea60e5-32fe-490c-9c92-45bc445c04b4 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:35.636242 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea60e5-32fe-490c-9c92-45bc445c04b4 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:35.652081 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98db532-e3e8-40f6-8511-e79918299d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:35.655737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98db532-e3e8-40f6-8511-e79918299d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:35.655737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98db532-e3e8-40f6-8511-e79918299d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:35.656277 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98db532-e3e8-40f6-8511-e79918299d5f admin admin] PATH_INFO: `/v3/projects/eeabe2277acd4a2c961e650dbcacd84f/users/4dbe96e33792428aa75227264be32a2c/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:35.687424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98db532-e3e8-40f6-8511-e79918299d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeabe2277acd4a2c961e650dbcacd84f, user_id=4dbe96e33792428aa75227264be32a2c, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:35.688165 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98db532-e3e8-40f6-8511-e79918299d5f admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:35.790540 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-75fe2037-5ce5-413f-aced-5a6ea66a2b55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca6962fd156d44539c208ce4b1f1da86'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:35.791575 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-75fe2037-5ce5-413f-aced-5a6ea66a2b55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca6962fd156d44539c208ce4b1f1da86'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:35.871901 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 864/1735] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:35 2022] PUT /identity/v3/projects/eeabe2277acd4a2c961e650dbcacd84f/users/4dbe96e33792428aa75227264be32a2c/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:35.873525 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98db532-e3e8-40f6-8511-e79918299d5f admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:35.891095 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-75fe2037-5ce5-413f-aced-5a6ea66a2b55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca6962fd156d44539c208ce4b1f1da86'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:35.919762 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-75fe2037-5ce5-413f-aced-5a6ea66a2b55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca6962fd156d44539c208ce4b1f1da86'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:35.947753 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-75fe2037-5ce5-413f-aced-5a6ea66a2b55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca6962fd156d44539c208ce4b1f1da86'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:35.964686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 872/1736] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:02:35 2022] DELETE /identity/v3/users/ca6962fd156d44539c208ce4b1f1da86 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:35.966250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecc6fa-c303-42f3-a491-0502154391d6 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:35.966505 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecc6fa-c303-42f3-a491-0502154391d6 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:35.966788 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecc6fa-c303-42f3-a491-0502154391d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:36.042400 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-31ecc6fa-c303-42f3-a491-0502154391d6 None None] MFA Rules not processed for user `4dbe96e33792428aa75227264be32a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:36.043773 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-31ecc6fa-c303-42f3-a491-0502154391d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:36.150085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98db532-e3e8-40f6-8511-e79918299d5f admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:36.180709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 873/1737] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:36.184542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010d4c6-8271-459f-83ce-a33c17c2c868 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:36.184542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010d4c6-8271-459f-83ce-a33c17c2c868 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:36.184542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010d4c6-8271-459f-83ce-a33c17c2c868 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:36.187598 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 874/1738] 10.222.0.64 () {54 vars in 961 bytes} [Thu Jul 28 04:02:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:02:36.188654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010d4c6-8271-459f-83ce-a33c17c2c868 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:36.191118 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-4010d4c6-8271-459f-83ce-a33c17c2c868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:36.330287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afaaf9-b85a-4bde-9ff2-1880e74928bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:36.331347 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afaaf9-b85a-4bde-9ff2-1880e74928bb admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:36.333388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afaaf9-b85a-4bde-9ff2-1880e74928bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:36.334922 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afaaf9-b85a-4bde-9ff2-1880e74928bb admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:36.337664 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afaaf9-b85a-4bde-9ff2-1880e74928bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:36.353463 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afaaf9-b85a-4bde-9ff2-1880e74928bb admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:36.401280 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 865/1739] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:35 2022] GET /identity/v3/roles => generated 1420 bytes in 528 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:36.402758 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56cbf0-699f-412e-b569-8a689cf779f4 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:36.403055 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56cbf0-699f-412e-b569-8a689cf779f4 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:36.403346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56cbf0-699f-412e-b569-8a689cf779f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:36.476822 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010d4c6-8271-459f-83ce-a33c17c2c868 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:36.484740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-9c56cbf0-699f-412e-b569-8a689cf779f4 None None] MFA Rules not processed for user `e91f2584622a48bba21e1bf31c1aef30`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:36.486058 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9c56cbf0-699f-412e-b569-8a689cf779f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:36.497696 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e484a-2cd9-4412-b026-ed4aa563e8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:36.498463 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e484a-2cd9-4412-b026-ed4aa563e8b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:36.498565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e484a-2cd9-4412-b026-ed4aa563e8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:36.498972 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e484a-2cd9-4412-b026-ed4aa563e8b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:36.501564 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e484a-2cd9-4412-b026-ed4aa563e8b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:36.511931 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e484a-2cd9-4412-b026-ed4aa563e8b9 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:36.662496 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 875/1740] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:36 2022] POST /identity/v3/projects => generated 377 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:36.662496 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e484a-2cd9-4412-b026-ed4aa563e8b9 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:36.666232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-414e484a-2cd9-4412-b026-ed4aa563e8b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:36.667996 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 866/1741] 10.222.0.64 () {58 vars in 1058 bytes} [Thu Jul 28 04:02:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:36.668858 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56cbf0-699f-412e-b569-8a689cf779f4 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:36.697697 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56cbf0-699f-412e-b569-8a689cf779f4 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:36.803436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e484a-2cd9-4412-b026-ed4aa563e8b9 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:36.809722 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425044a2-32ee-44c6-944d-cadab01accfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:36.810536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425044a2-32ee-44c6-944d-cadab01accfa admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:36.810822 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425044a2-32ee-44c6-944d-cadab01accfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:36.811177 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425044a2-32ee-44c6-944d-cadab01accfa admin admin] PATH_INFO: `/v3/projects/0d535eb814f54d09890866e32cfb2a18/users/9fe9f02c14f5491aa6ef52ccf1a57586/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:36.832602 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425044a2-32ee-44c6-944d-cadab01accfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d535eb814f54d09890866e32cfb2a18, user_id=9fe9f02c14f5491aa6ef52ccf1a57586, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:36.836396 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425044a2-32ee-44c6-944d-cadab01accfa admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:36.940295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe632ea3-6668-4f4b-bc97-d7e4fbedc212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:36.941141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe632ea3-6668-4f4b-bc97-d7e4fbedc212 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:36.941434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe632ea3-6668-4f4b-bc97-d7e4fbedc212 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:36.941718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe632ea3-6668-4f4b-bc97-d7e4fbedc212 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:36.942427 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe632ea3-6668-4f4b-bc97-d7e4fbedc212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:36.944976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe632ea3-6668-4f4b-bc97-d7e4fbedc212 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:36.959358 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 876/1742] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:36 2022] PUT /identity/v3/projects/0d535eb814f54d09890866e32cfb2a18/users/9fe9f02c14f5491aa6ef52ccf1a57586/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:36.959505 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425044a2-32ee-44c6-944d-cadab01accfa admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:37.112129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 867/1743] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:36 2022] POST /identity/v3/users => generated 295 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:37.113720 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a40ee-392c-49d2-bd0a-7205d9729557 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:37.114079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a40ee-392c-49d2-bd0a-7205d9729557 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:37.114433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a40ee-392c-49d2-bd0a-7205d9729557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:37.185500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425044a2-32ee-44c6-944d-cadab01accfa admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:37.196312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-e63a40ee-392c-49d2-bd0a-7205d9729557 None None] MFA Rules not processed for user `9fe9f02c14f5491aa6ef52ccf1a57586`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:37.199492 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e63a40ee-392c-49d2-bd0a-7205d9729557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:37.212038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aee565-b121-427c-8dc6-6749c80e1a13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f2584622a48bba21e1bf31c1aef30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:37.213167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aee565-b121-427c-8dc6-6749c80e1a13 service placement] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:37.213810 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aee565-b121-427c-8dc6-6749c80e1a13 service placement] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:37.214492 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aee565-b121-427c-8dc6-6749c80e1a13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:37.219441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-75aee565-b121-427c-8dc6-6749c80e1a13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:37.260653 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aee565-b121-427c-8dc6-6749c80e1a13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:37.266177 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aee565-b121-427c-8dc6-6749c80e1a13 service placement] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:37.302101 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 877/1744] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:37.315445 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aee565-b121-427c-8dc6-6749c80e1a13 service placement] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:37.419051 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 868/1745] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:37.426368 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a40ee-392c-49d2-bd0a-7205d9729557 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:37.462165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:37.558832 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aee565-b121-427c-8dc6-6749c80e1a13 service placement] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:37.593686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edf8ec-8e8d-4964-b3ea-82782a0bd800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:37.594347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edf8ec-8e8d-4964-b3ea-82782a0bd800 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:37.594630 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edf8ec-8e8d-4964-b3ea-82782a0bd800 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:37.594908 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edf8ec-8e8d-4964-b3ea-82782a0bd800 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:37.596416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edf8ec-8e8d-4964-b3ea-82782a0bd800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:37.598599 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edf8ec-8e8d-4964-b3ea-82782a0bd800 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:37.609951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a40ee-392c-49d2-bd0a-7205d9729557 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:37.615052 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7529afa-f809-40e3-8b16-7bb6b490fa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:37.633087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7529afa-f809-40e3-8b16-7bb6b490fa60 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:37.638647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7529afa-f809-40e3-8b16-7bb6b490fa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:37.638647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7529afa-f809-40e3-8b16-7bb6b490fa60 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:37.638647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7529afa-f809-40e3-8b16-7bb6b490fa60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:37.638647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7529afa-f809-40e3-8b16-7bb6b490fa60 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:37.655399 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 878/1746] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:37.665486 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edf8ec-8e8d-4964-b3ea-82782a0bd800 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:37.708734 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edf8ec-8e8d-4964-b3ea-82782a0bd800 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:37.727462 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71155224-2d29-4568-882f-338a9b78e33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:37.733033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71155224-2d29-4568-882f-338a9b78e33a admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:37.733461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71155224-2d29-4568-882f-338a9b78e33a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:37.733584 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71155224-2d29-4568-882f-338a9b78e33a admin admin] PATH_INFO: `/v3/projects/197c2418a7784b37b603a483b3142165/users/1531699bcd2b490b8220b7d856e5ad22/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:37.789999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:37.813297 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 869/1747] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:37 2022] POST /identity/v3/projects => generated 373 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:37.818379 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7529afa-f809-40e3-8b16-7bb6b490fa60 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:37.831695 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71155224-2d29-4568-882f-338a9b78e33a admin admin] RBAC: Authorizing `identity:create_grant(project_id=197c2418a7784b37b603a483b3142165, user_id=1531699bcd2b490b8220b7d856e5ad22, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:37.841579 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71155224-2d29-4568-882f-338a9b78e33a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:38.015858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 879/1748] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:37 2022] PUT /identity/v3/projects/197c2418a7784b37b603a483b3142165/users/1531699bcd2b490b8220b7d856e5ad22/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:38.016794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71155224-2d29-4568-882f-338a9b78e33a admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:38.029293 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7529afa-f809-40e3-8b16-7bb6b490fa60 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:38.124782 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5df8d-0615-43eb-9450-9a83c04ae857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:38.132296 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5df8d-0615-43eb-9450-9a83c04ae857 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:38.133119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5df8d-0615-43eb-9450-9a83c04ae857 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:38.133689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5df8d-0615-43eb-9450-9a83c04ae857 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:38.134603 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5df8d-0615-43eb-9450-9a83c04ae857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:38.137056 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5df8d-0615-43eb-9450-9a83c04ae857 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:38.199222 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71155224-2d29-4568-882f-338a9b78e33a admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:38.206584 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe238f-69c7-412d-a231-19d382ab5c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:38.207293 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe238f-69c7-412d-a231-19d382ab5c1c admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:38.207601 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe238f-69c7-412d-a231-19d382ab5c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:38.211456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe238f-69c7-412d-a231-19d382ab5c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:38.211456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe238f-69c7-412d-a231-19d382ab5c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:38.211456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe238f-69c7-412d-a231-19d382ab5c1c admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:38.224126 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 880/1749] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:38.225786 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce882ed7-5a93-4e28-b843-11f8ea17d8e1 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:38.226121 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce882ed7-5a93-4e28-b843-11f8ea17d8e1 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:38.226405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce882ed7-5a93-4e28-b843-11f8ea17d8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:38.250634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-ce882ed7-5a93-4e28-b843-11f8ea17d8e1 None None] MFA Rules not processed for user `414b0f1addcc487fb2834b16d7047923`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:38.254688 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ce882ed7-5a93-4e28-b843-11f8ea17d8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:38.284184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 870/1750] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:37 2022] POST /identity/v3/users => generated 293 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:38.284184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5df8d-0615-43eb-9450-9a83c04ae857 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:38.286615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:38.296620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5df8d-0615-43eb-9450-9a83c04ae857 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:38.312920 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b75de6-c323-44e4-83c8-d9d908bd00f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:38.314079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b75de6-c323-44e4-83c8-d9d908bd00f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:38.314573 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b75de6-c323-44e4-83c8-d9d908bd00f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:38.315027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b75de6-c323-44e4-83c8-d9d908bd00f9 admin admin] PATH_INFO: `/v3/projects/197c2418a7784b37b603a483b3142165/users/1531699bcd2b490b8220b7d856e5ad22/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:38.320827 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b75de6-c323-44e4-83c8-d9d908bd00f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=197c2418a7784b37b603a483b3142165, user_id=1531699bcd2b490b8220b7d856e5ad22, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:38.325713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b75de6-c323-44e4-83c8-d9d908bd00f9 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:38.348894 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 871/1751] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:38 2022] PUT /identity/v3/projects/197c2418a7784b37b603a483b3142165/users/1531699bcd2b490b8220b7d856e5ad22/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:38.357780 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b75de6-c323-44e4-83c8-d9d908bd00f9 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:38.393560 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 881/1752] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:38.395259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df86e3-dd1e-41ac-a3c6-0f828078c112 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:38.395823 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df86e3-dd1e-41ac-a3c6-0f828078c112 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:38.396749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df86e3-dd1e-41ac-a3c6-0f828078c112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:38.496500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-03df86e3-dd1e-41ac-a3c6-0f828078c112 None None] MFA Rules not processed for user `1531699bcd2b490b8220b7d856e5ad22`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:38.503068 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-03df86e3-dd1e-41ac-a3c6-0f828078c112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:38.559101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b75de6-c323-44e4-83c8-d9d908bd00f9 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:38.566175 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72953a42-c966-4ddb-ace3-3c2b92a308a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:38.567587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72953a42-c966-4ddb-ace3-3c2b92a308a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:38.567939 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72953a42-c966-4ddb-ace3-3c2b92a308a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:38.568281 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72953a42-c966-4ddb-ace3-3c2b92a308a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:38.569399 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72953a42-c966-4ddb-ace3-3c2b92a308a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:38.573745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72953a42-c966-4ddb-ace3-3c2b92a308a3 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:38.594953 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 872/1753] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:38.596222 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72953a42-c966-4ddb-ace3-3c2b92a308a3 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:38.600514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-72953a42-c966-4ddb-ace3-3c2b92a308a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:38.627683 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72953a42-c966-4ddb-ace3-3c2b92a308a3 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:38.631253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 882/1754] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:38.632442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df86e3-dd1e-41ac-a3c6-0f828078c112 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:38.636831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fc6da-2d61-4915-a56c-6bf6c8ac74c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:38.637502 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fc6da-2d61-4915-a56c-6bf6c8ac74c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:38.637930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fc6da-2d61-4915-a56c-6bf6c8ac74c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:38.638081 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fc6da-2d61-4915-a56c-6bf6c8ac74c8 admin admin] PATH_INFO: `/v3/users/c9096c0061d94e849ea4bd31fb55d13b` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:38.639427 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fc6da-2d61-4915-a56c-6bf6c8ac74c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9096c0061d94e849ea4bd31fb55d13b)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:38.641558 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fc6da-2d61-4915-a56c-6bf6c8ac74c8 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:38.645603 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df86e3-dd1e-41ac-a3c6-0f828078c112 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:38.651695 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ed755-f573-4cc7-acd4-a7e901778d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:38.653742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ed755-f573-4cc7-acd4-a7e901778d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:38.653742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ed755-f573-4cc7-acd4-a7e901778d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:38.653742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ed755-f573-4cc7-acd4-a7e901778d38 admin admin] PATH_INFO: `/v3/projects/e01bbf9a029a48c8813b22e3bd596a6c/users/1e96f1f23f134c02a0907a945a8e7d44/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:38.673976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ed755-f573-4cc7-acd4-a7e901778d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e01bbf9a029a48c8813b22e3bd596a6c, user_id=1e96f1f23f134c02a0907a945a8e7d44, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:38.674505 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:38.678124 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ed755-f573-4cc7-acd4-a7e901778d38 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:38.771567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 883/1755] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:38 2022] PUT /identity/v3/projects/e01bbf9a029a48c8813b22e3bd596a6c/users/1e96f1f23f134c02a0907a945a8e7d44/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:38.771567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ed755-f573-4cc7-acd4-a7e901778d38 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:38.773085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-fc0ed755-f573-4cc7-acd4-a7e901778d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:38.875601 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b12fc6da-2d61-4915-a56c-6bf6c8ac74c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9096c0061d94e849ea4bd31fb55d13b'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:38.882352 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b12fc6da-2d61-4915-a56c-6bf6c8ac74c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9096c0061d94e849ea4bd31fb55d13b'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:38.917766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ed755-f573-4cc7-acd4-a7e901778d38 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:38.933376 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0772da-a486-4a46-b0a4-be5feb769400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:38.940939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0772da-a486-4a46-b0a4-be5feb769400 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:38.947794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0772da-a486-4a46-b0a4-be5feb769400 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:38.948115 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0772da-a486-4a46-b0a4-be5feb769400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:38.956268 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9b0772da-a486-4a46-b0a4-be5feb769400 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:39.022511 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b12fc6da-2d61-4915-a56c-6bf6c8ac74c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9096c0061d94e849ea4bd31fb55d13b'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:39.039402 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b12fc6da-2d61-4915-a56c-6bf6c8ac74c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9096c0061d94e849ea4bd31fb55d13b'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:39.075814 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b12fc6da-2d61-4915-a56c-6bf6c8ac74c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9096c0061d94e849ea4bd31fb55d13b'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:39.087876 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 873/1756] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:02:38 2022] DELETE /identity/v3/users/c9096c0061d94e849ea4bd31fb55d13b => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:39.091932 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fc6da-2d61-4915-a56c-6bf6c8ac74c8 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:39.097093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b12fc6da-2d61-4915-a56c-6bf6c8ac74c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:39.136135 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0772da-a486-4a46-b0a4-be5feb769400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:39.138164 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0772da-a486-4a46-b0a4-be5feb769400 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:39.150148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 884/1757] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:39.150919 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0772da-a486-4a46-b0a4-be5feb769400 service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:39.152968 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9b0772da-a486-4a46-b0a4-be5feb769400 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:39.305864 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fc6da-2d61-4915-a56c-6bf6c8ac74c8 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:39.318541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a022fa-3d75-48cb-be13-045d9e3ede68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:39.319492 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a022fa-3d75-48cb-be13-045d9e3ede68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:39.319909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a022fa-3d75-48cb-be13-045d9e3ede68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:39.320426 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a022fa-3d75-48cb-be13-045d9e3ede68 admin admin] PATH_INFO: `/v3/projects/dee22a9595b742fcb867aee7f83dac5f` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:39.322229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a022fa-3d75-48cb-be13-045d9e3ede68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee22a9595b742fcb867aee7f83dac5f)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:39.327776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a022fa-3d75-48cb-be13-045d9e3ede68 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:39.333135 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0772da-a486-4a46-b0a4-be5feb769400 service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:39.341175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bc2de-2e1d-4ad5-8383-2cd1eb1765f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:39.341885 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bc2de-2e1d-4ad5-8383-2cd1eb1765f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:39.342170 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bc2de-2e1d-4ad5-8383-2cd1eb1765f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:39.342448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bc2de-2e1d-4ad5-8383-2cd1eb1765f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:39.346375 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bc2de-2e1d-4ad5-8383-2cd1eb1765f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:39.346375 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bc2de-2e1d-4ad5-8383-2cd1eb1765f7 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:39.360787 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 885/1758] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:39.360787 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de18ae-9f67-49d7-913b-26a473952b54 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:39.360787 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de18ae-9f67-49d7-913b-26a473952b54 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:39.360787 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de18ae-9f67-49d7-913b-26a473952b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:39.400574 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-a6de18ae-9f67-49d7-913b-26a473952b54 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:39.402029 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a6de18ae-9f67-49d7-913b-26a473952b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:39.413812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 886/1759] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:39.415111 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de18ae-9f67-49d7-913b-26a473952b54 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:39.432820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de18ae-9f67-49d7-913b-26a473952b54 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:39.441212 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec71b4-e248-441c-a9ae-f0cc2da6e1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:39.441916 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec71b4-e248-441c-a9ae-f0cc2da6e1a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:39.442205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec71b4-e248-441c-a9ae-f0cc2da6e1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:39.442483 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec71b4-e248-441c-a9ae-f0cc2da6e1a7 admin admin] PATH_INFO: `/v3/projects/e01bbf9a029a48c8813b22e3bd596a6c/users/1e96f1f23f134c02a0907a945a8e7d44/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:39.445042 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec71b4-e248-441c-a9ae-f0cc2da6e1a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e01bbf9a029a48c8813b22e3bd596a6c, user_id=1e96f1f23f134c02a0907a945a8e7d44, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:39.448377 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec71b4-e248-441c-a9ae-f0cc2da6e1a7 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:39.464748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 887/1760] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:39 2022] PUT /identity/v3/projects/e01bbf9a029a48c8813b22e3bd596a6c/users/1e96f1f23f134c02a0907a945a8e7d44/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:39.465796 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec71b4-e248-441c-a9ae-f0cc2da6e1a7 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:39.477960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a6ec71b4-e248-441c-a9ae-f0cc2da6e1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:39.540331 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f3a022fa-3d75-48cb-be13-045d9e3ede68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee22a9595b742fcb867aee7f83dac5f', 'request_id': 'req-f3a022fa-3d75-48cb-be13-045d9e3ede68'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:39.551178 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f3a022fa-3d75-48cb-be13-045d9e3ede68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee22a9595b742fcb867aee7f83dac5f', 'request_id': 'req-f3a022fa-3d75-48cb-be13-045d9e3ede68'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:39.558596 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f3a022fa-3d75-48cb-be13-045d9e3ede68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee22a9595b742fcb867aee7f83dac5f', 'request_id': 'req-f3a022fa-3d75-48cb-be13-045d9e3ede68'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:39.580128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec71b4-e248-441c-a9ae-f0cc2da6e1a7 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:39.712883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f3a022fa-3d75-48cb-be13-045d9e3ede68 admin admin] The token cache is being invalidate because project dee22a9595b742fcb867aee7f83dac5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:02:39.716408 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f3a022fa-3d75-48cb-be13-045d9e3ede68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:39.718406 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da364a-bf08-4e0f-9584-4d7a7a15a4c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:39.719080 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da364a-bf08-4e0f-9584-4d7a7a15a4c7 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:39.719551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da364a-bf08-4e0f-9584-4d7a7a15a4c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:39.719849 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da364a-bf08-4e0f-9584-4d7a7a15a4c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:39.721173 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f3a022fa-3d75-48cb-be13-045d9e3ede68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:39.725348 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-71da364a-bf08-4e0f-9584-4d7a7a15a4c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:39.729408 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 874/1761] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:02:39 2022] DELETE /identity/v3/projects/dee22a9595b742fcb867aee7f83dac5f => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:39.737617 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9ac5a-bb13-4e9e-b65e-b2c4c23551c5 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:39.738382 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9ac5a-bb13-4e9e-b65e-b2c4c23551c5 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:39.740873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9ac5a-bb13-4e9e-b65e-b2c4c23551c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:39.838510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-a1c9ac5a-bb13-4e9e-b65e-b2c4c23551c5 None None] MFA Rules not processed for user `1e96f1f23f134c02a0907a945a8e7d44`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:39.841279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a1c9ac5a-bb13-4e9e-b65e-b2c4c23551c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:39.906762 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da364a-bf08-4e0f-9584-4d7a7a15a4c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:39.909789 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da364a-bf08-4e0f-9584-4d7a7a15a4c7 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:39.928779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 888/1762] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:39.930483 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2637b-93d7-44cf-9db6-167e79d26859 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:39.930856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2637b-93d7-44cf-9db6-167e79d26859 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:39.931205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2637b-93d7-44cf-9db6-167e79d26859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:39.954500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-aec2637b-93d7-44cf-9db6-167e79d26859 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:39.957043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-aec2637b-93d7-44cf-9db6-167e79d26859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:39.972181 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 889/1763] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:39.973704 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da076a-b185-4b6a-acb1-dbcd9f1cc50d None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:39.974041 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da076a-b185-4b6a-acb1-dbcd9f1cc50d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:39.974322 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da076a-b185-4b6a-acb1-dbcd9f1cc50d None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:39.975897 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 890/1764] 10.222.0.64 () {54 vars in 912 bytes} [Thu Jul 28 04:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:02:39.978999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 875/1765] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:39.984325 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77964374-6950-4056-820c-00a42f502005 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:39.984876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77964374-6950-4056-820c-00a42f502005 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:39.985144 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77964374-6950-4056-820c-00a42f502005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:39.988961 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39754a7d-198e-4e93-9b39-8bb27ce86b60 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:39.988961 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39754a7d-198e-4e93-9b39-8bb27ce86b60 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:39.988961 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39754a7d-198e-4e93-9b39-8bb27ce86b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:40.028944 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-77964374-6950-4056-820c-00a42f502005 None None] MFA Rules not processed for user `03742c23cae849d9bf4ce0b432edd1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:40.029701 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-39754a7d-198e-4e93-9b39-8bb27ce86b60 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:40.031071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-39754a7d-198e-4e93-9b39-8bb27ce86b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:40.033771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-77964374-6950-4056-820c-00a42f502005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:40.063717 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 876/1767] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:40.069658 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 891/1767] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 28 04:02:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:40.069804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39754a7d-198e-4e93-9b39-8bb27ce86b60 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:40.078194 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39754a7d-198e-4e93-9b39-8bb27ce86b60 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:40.090106 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df50637-887a-4aa1-9bfc-e35e6013858c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:40.091189 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df50637-887a-4aa1-9bfc-e35e6013858c admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:40.091610 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df50637-887a-4aa1-9bfc-e35e6013858c admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:40.092623 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df50637-887a-4aa1-9bfc-e35e6013858c admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:40.094931 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77964374-6950-4056-820c-00a42f502005 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:40.098562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-77964374-6950-4056-820c-00a42f502005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:40.104234 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df50637-887a-4aa1-9bfc-e35e6013858c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:02:40.104761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df50637-887a-4aa1-9bfc-e35e6013858c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:40.106649 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df50637-887a-4aa1-9bfc-e35e6013858c admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:40.120923 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77964374-6950-4056-820c-00a42f502005 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:40.129709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691f57b-25a5-4ae4-ab67-4c43555fb7d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:40.130461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691f57b-25a5-4ae4-ab67-4c43555fb7d5 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:40.130847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691f57b-25a5-4ae4-ab67-4c43555fb7d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:40.131164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 877/1768] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:02:40.131287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691f57b-25a5-4ae4-ab67-4c43555fb7d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:40.136192 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df50637-887a-4aa1-9bfc-e35e6013858c admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:40.143501 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691f57b-25a5-4ae4-ab67-4c43555fb7d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:40.144961 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691f57b-25a5-4ae4-ab67-4c43555fb7d5 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:40.154089 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df50637-887a-4aa1-9bfc-e35e6013858c admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:40.163041 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43349af3-398f-42fd-860a-90a080c76966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:40.163597 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 892/1769] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:40.164281 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691f57b-25a5-4ae4-ab67-4c43555fb7d5 service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:40.165816 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-0691f57b-25a5-4ae4-ab67-4c43555fb7d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:40.168222 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43349af3-398f-42fd-860a-90a080c76966 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:40.168784 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43349af3-398f-42fd-860a-90a080c76966 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:40.169267 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43349af3-398f-42fd-860a-90a080c76966 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:40.170364 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43349af3-398f-42fd-860a-90a080c76966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:40.175035 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43349af3-398f-42fd-860a-90a080c76966 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:40.250293 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691f57b-25a5-4ae4-ab67-4c43555fb7d5 service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:40.263488 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795e0ff-40ce-4ef1-9d44-f6562b97188b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:40.264533 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795e0ff-40ce-4ef1-9d44-f6562b97188b service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:40.264924 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795e0ff-40ce-4ef1-9d44-f6562b97188b service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:40.265307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795e0ff-40ce-4ef1-9d44-f6562b97188b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:40.285053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795e0ff-40ce-4ef1-9d44-f6562b97188b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:40.286837 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795e0ff-40ce-4ef1-9d44-f6562b97188b service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:40.302132 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 878/1770] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:40 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:02:40.303564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d671d-cbdb-4611-b165-24fa8d4ac5eb None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:40.303839 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d671d-cbdb-4611-b165-24fa8d4ac5eb None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:40.304119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d671d-cbdb-4611-b165-24fa8d4ac5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:40.336777 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 893/1771] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:40.347583 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795e0ff-40ce-4ef1-9d44-f6562b97188b service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:40.365831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-111d671d-cbdb-4611-b165-24fa8d4ac5eb None None] MFA Rules not processed for user `239971f05a0b4ba4874c167c26927c98`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:40.367477 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-111d671d-cbdb-4611-b165-24fa8d4ac5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:40.401987 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795e0ff-40ce-4ef1-9d44-f6562b97188b service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:40.461708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:40.530929 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 879/1772] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:40.634524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432cbed-9fc0-434e-ac44-14666a51d239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:40.635118 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432cbed-9fc0-434e-ac44-14666a51d239 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:40.635460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432cbed-9fc0-434e-ac44-14666a51d239 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:40.635746 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432cbed-9fc0-434e-ac44-14666a51d239 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:40.638691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432cbed-9fc0-434e-ac44-14666a51d239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:40.643909 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432cbed-9fc0-434e-ac44-14666a51d239 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:40.704575 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d671d-cbdb-4611-b165-24fa8d4ac5eb None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:40.706287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-111d671d-cbdb-4611-b165-24fa8d4ac5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:40.799643 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d671d-cbdb-4611-b165-24fa8d4ac5eb None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:40.803453 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd55fb-2bae-4c56-9c83-20dfc6f5284f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:40.804197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd55fb-2bae-4c56-9c83-20dfc6f5284f service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:40.805104 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd55fb-2bae-4c56-9c83-20dfc6f5284f service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:40.805307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd55fb-2bae-4c56-9c83-20dfc6f5284f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:40.809727 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-73bd55fb-2bae-4c56-9c83-20dfc6f5284f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:40.866290 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 894/1773] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:40 2022] POST /identity/v3/users => generated 286 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:40.867515 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432cbed-9fc0-434e-ac44-14666a51d239 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:40.897329 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:40.912719 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432cbed-9fc0-434e-ac44-14666a51d239 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:40.926175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909caba8-5d3a-4528-b22e-82fc0bac98f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:40.927705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909caba8-5d3a-4528-b22e-82fc0bac98f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:40.928737 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909caba8-5d3a-4528-b22e-82fc0bac98f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:40.929100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909caba8-5d3a-4528-b22e-82fc0bac98f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:40.930588 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909caba8-5d3a-4528-b22e-82fc0bac98f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:40.935599 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909caba8-5d3a-4528-b22e-82fc0bac98f2 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:40.974174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd55fb-2bae-4c56-9c83-20dfc6f5284f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:40.976250 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd55fb-2bae-4c56-9c83-20dfc6f5284f service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:41.008391 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 880/1774] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:41.011021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd55fb-2bae-4c56-9c83-20dfc6f5284f service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:41.012486 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-73bd55fb-2bae-4c56-9c83-20dfc6f5284f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:41.016729 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 895/1775] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:41.021590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909caba8-5d3a-4528-b22e-82fc0bac98f2 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:41.060499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd55fb-2bae-4c56-9c83-20dfc6f5284f service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:41.068329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909caba8-5d3a-4528-b22e-82fc0bac98f2 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:41.073670 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f55243-063e-4cbd-ac79-ac71f3d99927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:41.075439 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f55243-063e-4cbd-ac79-ac71f3d99927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:41.076078 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f55243-063e-4cbd-ac79-ac71f3d99927 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:41.078961 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f55243-063e-4cbd-ac79-ac71f3d99927 admin admin] PATH_INFO: `/v3/projects/a4b5c48224624f3798fffaa63ccbe97e` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:41.081745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f55243-063e-4cbd-ac79-ac71f3d99927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b5c48224624f3798fffaa63ccbe97e)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:41.089637 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f55243-063e-4cbd-ac79-ac71f3d99927 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:41.093408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205569f-0e0d-4d40-90f6-a38cc090366e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:41.094410 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205569f-0e0d-4d40-90f6-a38cc090366e admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:41.099106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205569f-0e0d-4d40-90f6-a38cc090366e admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:41.099106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205569f-0e0d-4d40-90f6-a38cc090366e admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:41.099106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205569f-0e0d-4d40-90f6-a38cc090366e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:41.099866 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205569f-0e0d-4d40-90f6-a38cc090366e admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:41.160189 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 896/1776] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:41.166986 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205569f-0e0d-4d40-90f6-a38cc090366e admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:41.211297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205569f-0e0d-4d40-90f6-a38cc090366e admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:41.232465 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b252d6-ff1b-45b2-aa8b-a425e4db59db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:41.233174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b252d6-ff1b-45b2-aa8b-a425e4db59db admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:41.234774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b252d6-ff1b-45b2-aa8b-a425e4db59db admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:41.235089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b252d6-ff1b-45b2-aa8b-a425e4db59db admin admin] PATH_INFO: `/v3/projects/3eaf7251d0ec4287bbd2357a59472c04/users/2f06af05b68341ceaeae955d851da131/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:41.270329 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b252d6-ff1b-45b2-aa8b-a425e4db59db admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eaf7251d0ec4287bbd2357a59472c04, user_id=2f06af05b68341ceaeae955d851da131, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:41.273628 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b252d6-ff1b-45b2-aa8b-a425e4db59db admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:41.398578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 897/1777] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:41 2022] PUT /identity/v3/projects/3eaf7251d0ec4287bbd2357a59472c04/users/2f06af05b68341ceaeae955d851da131/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:41.410758 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c936c-29bb-4341-9827-0f025e2a996c None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:41.411067 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c936c-29bb-4341-9827-0f025e2a996c None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:41.412008 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c936c-29bb-4341-9827-0f025e2a996c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:41.413052 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b6f55243-063e-4cbd-ac79-ac71f3d99927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b5c48224624f3798fffaa63ccbe97e', 'request_id': 'req-b6f55243-063e-4cbd-ac79-ac71f3d99927'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:41.427094 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b6f55243-063e-4cbd-ac79-ac71f3d99927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b5c48224624f3798fffaa63ccbe97e', 'request_id': 'req-b6f55243-063e-4cbd-ac79-ac71f3d99927'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:41.441788 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b6f55243-063e-4cbd-ac79-ac71f3d99927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b5c48224624f3798fffaa63ccbe97e', 'request_id': 'req-b6f55243-063e-4cbd-ac79-ac71f3d99927'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:41.462766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-c62c936c-29bb-4341-9827-0f025e2a996c None None] MFA Rules not processed for user `2f06af05b68341ceaeae955d851da131`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:41.467368 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c62c936c-29bb-4341-9827-0f025e2a996c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:41.558012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b6f55243-063e-4cbd-ac79-ac71f3d99927 admin admin] The token cache is being invalidate because project a4b5c48224624f3798fffaa63ccbe97e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:02:41.558469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b6f55243-063e-4cbd-ac79-ac71f3d99927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:41.559369 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b6f55243-063e-4cbd-ac79-ac71f3d99927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:41.562264 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 881/1778] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:02:41 2022] DELETE /identity/v3/projects/a4b5c48224624f3798fffaa63ccbe97e => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:41.566994 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f55243-063e-4cbd-ac79-ac71f3d99927 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:41.568902 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b6f55243-063e-4cbd-ac79-ac71f3d99927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:41.640169 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 898/1779] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:02:41.644851 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c936c-29bb-4341-9827-0f025e2a996c None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:41.646527 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c62c936c-29bb-4341-9827-0f025e2a996c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:41.675763 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f55243-063e-4cbd-ac79-ac71f3d99927 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:41.691813 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd9262-6686-4aea-a0ca-1736d817cede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:41.692775 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd9262-6686-4aea-a0ca-1736d817cede admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:41.693184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd9262-6686-4aea-a0ca-1736d817cede admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:41.693589 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd9262-6686-4aea-a0ca-1736d817cede admin admin] PATH_INFO: `/v3/users/28728cec49c7474ca774c38cc8080dd6` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:41.695095 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd9262-6686-4aea-a0ca-1736d817cede admin admin] RBAC: Authorizing `identity:delete_user(user_id=28728cec49c7474ca774c38cc8080dd6)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:41.697318 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd9262-6686-4aea-a0ca-1736d817cede admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:41.808522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c936c-29bb-4341-9827-0f025e2a996c None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:41.819653 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684e29f-4330-4dea-8397-99fc11ba36ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:41.821297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684e29f-4330-4dea-8397-99fc11ba36ac admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:41.821297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684e29f-4330-4dea-8397-99fc11ba36ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:41.821297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684e29f-4330-4dea-8397-99fc11ba36ac admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:41.822195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684e29f-4330-4dea-8397-99fc11ba36ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:41.824901 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9684e29f-4330-4dea-8397-99fc11ba36ac admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:41.908126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:41.969404 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 899/1780] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:41 2022] POST /identity/v3/projects => generated 373 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:02:41.974254 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684e29f-4330-4dea-8397-99fc11ba36ac admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:42.064918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684e29f-4330-4dea-8397-99fc11ba36ac admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:42.075996 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418c133-0b49-4bb2-ae02-3e8457f9a6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:42.077148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418c133-0b49-4bb2-ae02-3e8457f9a6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:42.078185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418c133-0b49-4bb2-ae02-3e8457f9a6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:42.079223 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418c133-0b49-4bb2-ae02-3e8457f9a6c3 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:42.082013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418c133-0b49-4bb2-ae02-3e8457f9a6c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:42.085335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-dabd9262-6686-4aea-a0ca-1736d817cede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28728cec49c7474ca774c38cc8080dd6'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:42.087091 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-dabd9262-6686-4aea-a0ca-1736d817cede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28728cec49c7474ca774c38cc8080dd6'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:42.087756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418c133-0b49-4bb2-ae02-3e8457f9a6c3 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:42.233447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-dabd9262-6686-4aea-a0ca-1736d817cede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28728cec49c7474ca774c38cc8080dd6'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:42.243263 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 900/1781] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:41 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:02:42.243951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-dabd9262-6686-4aea-a0ca-1736d817cede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28728cec49c7474ca774c38cc8080dd6'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:42.250456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418c133-0b49-4bb2-ae02-3e8457f9a6c3 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:42.254445 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d418c133-0b49-4bb2-ae02-3e8457f9a6c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:42.337710 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-dabd9262-6686-4aea-a0ca-1736d817cede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28728cec49c7474ca774c38cc8080dd6'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:42.346511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418c133-0b49-4bb2-ae02-3e8457f9a6c3 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:42.369840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 882/1782] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:02:41 2022] DELETE /identity/v3/users/28728cec49c7474ca774c38cc8080dd6 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:02:42.404085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b2d33-784f-4c83-ad19-cbb80f4e5a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:42.405200 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b2d33-784f-4c83-ad19-cbb80f4e5a3b admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:42.405714 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b2d33-784f-4c83-ad19-cbb80f4e5a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:42.406205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b2d33-784f-4c83-ad19-cbb80f4e5a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:42.407534 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b2d33-784f-4c83-ad19-cbb80f4e5a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:42.410754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b2d33-784f-4c83-ad19-cbb80f4e5a3b admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:42.435467 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:42.453975 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 901/1783] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:42.459706 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd9262-6686-4aea-a0ca-1736d817cede admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:42.552562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd9262-6686-4aea-a0ca-1736d817cede admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:42.561053 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f45fb-e969-4803-8b1c-7ab88102e560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:42.562973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f45fb-e969-4803-8b1c-7ab88102e560 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:42.563255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f45fb-e969-4803-8b1c-7ab88102e560 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:42.563558 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f45fb-e969-4803-8b1c-7ab88102e560 admin admin] PATH_INFO: `/v3/projects/46d8246c46064d25905116c2ccef8f64/users/a482209decc544afb78c752f866183bc/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:42.601019 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f45fb-e969-4803-8b1c-7ab88102e560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d8246c46064d25905116c2ccef8f64, user_id=a482209decc544afb78c752f866183bc, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:42.604140 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f45fb-e969-4803-8b1c-7ab88102e560 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:42.738607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 883/1784] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:42 2022] PUT /identity/v3/projects/46d8246c46064d25905116c2ccef8f64/users/a482209decc544afb78c752f866183bc/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:42.742770 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b2d33-784f-4c83-ad19-cbb80f4e5a3b admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:42.756419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b2d33-784f-4c83-ad19-cbb80f4e5a3b admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:42.819268 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ae8c9-6fb0-4564-8cf0-8f35d10e9a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:42.819946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ae8c9-6fb0-4564-8cf0-8f35d10e9a89 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:42.820231 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ae8c9-6fb0-4564-8cf0-8f35d10e9a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:42.820509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ae8c9-6fb0-4564-8cf0-8f35d10e9a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:42.821219 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ae8c9-6fb0-4564-8cf0-8f35d10e9a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:42.822903 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ae8c9-6fb0-4564-8cf0-8f35d10e9a89 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:42.833551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 902/1785] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:42.838041 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f45fb-e969-4803-8b1c-7ab88102e560 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:42.850459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f45fb-e969-4803-8b1c-7ab88102e560 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:42.855270 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fbd88-bf03-454c-bb56-1f546e7de439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:42.856010 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fbd88-bf03-454c-bb56-1f546e7de439 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:42.856293 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fbd88-bf03-454c-bb56-1f546e7de439 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:42.856983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fbd88-bf03-454c-bb56-1f546e7de439 admin admin] PATH_INFO: `/v3/projects/46d8246c46064d25905116c2ccef8f64/users/a482209decc544afb78c752f866183bc/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:42.858848 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fbd88-bf03-454c-bb56-1f546e7de439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d8246c46064d25905116c2ccef8f64, user_id=a482209decc544afb78c752f866183bc, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:42.862329 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fbd88-bf03-454c-bb56-1f546e7de439 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:42.873746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 884/1786] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:42 2022] PUT /identity/v3/projects/46d8246c46064d25905116c2ccef8f64/users/a482209decc544afb78c752f866183bc/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:42.888409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0d4ac-fad5-4e67-8bc6-4cd781f543ef None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:42.888697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0d4ac-fad5-4e67-8bc6-4cd781f543ef None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:42.888983 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0d4ac-fad5-4e67-8bc6-4cd781f543ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:42.954818 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-4ef0d4ac-fad5-4e67-8bc6-4cd781f543ef None None] MFA Rules not processed for user `a482209decc544afb78c752f866183bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:42.956978 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-4ef0d4ac-fad5-4e67-8bc6-4cd781f543ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:43.091120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 903/1787] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:02:43.104079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fbd88-bf03-454c-bb56-1f546e7de439 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:43.107218 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c65fbd88-bf03-454c-bb56-1f546e7de439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:43.162503 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc681ac-1f62-495a-bffd-96eeb4e85450 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:43.162936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc681ac-1f62-495a-bffd-96eeb4e85450 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:43.163303 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc681ac-1f62-495a-bffd-96eeb4e85450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:43.264145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fbd88-bf03-454c-bb56-1f546e7de439 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:43.269675 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61415db4-337b-4f7c-97c8-7fd1f2f09831 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:43.270595 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61415db4-337b-4f7c-97c8-7fd1f2f09831 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:43.271026 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61415db4-337b-4f7c-97c8-7fd1f2f09831 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:43.271484 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61415db4-337b-4f7c-97c8-7fd1f2f09831 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:43.277295 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-8dc681ac-1f62-495a-bffd-96eeb4e85450 None None] MFA Rules not processed for user `420e2a81b66a470e8db624efd61fd1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:43.278959 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-8dc681ac-1f62-495a-bffd-96eeb4e85450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:43.284560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61415db4-337b-4f7c-97c8-7fd1f2f09831 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:43.287850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61415db4-337b-4f7c-97c8-7fd1f2f09831 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:43.318982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 885/1788] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:43.361738 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 904/1789] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 28 04:02:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:02:43.465039 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61415db4-337b-4f7c-97c8-7fd1f2f09831 service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:43.476161 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-61415db4-337b-4f7c-97c8-7fd1f2f09831 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:43.711352 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61415db4-337b-4f7c-97c8-7fd1f2f09831 service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:43.724533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27b2c6-12ff-41c8-867d-77702c55a93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:43.725390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27b2c6-12ff-41c8-867d-77702c55a93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:43.725738 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27b2c6-12ff-41c8-867d-77702c55a93e admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:43.726079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27b2c6-12ff-41c8-867d-77702c55a93e admin admin] PATH_INFO: `/v3/projects/103510845800404387e0333b55803b30` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:43.728798 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27b2c6-12ff-41c8-867d-77702c55a93e admin admin] RBAC: Authorizing `identity:delete_project(project_id=103510845800404387e0333b55803b30)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:43.733364 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27b2c6-12ff-41c8-867d-77702c55a93e admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:43.818936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc681ac-1f62-495a-bffd-96eeb4e85450 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:43.828714 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc681ac-1f62-495a-bffd-96eeb4e85450 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:43.833820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dcc54-4946-4bae-8de8-6c1f9791267e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:43.834647 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dcc54-4946-4bae-8de8-6c1f9791267e service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:43.834928 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dcc54-4946-4bae-8de8-6c1f9791267e service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:43.835205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dcc54-4946-4bae-8de8-6c1f9791267e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:43.838129 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f73dcc54-4946-4bae-8de8-6c1f9791267e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:43.913131 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:43.925918 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-fa27b2c6-12ff-41c8-867d-77702c55a93e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103510845800404387e0333b55803b30', 'request_id': 'req-fa27b2c6-12ff-41c8-867d-77702c55a93e'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:43.931734 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dcc54-4946-4bae-8de8-6c1f9791267e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:43.933910 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dcc54-4946-4bae-8de8-6c1f9791267e service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:43.943970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-fa27b2c6-12ff-41c8-867d-77702c55a93e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103510845800404387e0333b55803b30', 'request_id': 'req-fa27b2c6-12ff-41c8-867d-77702c55a93e'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:43.947975 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 905/1790] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:43.949462 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dcc54-4946-4bae-8de8-6c1f9791267e service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:43.950655 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f73dcc54-4946-4bae-8de8-6c1f9791267e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:43.980004 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-fa27b2c6-12ff-41c8-867d-77702c55a93e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103510845800404387e0333b55803b30', 'request_id': 'req-fa27b2c6-12ff-41c8-867d-77702c55a93e'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:44.085169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-fa27b2c6-12ff-41c8-867d-77702c55a93e admin admin] The token cache is being invalidate because project 103510845800404387e0333b55803b30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:02:44.085169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-fa27b2c6-12ff-41c8-867d-77702c55a93e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:44.085665 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-fa27b2c6-12ff-41c8-867d-77702c55a93e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:44.088541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 886/1791] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:02:43 2022] DELETE /identity/v3/projects/103510845800404387e0333b55803b30 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:02:44.091002 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dcc54-4946-4bae-8de8-6c1f9791267e service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:44.102961 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff7c42-4950-462c-9569-0a57465a44fd None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:44.103515 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff7c42-4950-462c-9569-0a57465a44fd None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:44.107699 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff7c42-4950-462c-9569-0a57465a44fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:44.155090 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-4cff7c42-4950-462c-9569-0a57465a44fd None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:44.156556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-4cff7c42-4950-462c-9569-0a57465a44fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:44.225152 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020235e4-46b7-4303-85e4-0289ac4dce28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382ff6087bf4486d8651162880825eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:44.228154 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020235e4-46b7-4303-85e4-0289ac4dce28 service swift] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:44.228732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020235e4-46b7-4303-85e4-0289ac4dce28 service swift] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:44.229896 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020235e4-46b7-4303-85e4-0289ac4dce28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:44.246681 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-020235e4-46b7-4303-85e4-0289ac4dce28 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:44.312298 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 887/1792] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:44.321073 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff01dd-015a-4d05-83fb-2b78aa741a97 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:44.321616 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff01dd-015a-4d05-83fb-2b78aa741a97 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:44.322115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff01dd-015a-4d05-83fb-2b78aa741a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:44.358168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-91ff01dd-015a-4d05-83fb-2b78aa741a97 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:44.359872 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-91ff01dd-015a-4d05-83fb-2b78aa741a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:44.377650 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 888/1793] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:44.382734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff01dd-015a-4d05-83fb-2b78aa741a97 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:44.399437 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff01dd-015a-4d05-83fb-2b78aa741a97 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:44.404177 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020235e4-46b7-4303-85e4-0289ac4dce28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:44.409661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020235e4-46b7-4303-85e4-0289ac4dce28 service swift] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:44.410553 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3cb33-e63b-4e35-9fbc-441e50fa8ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:44.411215 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3cb33-e63b-4e35-9fbc-441e50fa8ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:44.411525 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3cb33-e63b-4e35-9fbc-441e50fa8ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:44.411800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3cb33-e63b-4e35-9fbc-441e50fa8ee0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:44.412525 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3cb33-e63b-4e35-9fbc-441e50fa8ee0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:02:44.412884 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3cb33-e63b-4e35-9fbc-441e50fa8ee0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:44.414540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3cb33-e63b-4e35-9fbc-441e50fa8ee0 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:44.441940 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 889/1794] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:02:44.446070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3cb33-e63b-4e35-9fbc-441e50fa8ee0 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:44.471172 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3cb33-e63b-4e35-9fbc-441e50fa8ee0 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:44.476379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 906/1795] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 28 04:02:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 04:02:44.488337 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22e89d-e38a-475c-bd5c-4c3e9221c66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:44.490056 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22e89d-e38a-475c-bd5c-4c3e9221c66e admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:44.490412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22e89d-e38a-475c-bd5c-4c3e9221c66e admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:44.490772 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22e89d-e38a-475c-bd5c-4c3e9221c66e admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:44.491817 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22e89d-e38a-475c-bd5c-4c3e9221c66e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:44.494098 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22e89d-e38a-475c-bd5c-4c3e9221c66e admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:44.508377 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dff6e0-21b3-40ba-a7d2-dcdcd080ade0 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:44.509722 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dff6e0-21b3-40ba-a7d2-dcdcd080ade0 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:44.513588 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dff6e0-21b3-40ba-a7d2-dcdcd080ade0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:44.578196 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-34dff6e0-21b3-40ba-a7d2-dcdcd080ade0 None None] MFA Rules not processed for user `03742c23cae849d9bf4ce0b432edd1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:44.580607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-34dff6e0-21b3-40ba-a7d2-dcdcd080ade0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:44.682630 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 890/1796] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:44 2022] POST /identity/v3/projects => generated 381 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:44.684583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22e89d-e38a-475c-bd5c-4c3e9221c66e admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:44.728699 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 907/1797] 10.222.0.69 () {58 vars in 1015 bytes} [Thu Jul 28 04:02:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:44.771487 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dff6e0-21b3-40ba-a7d2-dcdcd080ade0 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:44.775703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-34dff6e0-21b3-40ba-a7d2-dcdcd080ade0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:44.797898 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dff6e0-21b3-40ba-a7d2-dcdcd080ade0 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:44.906634 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22e89d-e38a-475c-bd5c-4c3e9221c66e admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:44.917888 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cb8c2-5107-43e9-b0d3-69fdcc3dd329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:44.918799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cb8c2-5107-43e9-b0d3-69fdcc3dd329 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:44.919983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cb8c2-5107-43e9-b0d3-69fdcc3dd329 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:44.925856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cb8c2-5107-43e9-b0d3-69fdcc3dd329 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:44.925856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377cb8c2-5107-43e9-b0d3-69fdcc3dd329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:44.932939 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377cb8c2-5107-43e9-b0d3-69fdcc3dd329 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:45.070508 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5e3cf-0a03-42f3-8053-e735530ebad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:45.071255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5e3cf-0a03-42f3-8053-e735530ebad3 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:45.071603 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5e3cf-0a03-42f3-8053-e735530ebad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:45.071982 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5e3cf-0a03-42f3-8053-e735530ebad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:45.102601 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 891/1798] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:44 2022] POST /identity/v3/users => generated 291 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:45.104168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cb8c2-5107-43e9-b0d3-69fdcc3dd329 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:45.113088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5e3cf-0a03-42f3-8053-e735530ebad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:45.115812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f5e3cf-0a03-42f3-8053-e735530ebad3 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:45.147338 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cb8c2-5107-43e9-b0d3-69fdcc3dd329 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:45.156358 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:45.160419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 908/1799] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:45.169172 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b83b2-1d66-423d-aa66-deb17269828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:45.178018 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b83b2-1d66-423d-aa66-deb17269828f admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:45.178323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b83b2-1d66-423d-aa66-deb17269828f admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:45.178665 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b83b2-1d66-423d-aa66-deb17269828f admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:45.180873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b83b2-1d66-423d-aa66-deb17269828f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:45.196682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b83b2-1d66-423d-aa66-deb17269828f admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:45.219387 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 892/1800] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:45.224925 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5e3cf-0a03-42f3-8053-e735530ebad3 service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:45.243556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f5e3cf-0a03-42f3-8053-e735530ebad3 service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:45.254101 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7929f81-5b1b-4259-a080-e5c928f3c3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:45.266320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7929f81-5b1b-4259-a080-e5c928f3c3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:45.266320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7929f81-5b1b-4259-a080-e5c928f3c3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:45.266320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7929f81-5b1b-4259-a080-e5c928f3c3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:45.266320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7929f81-5b1b-4259-a080-e5c928f3c3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:45.266320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7929f81-5b1b-4259-a080-e5c928f3c3c0 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:45.294983 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 909/1801] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:45.300228 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b83b2-1d66-423d-aa66-deb17269828f admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:45.313584 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b83b2-1d66-423d-aa66-deb17269828f admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:45.325372 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f1599-386d-4168-a89b-fdb9a65e4c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:45.326175 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f1599-386d-4168-a89b-fdb9a65e4c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:45.332221 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f1599-386d-4168-a89b-fdb9a65e4c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:45.332221 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f1599-386d-4168-a89b-fdb9a65e4c69 admin admin] PATH_INFO: `/v3/projects/9bda2f2af79241cdaad42f493db93876/users/62a18929019345a3a8dfb00a33fc76e3/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:45.349245 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f1599-386d-4168-a89b-fdb9a65e4c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bda2f2af79241cdaad42f493db93876, user_id=62a18929019345a3a8dfb00a33fc76e3, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:45.352376 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f1599-386d-4168-a89b-fdb9a65e4c69 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:45.534164 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed595b78-f8b0-4a49-b5d7-e2b63aff1407 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:45.534485 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed595b78-f8b0-4a49-b5d7-e2b63aff1407 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:45.537349 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed595b78-f8b0-4a49-b5d7-e2b63aff1407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:45.549282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 893/1802] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:45 2022] PUT /identity/v3/projects/9bda2f2af79241cdaad42f493db93876/users/62a18929019345a3a8dfb00a33fc76e3/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:45.865460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-ed595b78-f8b0-4a49-b5d7-e2b63aff1407 None None] MFA Rules not processed for user `62a18929019345a3a8dfb00a33fc76e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:45.865460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ed595b78-f8b0-4a49-b5d7-e2b63aff1407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:45.865460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 910/1803] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:45.867205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f1599-386d-4168-a89b-fdb9a65e4c69 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:45.935821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f1599-386d-4168-a89b-fdb9a65e4c69 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:45.975141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f72064-4e26-49f7-94a1-f8a8531171b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:45.975141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f72064-4e26-49f7-94a1-f8a8531171b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:45.975141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f72064-4e26-49f7-94a1-f8a8531171b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:45.975141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f72064-4e26-49f7-94a1-f8a8531171b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:45.976192 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f72064-4e26-49f7-94a1-f8a8531171b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:45.976192 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f72064-4e26-49f7-94a1-f8a8531171b5 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:48.024749 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:48.061248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 894/1804] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:45 2022] POST /identity/v3/projects => generated 379 bytes in 2204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:02:48.065277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed595b78-f8b0-4a49-b5d7-e2b63aff1407 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:48.106101 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed595b78-f8b0-4a49-b5d7-e2b63aff1407 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:48.194779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e63f26-87f0-47b6-81e9-436ce105218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:48.195803 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e63f26-87f0-47b6-81e9-436ce105218c admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:48.199337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e63f26-87f0-47b6-81e9-436ce105218c admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:48.199337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e63f26-87f0-47b6-81e9-436ce105218c admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:48.199337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e63f26-87f0-47b6-81e9-436ce105218c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:48.200188 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e63f26-87f0-47b6-81e9-436ce105218c admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:48.372066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 911/1805] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:48 2022] POST /identity/v3/users => generated 296 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:48.382565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e63f26-87f0-47b6-81e9-436ce105218c admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:48.384722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f72064-4e26-49f7-94a1-f8a8531171b5 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:48.386234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-17e63f26-87f0-47b6-81e9-436ce105218c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:48.476100 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f72064-4e26-49f7-94a1-f8a8531171b5 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:48.490558 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e63f26-87f0-47b6-81e9-436ce105218c admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:48.524093 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58ddd3-8cb8-45f0-920a-3f20d6bb6e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:48.524821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb76107-1948-40c6-b62f-66b3b30eefce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:48.525178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58ddd3-8cb8-45f0-920a-3f20d6bb6e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:48.526559 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb76107-1948-40c6-b62f-66b3b30eefce admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:48.527102 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb76107-1948-40c6-b62f-66b3b30eefce admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:48.527239 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58ddd3-8cb8-45f0-920a-3f20d6bb6e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:48.530066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb76107-1948-40c6-b62f-66b3b30eefce admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:48.531233 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58ddd3-8cb8-45f0-920a-3f20d6bb6e4c admin admin] PATH_INFO: `/v3/users/271e08095d264d34b4bc8fe0cd0bbc31` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:48.534631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58ddd3-8cb8-45f0-920a-3f20d6bb6e4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=271e08095d264d34b4bc8fe0cd0bbc31)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:48.536955 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58ddd3-8cb8-45f0-920a-3f20d6bb6e4c admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:48.537494 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb76107-1948-40c6-b62f-66b3b30eefce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:48.555803 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb76107-1948-40c6-b62f-66b3b30eefce admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:48.637350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 895/1806] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:48.645860 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb76107-1948-40c6-b62f-66b3b30eefce admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:48.679479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb76107-1948-40c6-b62f-66b3b30eefce admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:48.703198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c1caa-9e01-425d-a09f-b0954bcd9876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:48.704116 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1caa-9e01-425d-a09f-b0954bcd9876 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:48.704501 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1caa-9e01-425d-a09f-b0954bcd9876 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:48.704914 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c1caa-9e01-425d-a09f-b0954bcd9876 admin admin] PATH_INFO: `/v3/projects/d8841660dd974b67bc1ccaf5f5273081/users/07fc63b6638847d8b6baa61ad3719631/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:48.731300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c1caa-9e01-425d-a09f-b0954bcd9876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8841660dd974b67bc1ccaf5f5273081, user_id=07fc63b6638847d8b6baa61ad3719631, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:48.735273 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c1caa-9e01-425d-a09f-b0954bcd9876 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:48.914743 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 896/1807] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:48 2022] PUT /identity/v3/projects/d8841660dd974b67bc1ccaf5f5273081/users/07fc63b6638847d8b6baa61ad3719631/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:48.937897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c1caa-9e01-425d-a09f-b0954bcd9876 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:48.968148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-cb58ddd3-8cb8-45f0-920a-3f20d6bb6e4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271e08095d264d34b4bc8fe0cd0bbc31'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:48.998458 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-cb58ddd3-8cb8-45f0-920a-3f20d6bb6e4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271e08095d264d34b4bc8fe0cd0bbc31'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:49.008841 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:49.140569 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c1caa-9e01-425d-a09f-b0954bcd9876 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:49.146877 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e324d-a69d-4893-8609-7956a9d9ce56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:49.148146 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e324d-a69d-4893-8609-7956a9d9ce56 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:49.155053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-cb58ddd3-8cb8-45f0-920a-3f20d6bb6e4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271e08095d264d34b4bc8fe0cd0bbc31'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:49.161936 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e324d-a69d-4893-8609-7956a9d9ce56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:49.164004 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e324d-a69d-4893-8609-7956a9d9ce56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:49.164004 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e324d-a69d-4893-8609-7956a9d9ce56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:49.166803 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e324d-a69d-4893-8609-7956a9d9ce56 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:49.190869 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 897/1808] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:49.192156 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e324d-a69d-4893-8609-7956a9d9ce56 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:49.194535 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ea1e324d-a69d-4893-8609-7956a9d9ce56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:49.216845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-cb58ddd3-8cb8-45f0-920a-3f20d6bb6e4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271e08095d264d34b4bc8fe0cd0bbc31'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:49.241284 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e324d-a69d-4893-8609-7956a9d9ce56 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:49.249023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:49.268881 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b424e3-0581-4d3f-ba9d-6287dd7ac8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:49.270624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b424e3-0581-4d3f-ba9d-6287dd7ac8c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:49.271062 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b424e3-0581-4d3f-ba9d-6287dd7ac8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:49.271619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b424e3-0581-4d3f-ba9d-6287dd7ac8c0 admin admin] PATH_INFO: `/v3/users/2f06af05b68341ceaeae955d851da131` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:49.274210 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b424e3-0581-4d3f-ba9d-6287dd7ac8c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f06af05b68341ceaeae955d851da131)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:49.276436 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b424e3-0581-4d3f-ba9d-6287dd7ac8c0 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:49.278060 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-cb58ddd3-8cb8-45f0-920a-3f20d6bb6e4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271e08095d264d34b4bc8fe0cd0bbc31'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:49.300386 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 912/1809] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:02:48 2022] DELETE /identity/v3/users/271e08095d264d34b4bc8fe0cd0bbc31 => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:49.305961 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58ddd3-8cb8-45f0-920a-3f20d6bb6e4c admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:49.311507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-cb58ddd3-8cb8-45f0-920a-3f20d6bb6e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:49.489876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58ddd3-8cb8-45f0-920a-3f20d6bb6e4c admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:49.503621 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa26ef-0801-47d5-b3fa-d6d0d833740f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:49.504762 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa26ef-0801-47d5-b3fa-d6d0d833740f admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:49.504762 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa26ef-0801-47d5-b3fa-d6d0d833740f admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:49.505299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa26ef-0801-47d5-b3fa-d6d0d833740f admin admin] PATH_INFO: `/v3/projects/d8841660dd974b67bc1ccaf5f5273081/users/07fc63b6638847d8b6baa61ad3719631/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:49.508042 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa26ef-0801-47d5-b3fa-d6d0d833740f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8841660dd974b67bc1ccaf5f5273081, user_id=07fc63b6638847d8b6baa61ad3719631, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:49.511488 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa26ef-0801-47d5-b3fa-d6d0d833740f admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:49.526350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 913/1810] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:49 2022] PUT /identity/v3/projects/d8841660dd974b67bc1ccaf5f5273081/users/07fc63b6638847d8b6baa61ad3719631/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:49.527930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca11b55-15e5-451a-b0d4-635895f2ddc7 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:49.531091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca11b55-15e5-451a-b0d4-635895f2ddc7 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:49.531091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca11b55-15e5-451a-b0d4-635895f2ddc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:49.599071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-8ca11b55-15e5-451a-b0d4-635895f2ddc7 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:49.604115 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-8ca11b55-15e5-451a-b0d4-635895f2ddc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:49.807709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c3b424e3-0581-4d3f-ba9d-6287dd7ac8c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f06af05b68341ceaeae955d851da131'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:49.811073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 914/1811] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:49.812222 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c3b424e3-0581-4d3f-ba9d-6287dd7ac8c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f06af05b68341ceaeae955d851da131'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:49.817531 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2984c11-83d3-4edc-8beb-bf28a3ad5266 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:49.817531 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2984c11-83d3-4edc-8beb-bf28a3ad5266 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:49.817531 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2984c11-83d3-4edc-8beb-bf28a3ad5266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:49.864386 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-e2984c11-83d3-4edc-8beb-bf28a3ad5266 None None] MFA Rules not processed for user `07fc63b6638847d8b6baa61ad3719631`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:49.866536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e2984c11-83d3-4edc-8beb-bf28a3ad5266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:49.936533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c3b424e3-0581-4d3f-ba9d-6287dd7ac8c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f06af05b68341ceaeae955d851da131'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:49.975299 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c3b424e3-0581-4d3f-ba9d-6287dd7ac8c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f06af05b68341ceaeae955d851da131'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:50.031105 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c3b424e3-0581-4d3f-ba9d-6287dd7ac8c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f06af05b68341ceaeae955d851da131'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:50.041245 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 898/1812] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:02:49 2022] DELETE /identity/v3/users/2f06af05b68341ceaeae955d851da131 => generated 0 bytes in 850 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:50.048794 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4dc3b-440e-403d-b4df-186932fd8f72 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:50.049940 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4dc3b-440e-403d-b4df-186932fd8f72 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:50.052230 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4dc3b-440e-403d-b4df-186932fd8f72 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:50.058615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 899/1813] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 28 04:02:50 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:02:50.067056 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4dc3b-440e-403d-b4df-186932fd8f72 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:50.067056 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a5d4dc3b-440e-403d-b4df-186932fd8f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:50.084234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 915/1814] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:50.086422 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc49e4d-9f65-4b12-9cc1-3ebfd4bd0e2e None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:50.086718 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc49e4d-9f65-4b12-9cc1-3ebfd4bd0e2e None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:50.105952 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc49e4d-9f65-4b12-9cc1-3ebfd4bd0e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:50.146010 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-ebc49e4d-9f65-4b12-9cc1-3ebfd4bd0e2e None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:50.146010 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ebc49e4d-9f65-4b12-9cc1-3ebfd4bd0e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:50.230671 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 916/1815] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:50.230671 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc49e4d-9f65-4b12-9cc1-3ebfd4bd0e2e None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:50.231444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ebc49e4d-9f65-4b12-9cc1-3ebfd4bd0e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:50.305812 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4dc3b-440e-403d-b4df-186932fd8f72 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:50.322903 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cacbb-a889-49a0-8bdb-c7d083bdfeb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:50.322903 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cacbb-a889-49a0-8bdb-c7d083bdfeb9 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:50.327815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cacbb-a889-49a0-8bdb-c7d083bdfeb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:50.332101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cacbb-a889-49a0-8bdb-c7d083bdfeb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:50.341173 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-098cacbb-a889-49a0-8bdb-c7d083bdfeb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:50.359885 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc49e4d-9f65-4b12-9cc1-3ebfd4bd0e2e None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:50.365043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2694b-0070-40f0-af96-6d5b0a5b04c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:50.365934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2694b-0070-40f0-af96-6d5b0a5b04c7 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:50.366234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2694b-0070-40f0-af96-6d5b0a5b04c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:50.366579 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2694b-0070-40f0-af96-6d5b0a5b04c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:50.398356 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cacbb-a889-49a0-8bdb-c7d083bdfeb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:50.411675 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cacbb-a889-49a0-8bdb-c7d083bdfeb9 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:50.444667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 900/1816] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:50.450793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c69ee-2ed9-4d06-a82c-12e3dbbbd078 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:50.458492 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c69ee-2ed9-4d06-a82c-12e3dbbbd078 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:50.459050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c69ee-2ed9-4d06-a82c-12e3dbbbd078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:50.467432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2694b-0070-40f0-af96-6d5b0a5b04c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:50.472002 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2694b-0070-40f0-af96-6d5b0a5b04c7 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:50.485630 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 917/1817] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:50.487021 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2694b-0070-40f0-af96-6d5b0a5b04c7 service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:50.489174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c5b2694b-0070-40f0-af96-6d5b0a5b04c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:50.511635 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2694b-0070-40f0-af96-6d5b0a5b04c7 service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:50.519608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077d3ba-337c-40af-86f0-02d40c145f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:50.520731 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077d3ba-337c-40af-86f0-02d40c145f11 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:50.522811 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077d3ba-337c-40af-86f0-02d40c145f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:50.523946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077d3ba-337c-40af-86f0-02d40c145f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:50.552859 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077d3ba-337c-40af-86f0-02d40c145f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:50.556856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077d3ba-337c-40af-86f0-02d40c145f11 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:50.567709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:50.569603 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-0c0c69ee-2ed9-4d06-a82c-12e3dbbbd078 None None] MFA Rules not processed for user `5133abf4c32a45b0b2188f71496c572b`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:50.570893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0c0c69ee-2ed9-4d06-a82c-12e3dbbbd078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:50.592311 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 918/1818] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:50.631676 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:50.847386 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 901/1819] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 28 04:02:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:51.060775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077d3ba-337c-40af-86f0-02d40c145f11 service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:51.063279 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-4077d3ba-337c-40af-86f0-02d40c145f11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:51.114789 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077d3ba-337c-40af-86f0-02d40c145f11 service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:51.130523 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af7c64-6b9b-4583-83fc-5db321dc9b17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:51.132436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af7c64-6b9b-4583-83fc-5db321dc9b17 service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:51.132941 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af7c64-6b9b-4583-83fc-5db321dc9b17 service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:51.133705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af7c64-6b9b-4583-83fc-5db321dc9b17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:51.183783 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af7c64-6b9b-4583-83fc-5db321dc9b17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:51.187229 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64af7c64-6b9b-4583-83fc-5db321dc9b17 service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:51.222099 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 919/1820] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:51.533285 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c69ee-2ed9-4d06-a82c-12e3dbbbd078 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:51.536077 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0c0c69ee-2ed9-4d06-a82c-12e3dbbbd078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:51.577683 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c69ee-2ed9-4d06-a82c-12e3dbbbd078 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:51.582997 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f98414-fcec-4230-ac4e-e5dfabf849df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:51.584247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f98414-fcec-4230-ac4e-e5dfabf849df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:51.584951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f98414-fcec-4230-ac4e-e5dfabf849df admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:51.585436 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f98414-fcec-4230-ac4e-e5dfabf849df admin admin] PATH_INFO: `/v3/projects/3eaf7251d0ec4287bbd2357a59472c04` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:51.587078 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f98414-fcec-4230-ac4e-e5dfabf849df admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eaf7251d0ec4287bbd2357a59472c04)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:51.589658 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f98414-fcec-4230-ac4e-e5dfabf849df admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:51.787574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b1f98414-fcec-4230-ac4e-e5dfabf849df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eaf7251d0ec4287bbd2357a59472c04', 'request_id': 'req-b1f98414-fcec-4230-ac4e-e5dfabf849df'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:51.821037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b1f98414-fcec-4230-ac4e-e5dfabf849df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eaf7251d0ec4287bbd2357a59472c04', 'request_id': 'req-b1f98414-fcec-4230-ac4e-e5dfabf849df'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:51.838045 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b1f98414-fcec-4230-ac4e-e5dfabf849df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eaf7251d0ec4287bbd2357a59472c04', 'request_id': 'req-b1f98414-fcec-4230-ac4e-e5dfabf849df'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:51.975153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:52.061350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b1f98414-fcec-4230-ac4e-e5dfabf849df admin admin] The token cache is being invalidate because project 3eaf7251d0ec4287bbd2357a59472c04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:02:52.062220 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b1f98414-fcec-4230-ac4e-e5dfabf849df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:52.064126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b1f98414-fcec-4230-ac4e-e5dfabf849df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:52.071304 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 902/1821] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:02:51 2022] DELETE /identity/v3/projects/3eaf7251d0ec4287bbd2357a59472c04 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:52.078810 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af7c64-6b9b-4583-83fc-5db321dc9b17 service nova] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:52.090504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f98414-fcec-4230-ac4e-e5dfabf849df admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:52.095923 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b1f98414-fcec-4230-ac4e-e5dfabf849df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:52.102159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af7c64-6b9b-4583-83fc-5db321dc9b17 service nova] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:52.284704 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f01d9-0943-4f50-bdd0-8e791c54b07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:52.285398 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f01d9-0943-4f50-bdd0-8e791c54b07f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:52.285809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f01d9-0943-4f50-bdd0-8e791c54b07f admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:52.286294 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f01d9-0943-4f50-bdd0-8e791c54b07f admin admin] PATH_INFO: `/v3/users/a482209decc544afb78c752f866183bc` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:52.288501 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f01d9-0943-4f50-bdd0-8e791c54b07f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a482209decc544afb78c752f866183bc)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:52.292302 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f01d9-0943-4f50-bdd0-8e791c54b07f admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:52.319268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f98414-fcec-4230-ac4e-e5dfabf849df admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:52.325423 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc08ea-5a00-45df-96ba-ccb0471a5cc1 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fc63b6638847d8b6baa61ad3719631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8841660dd974b67bc1ccaf5f5273081', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:52.326082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc08ea-5a00-45df-96ba-ccb0471a5cc1 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:52.326368 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc08ea-5a00-45df-96ba-ccb0471a5cc1 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:52.326650 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc08ea-5a00-45df-96ba-ccb0471a5cc1 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:52.327659 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc08ea-5a00-45df-96ba-ccb0471a5cc1 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:02:52.327766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc08ea-5a00-45df-96ba-ccb0471a5cc1 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:52.330427 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc08ea-5a00-45df-96ba-ccb0471a5cc1 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:52.368080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 903/1822] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:02:52.377349 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc08ea-5a00-45df-96ba-ccb0471a5cc1 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:52.408724 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc08ea-5a00-45df-96ba-ccb0471a5cc1 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:52.429599 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31734b25-d2b2-433d-996a-61e35fa513fd tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fc63b6638847d8b6baa61ad3719631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8841660dd974b67bc1ccaf5f5273081', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:52.430723 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31734b25-d2b2-433d-996a-61e35fa513fd tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:52.433521 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31734b25-d2b2-433d-996a-61e35fa513fd tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:52.434137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31734b25-d2b2-433d-996a-61e35fa513fd tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:52.435118 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31734b25-d2b2-433d-996a-61e35fa513fd tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:52.447027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31734b25-d2b2-433d-996a-61e35fa513fd tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:52.531038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:52.571892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 904/1823] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:52 2022] POST /identity/v3/projects => generated 353 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:02:52.573041 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31734b25-d2b2-433d-996a-61e35fa513fd tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:52.607299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4e8f01d9-0943-4f50-bdd0-8e791c54b07f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a482209decc544afb78c752f866183bc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:52.610122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4e8f01d9-0943-4f50-bdd0-8e791c54b07f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a482209decc544afb78c752f866183bc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:52.758614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4e8f01d9-0943-4f50-bdd0-8e791c54b07f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a482209decc544afb78c752f866183bc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:52.795949 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4e8f01d9-0943-4f50-bdd0-8e791c54b07f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a482209decc544afb78c752f866183bc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:52.804803 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31734b25-d2b2-433d-996a-61e35fa513fd tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:52.816562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d0f86-f45e-4db3-9bc6-3c6a27e861e4 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fc63b6638847d8b6baa61ad3719631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8841660dd974b67bc1ccaf5f5273081', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:52.818478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d0f86-f45e-4db3-9bc6-3c6a27e861e4 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:52.818838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d0f86-f45e-4db3-9bc6-3c6a27e861e4 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:52.819451 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d0f86-f45e-4db3-9bc6-3c6a27e861e4 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:52.823059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d0f86-f45e-4db3-9bc6-3c6a27e861e4 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:02:52.823190 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4e8f01d9-0943-4f50-bdd0-8e791c54b07f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a482209decc544afb78c752f866183bc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:52.823283 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d0f86-f45e-4db3-9bc6-3c6a27e861e4 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:52.823283 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d0f86-f45e-4db3-9bc6-3c6a27e861e4 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:52.843030 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 905/1824] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:02:52.856021 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 920/1825] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:02:52 2022] DELETE /identity/v3/users/a482209decc544afb78c752f866183bc => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:52.880478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d0f86-f45e-4db3-9bc6-3c6a27e861e4 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:52.893594 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-209d0f86-f45e-4db3-9bc6-3c6a27e861e4 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:53.114085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f01d9-0943-4f50-bdd0-8e791c54b07f admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:53.115734 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-4e8f01d9-0943-4f50-bdd0-8e791c54b07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:53.179993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d0f86-f45e-4db3-9bc6-3c6a27e861e4 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:53.276036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f01d9-0943-4f50-bdd0-8e791c54b07f admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:53.282674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b44e2a-0b52-4cd8-9f17-f6c4b8ad5f88 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07fc63b6638847d8b6baa61ad3719631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8841660dd974b67bc1ccaf5f5273081', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:53.285019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b44e2a-0b52-4cd8-9f17-f6c4b8ad5f88 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:53.285498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b44e2a-0b52-4cd8-9f17-f6c4b8ad5f88 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:53.286012 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b44e2a-0b52-4cd8-9f17-f6c4b8ad5f88 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] PATH_INFO: `/v3/projects/9fa94089ceb8497e8f7b51941f93bc61` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:53.288932 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b44e2a-0b52-4cd8-9f17-f6c4b8ad5f88 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9fa94089ceb8497e8f7b51941f93bc61)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:53.292098 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b44e2a-0b52-4cd8-9f17-f6c4b8ad5f88 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:53.319892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708aac1f-effd-44d6-add1-76a0680d1f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:53.319892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708aac1f-effd-44d6-add1-76a0680d1f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:53.319892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708aac1f-effd-44d6-add1-76a0680d1f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:53.319892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708aac1f-effd-44d6-add1-76a0680d1f8e admin admin] PATH_INFO: `/v3/projects/984f291b87a84fc18e2b5468772372d2` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:53.320916 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708aac1f-effd-44d6-add1-76a0680d1f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=984f291b87a84fc18e2b5468772372d2)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:53.321462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708aac1f-effd-44d6-add1-76a0680d1f8e admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:53.448365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-35b44e2a-0b52-4cd8-9f17-f6c4b8ad5f88 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fa94089ceb8497e8f7b51941f93bc61', 'request_id': 'req-35b44e2a-0b52-4cd8-9f17-f6c4b8ad5f88'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:53.565215 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-708aac1f-effd-44d6-add1-76a0680d1f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '984f291b87a84fc18e2b5468772372d2', 'request_id': 'req-708aac1f-effd-44d6-add1-76a0680d1f8e'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:53.568185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-35b44e2a-0b52-4cd8-9f17-f6c4b8ad5f88 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fa94089ceb8497e8f7b51941f93bc61', 'request_id': 'req-35b44e2a-0b52-4cd8-9f17-f6c4b8ad5f88'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:53.575948 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-35b44e2a-0b52-4cd8-9f17-f6c4b8ad5f88 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fa94089ceb8497e8f7b51941f93bc61', 'request_id': 'req-35b44e2a-0b52-4cd8-9f17-f6c4b8ad5f88'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:53.580853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-708aac1f-effd-44d6-add1-76a0680d1f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '984f291b87a84fc18e2b5468772372d2', 'request_id': 'req-708aac1f-effd-44d6-add1-76a0680d1f8e'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:53.588402 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-708aac1f-effd-44d6-add1-76a0680d1f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '984f291b87a84fc18e2b5468772372d2', 'request_id': 'req-708aac1f-effd-44d6-add1-76a0680d1f8e'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:53.592868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-35b44e2a-0b52-4cd8-9f17-f6c4b8ad5f88 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] The token cache is being invalidate because project 9fa94089ceb8497e8f7b51941f93bc61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:02:53.593384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-35b44e2a-0b52-4cd8-9f17-f6c4b8ad5f88 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:53.594435 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-35b44e2a-0b52-4cd8-9f17-f6c4b8ad5f88 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:53.596687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 921/1826] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:02:53 2022] DELETE /identity/v3/projects/9fa94089ceb8497e8f7b51941f93bc61 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:53.682462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-708aac1f-effd-44d6-add1-76a0680d1f8e admin admin] The token cache is being invalidate because project 984f291b87a84fc18e2b5468772372d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:02:53.683128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-708aac1f-effd-44d6-add1-76a0680d1f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:53.684282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-708aac1f-effd-44d6-add1-76a0680d1f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:53.686986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 906/1827] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:02:52 2022] DELETE /identity/v3/projects/984f291b87a84fc18e2b5468772372d2 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:53.691971 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b44e2a-0b52-4cd8-9f17-f6c4b8ad5f88 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:53.693456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-35b44e2a-0b52-4cd8-9f17-f6c4b8ad5f88 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:53.789353 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:53.887124 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b44e2a-0b52-4cd8-9f17-f6c4b8ad5f88 tempest-VolumeQuotaClassesTest-161964652 tempest-VolumeQuotaClassesTest-161964652-project-admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:53.963125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708aac1f-effd-44d6-add1-76a0680d1f8e admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:53.963125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-708aac1f-effd-44d6-add1-76a0680d1f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:54.103068 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f525f1-c37b-4b9c-9eea-853bf0167aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:54.103952 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f525f1-c37b-4b9c-9eea-853bf0167aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:54.104293 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f525f1-c37b-4b9c-9eea-853bf0167aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:54.104579 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f525f1-c37b-4b9c-9eea-853bf0167aa5 admin admin] PATH_INFO: `/v3/users/8c19511384c346c6b02faa4ef5d1c837` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:54.106559 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f525f1-c37b-4b9c-9eea-853bf0167aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c19511384c346c6b02faa4ef5d1c837)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:54.118370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f525f1-c37b-4b9c-9eea-853bf0167aa5 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:54.184295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708aac1f-effd-44d6-add1-76a0680d1f8e admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:54.196129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03516f0a-5902-4ec2-9b0a-ba6a2dfce003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:54.196822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03516f0a-5902-4ec2-9b0a-ba6a2dfce003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:54.197112 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03516f0a-5902-4ec2-9b0a-ba6a2dfce003 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:54.197397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03516f0a-5902-4ec2-9b0a-ba6a2dfce003 admin admin] PATH_INFO: `/v3/projects/46d8246c46064d25905116c2ccef8f64` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:54.199116 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03516f0a-5902-4ec2-9b0a-ba6a2dfce003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46d8246c46064d25905116c2ccef8f64)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:54.201859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03516f0a-5902-4ec2-9b0a-ba6a2dfce003 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:54.451881 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-38f525f1-c37b-4b9c-9eea-853bf0167aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c19511384c346c6b02faa4ef5d1c837'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:54.459033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-38f525f1-c37b-4b9c-9eea-853bf0167aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c19511384c346c6b02faa4ef5d1c837'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:54.466436 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-03516f0a-5902-4ec2-9b0a-ba6a2dfce003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46d8246c46064d25905116c2ccef8f64', 'request_id': 'req-03516f0a-5902-4ec2-9b0a-ba6a2dfce003'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:54.482754 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-03516f0a-5902-4ec2-9b0a-ba6a2dfce003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46d8246c46064d25905116c2ccef8f64', 'request_id': 'req-03516f0a-5902-4ec2-9b0a-ba6a2dfce003'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:54.529652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-03516f0a-5902-4ec2-9b0a-ba6a2dfce003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46d8246c46064d25905116c2ccef8f64', 'request_id': 'req-03516f0a-5902-4ec2-9b0a-ba6a2dfce003'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:54.644033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-38f525f1-c37b-4b9c-9eea-853bf0167aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c19511384c346c6b02faa4ef5d1c837'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:54.663650 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-38f525f1-c37b-4b9c-9eea-853bf0167aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c19511384c346c6b02faa4ef5d1c837'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:54.674178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-38f525f1-c37b-4b9c-9eea-853bf0167aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c19511384c346c6b02faa4ef5d1c837'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:54.686958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 922/1828] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:02:53 2022] DELETE /identity/v3/users/8c19511384c346c6b02faa4ef5d1c837 => generated 0 bytes in 995 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:54.691834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cc462-dbb2-4583-9419-64d17f1184f2 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:54.698687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cc462-dbb2-4583-9419-64d17f1184f2 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:54.698687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cc462-dbb2-4583-9419-64d17f1184f2 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:54.698687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 923/1829] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 28 04:02:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:02:54.735003 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cdf59-0209-4526-a2a3-fa3537229e30 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:54.738095 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cdf59-0209-4526-a2a3-fa3537229e30 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:54.739036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cdf59-0209-4526-a2a3-fa3537229e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:54.777041 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-03516f0a-5902-4ec2-9b0a-ba6a2dfce003 admin admin] The token cache is being invalidate because project 46d8246c46064d25905116c2ccef8f64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:02:54.790715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-03516f0a-5902-4ec2-9b0a-ba6a2dfce003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:54.790715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-03516f0a-5902-4ec2-9b0a-ba6a2dfce003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:54.793591 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 907/1830] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:02:53 2022] DELETE /identity/v3/projects/46d8246c46064d25905116c2ccef8f64 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:54.801098 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d2121-b9ba-4e19-9026-37043ff40ad2 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:54.801994 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d2121-b9ba-4e19-9026-37043ff40ad2 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:54.805847 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d2121-b9ba-4e19-9026-37043ff40ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:54.841889 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-a07cdf59-0209-4526-a2a3-fa3537229e30 None None] MFA Rules not processed for user `5133abf4c32a45b0b2188f71496c572b`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:54.849830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a07cdf59-0209-4526-a2a3-fa3537229e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:54.902007 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-623d2121-b9ba-4e19-9026-37043ff40ad2 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:54.906913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-623d2121-b9ba-4e19-9026-37043ff40ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:55.094365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 924/1831] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 28 04:02:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:55.095717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07cdf59-0209-4526-a2a3-fa3537229e30 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:55.098819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a07cdf59-0209-4526-a2a3-fa3537229e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:55.130357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 908/1832] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:55.134944 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d2121-b9ba-4e19-9026-37043ff40ad2 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:55.134944 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-623d2121-b9ba-4e19-9026-37043ff40ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:55.211679 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d2121-b9ba-4e19-9026-37043ff40ad2 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:55.227764 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07cdf59-0209-4526-a2a3-fa3537229e30 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:55.228298 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23608f80-0f06-417a-9a8f-bfabc72d2b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:55.229880 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23608f80-0f06-417a-9a8f-bfabc72d2b5e service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:55.231740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23608f80-0f06-417a-9a8f-bfabc72d2b5e service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:55.232494 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23608f80-0f06-417a-9a8f-bfabc72d2b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:55.238613 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:55.243731 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc1fcd-fe61-4a84-a222-2f78fac18546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:55.246050 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc1fcd-fe61-4a84-a222-2f78fac18546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:55.246050 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc1fcd-fe61-4a84-a222-2f78fac18546 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:55.246050 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc1fcd-fe61-4a84-a222-2f78fac18546 admin admin] PATH_INFO: `/v3/users/62a18929019345a3a8dfb00a33fc76e3` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:55.246596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc1fcd-fe61-4a84-a222-2f78fac18546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a18929019345a3a8dfb00a33fc76e3)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:55.249253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc1fcd-fe61-4a84-a222-2f78fac18546 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:55.274961 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23608f80-0f06-417a-9a8f-bfabc72d2b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:55.277104 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23608f80-0f06-417a-9a8f-bfabc72d2b5e service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:55.320942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 909/1833] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:55.322475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870b521-d468-4674-8947-32284f3f2ab7 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:55.323433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870b521-d468-4674-8947-32284f3f2ab7 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:55.324646 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870b521-d468-4674-8947-32284f3f2ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:55.353024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-8870b521-d468-4674-8947-32284f3f2ab7 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:55.354449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-8870b521-d468-4674-8947-32284f3f2ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:55.384271 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 910/1834] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:55.388853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870b521-d468-4674-8947-32284f3f2ab7 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:55.410034 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870b521-d468-4674-8947-32284f3f2ab7 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:55.418971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b778f3-8d92-4d4c-a1e4-45cef1717a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:55.420718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b778f3-8d92-4d4c-a1e4-45cef1717a2b admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:55.421525 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b778f3-8d92-4d4c-a1e4-45cef1717a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:55.422185 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b778f3-8d92-4d4c-a1e4-45cef1717a2b admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:55.425530 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b778f3-8d92-4d4c-a1e4-45cef1717a2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:02:55.425530 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b778f3-8d92-4d4c-a1e4-45cef1717a2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:55.431226 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b778f3-8d92-4d4c-a1e4-45cef1717a2b admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:55.464497 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 911/1835] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:02:55.468595 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b778f3-8d92-4d4c-a1e4-45cef1717a2b admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:55.482934 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b778f3-8d92-4d4c-a1e4-45cef1717a2b admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:55.484300 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d5dc1fcd-fe61-4a84-a222-2f78fac18546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a18929019345a3a8dfb00a33fc76e3'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:55.485665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d5dc1fcd-fe61-4a84-a222-2f78fac18546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a18929019345a3a8dfb00a33fc76e3'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:55.518292 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cbf0b-fd31-4040-b5f7-87597078777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:55.519541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cbf0b-fd31-4040-b5f7-87597078777a admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:55.520226 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cbf0b-fd31-4040-b5f7-87597078777a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:55.520645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cbf0b-fd31-4040-b5f7-87597078777a admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:55.521387 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cbf0b-fd31-4040-b5f7-87597078777a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:55.523618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cbf0b-fd31-4040-b5f7-87597078777a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:55.637683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d5dc1fcd-fe61-4a84-a222-2f78fac18546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a18929019345a3a8dfb00a33fc76e3'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:55.666813 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d5dc1fcd-fe61-4a84-a222-2f78fac18546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a18929019345a3a8dfb00a33fc76e3'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:55.681396 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d5dc1fcd-fe61-4a84-a222-2f78fac18546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a18929019345a3a8dfb00a33fc76e3'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:55.687983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 912/1836] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:55 2022] POST /identity/v3/projects => generated 387 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:55.697725 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cbf0b-fd31-4040-b5f7-87597078777a admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:55.699667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-d81cbf0b-fd31-4040-b5f7-87597078777a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:55.710779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 925/1837] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:02:55 2022] DELETE /identity/v3/users/62a18929019345a3a8dfb00a33fc76e3 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:55.716139 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0702a-6778-4498-97b6-80f05e26f7a8 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:55.717290 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0702a-6778-4498-97b6-80f05e26f7a8 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:55.717852 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0702a-6778-4498-97b6-80f05e26f7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:55.753429 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-24d0702a-6778-4498-97b6-80f05e26f7a8 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:55.754831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-24d0702a-6778-4498-97b6-80f05e26f7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:55.829399 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cbf0b-fd31-4040-b5f7-87597078777a admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:55.870322 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 926/1838] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:55.884766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0702a-6778-4498-97b6-80f05e26f7a8 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:55.886613 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-24d0702a-6778-4498-97b6-80f05e26f7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:55.903936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:55.954624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d5126-7f8e-4174-822e-ca65227fbbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:55.956296 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d5126-7f8e-4174-822e-ca65227fbbf2 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:55.956296 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d5126-7f8e-4174-822e-ca65227fbbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:55.956582 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d5126-7f8e-4174-822e-ca65227fbbf2 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:55.962660 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d5126-7f8e-4174-822e-ca65227fbbf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:55.962660 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d5126-7f8e-4174-822e-ca65227fbbf2 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:56.004651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0702a-6778-4498-97b6-80f05e26f7a8 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:56.012104 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d006c6-4849-4966-b883-49ec4fa5d57d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:56.013136 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d006c6-4849-4966-b883-49ec4fa5d57d service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:56.013519 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d006c6-4849-4966-b883-49ec4fa5d57d service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:56.013894 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d006c6-4849-4966-b883-49ec4fa5d57d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:56.040523 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d006c6-4849-4966-b883-49ec4fa5d57d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:56.043011 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d006c6-4849-4966-b883-49ec4fa5d57d service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:56.106051 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 913/1839] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:55 2022] POST /identity/v3/users => generated 294 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:56.110521 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d5126-7f8e-4174-822e-ca65227fbbf2 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:56.118480 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 927/1840] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:02:56.136786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d5126-7f8e-4174-822e-ca65227fbbf2 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:56.152181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6fa94-64eb-4f67-a0f8-fa89f6145830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:56.152850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6fa94-64eb-4f67-a0f8-fa89f6145830 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:56.153724 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6fa94-64eb-4f67-a0f8-fa89f6145830 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:56.153724 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6fa94-64eb-4f67-a0f8-fa89f6145830 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:56.154177 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6fa94-64eb-4f67-a0f8-fa89f6145830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:56.155811 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6fa94-64eb-4f67-a0f8-fa89f6145830 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:56.176574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 914/1841] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:02:56.181074 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d006c6-4849-4966-b883-49ec4fa5d57d service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:56.202225 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d006c6-4849-4966-b883-49ec4fa5d57d service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:56.218320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b71134-cad7-4d6a-99dd-ad2d985ca08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:56.219694 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b71134-cad7-4d6a-99dd-ad2d985ca08b admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:56.219975 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b71134-cad7-4d6a-99dd-ad2d985ca08b admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:56.221254 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b71134-cad7-4d6a-99dd-ad2d985ca08b admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:56.222047 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b71134-cad7-4d6a-99dd-ad2d985ca08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:56.227625 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b71134-cad7-4d6a-99dd-ad2d985ca08b admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:56.260618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 928/1842] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:56.270108 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6fa94-64eb-4f67-a0f8-fa89f6145830 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:56.281610 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6fa94-64eb-4f67-a0f8-fa89f6145830 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:56.294446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6347b-e2a2-452c-b76c-67e994127ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:56.295425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6347b-e2a2-452c-b76c-67e994127ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:56.295877 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6347b-e2a2-452c-b76c-67e994127ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:56.296167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6347b-e2a2-452c-b76c-67e994127ec0 admin admin] PATH_INFO: `/v3/projects/1e7addf0ae3a43d0adf0d6dd551d8338/users/1ff13e56791a4c4ea77b6f6623d2baed/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:56.321573 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6347b-e2a2-452c-b76c-67e994127ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e7addf0ae3a43d0adf0d6dd551d8338, user_id=1ff13e56791a4c4ea77b6f6623d2baed, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:56.326595 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6347b-e2a2-452c-b76c-67e994127ec0 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:56.431703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 915/1843] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:56 2022] PUT /identity/v3/projects/1e7addf0ae3a43d0adf0d6dd551d8338/users/1ff13e56791a4c4ea77b6f6623d2baed/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:56.443577 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53d07a-f577-46b5-a014-1cea9542d5cf None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:56.444621 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53d07a-f577-46b5-a014-1cea9542d5cf None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:56.445137 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53d07a-f577-46b5-a014-1cea9542d5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:56.527217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-9b53d07a-f577-46b5-a014-1cea9542d5cf None None] MFA Rules not processed for user `1ff13e56791a4c4ea77b6f6623d2baed`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:56.531452 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9b53d07a-f577-46b5-a014-1cea9542d5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:56.677202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 929/1844] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:56.682323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6347b-e2a2-452c-b76c-67e994127ec0 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:56.780714 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53d07a-f577-46b5-a014-1cea9542d5cf None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:56.782516 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9b53d07a-f577-46b5-a014-1cea9542d5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:56.810295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6347b-e2a2-452c-b76c-67e994127ec0 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:56.815745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5196e11-ce2a-43f7-841a-9b746510cc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:56.817649 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5196e11-ce2a-43f7-841a-9b746510cc21 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:56.818162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5196e11-ce2a-43f7-841a-9b746510cc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:56.818613 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5196e11-ce2a-43f7-841a-9b746510cc21 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:56.834040 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5196e11-ce2a-43f7-841a-9b746510cc21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:56.838570 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5196e11-ce2a-43f7-841a-9b746510cc21 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:56.840013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53d07a-f577-46b5-a014-1cea9542d5cf None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:56.863993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d98ae-0cf9-41df-ba96-6f793c89e19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:56.864879 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d98ae-0cf9-41df-ba96-6f793c89e19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:56.865271 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d98ae-0cf9-41df-ba96-6f793c89e19e admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:56.865671 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d98ae-0cf9-41df-ba96-6f793c89e19e admin admin] PATH_INFO: `/v3/projects/4e3d1fa7c0cd4588b503fee6392efab1` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:56.887045 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d98ae-0cf9-41df-ba96-6f793c89e19e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3d1fa7c0cd4588b503fee6392efab1)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:56.888603 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d98ae-0cf9-41df-ba96-6f793c89e19e admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:56.975025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 916/1845] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:56 2022] POST /identity/v3/projects => generated 387 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:02:56.980664 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5196e11-ce2a-43f7-841a-9b746510cc21 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:57.148849 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-142d98ae-0cf9-41df-ba96-6f793c89e19e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3d1fa7c0cd4588b503fee6392efab1', 'request_id': 'req-142d98ae-0cf9-41df-ba96-6f793c89e19e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:57.241647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5196e11-ce2a-43f7-841a-9b746510cc21 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:57.356411 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f1fc8-b115-49b5-8bdc-4334c0579ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:57.358275 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f1fc8-b115-49b5-8bdc-4334c0579ebc admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:57.358793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f1fc8-b115-49b5-8bdc-4334c0579ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:57.359295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f1fc8-b115-49b5-8bdc-4334c0579ebc admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:57.361805 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f1fc8-b115-49b5-8bdc-4334c0579ebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:57.366301 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f1fc8-b115-49b5-8bdc-4334c0579ebc admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:57.684836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-142d98ae-0cf9-41df-ba96-6f793c89e19e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3d1fa7c0cd4588b503fee6392efab1', 'request_id': 'req-142d98ae-0cf9-41df-ba96-6f793c89e19e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:57.693602 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-142d98ae-0cf9-41df-ba96-6f793c89e19e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3d1fa7c0cd4588b503fee6392efab1', 'request_id': 'req-142d98ae-0cf9-41df-ba96-6f793c89e19e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:57.713278 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-142d98ae-0cf9-41df-ba96-6f793c89e19e admin admin] The token cache is being invalidate because project 4e3d1fa7c0cd4588b503fee6392efab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:02:57.713896 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-142d98ae-0cf9-41df-ba96-6f793c89e19e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:57.714711 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-142d98ae-0cf9-41df-ba96-6f793c89e19e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:57.716588 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 930/1846] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:02:56 2022] DELETE /identity/v3/projects/4e3d1fa7c0cd4588b503fee6392efab1 => generated 0 bytes in 937 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:57.727258 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f336e2-4fc3-4540-81c0-b27ccba99081 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:57.727706 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f336e2-4fc3-4540-81c0-b27ccba99081 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:57.728121 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f336e2-4fc3-4540-81c0-b27ccba99081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:57.753182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-21f336e2-4fc3-4540-81c0-b27ccba99081 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:57.754542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-21f336e2-4fc3-4540-81c0-b27ccba99081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:57.764732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 931/1847] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:02:57.776235 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc019c-9922-4025-9c17-b0e88dace936 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:57.776504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc019c-9922-4025-9c17-b0e88dace936 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:57.776782 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc019c-9922-4025-9c17-b0e88dace936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:57.812831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 917/1848] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:56 2022] POST /identity/v3/users => generated 300 bytes in 834 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:57.813987 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f1fc8-b115-49b5-8bdc-4334c0579ebc admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:57.818261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-0bcc019c-9922-4025-9c17-b0e88dace936 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:57.818560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-564f1fc8-b115-49b5-8bdc-4334c0579ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:57.818750 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-0bcc019c-9922-4025-9c17-b0e88dace936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:57.830522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 932/1849] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:02:57.831845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc019c-9922-4025-9c17-b0e88dace936 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:57.833653 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-0bcc019c-9922-4025-9c17-b0e88dace936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:57.851675 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc019c-9922-4025-9c17-b0e88dace936 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:57.860239 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f1fc8-b115-49b5-8bdc-4334c0579ebc admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:57.861095 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0faa25-c351-411c-969b-454e1ee5c014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:57.861095 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0faa25-c351-411c-969b-454e1ee5c014 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:57.861095 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0faa25-c351-411c-969b-454e1ee5c014 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:57.861095 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0faa25-c351-411c-969b-454e1ee5c014 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:57.862566 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0faa25-c351-411c-969b-454e1ee5c014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:57.864338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0faa25-c351-411c-969b-454e1ee5c014 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:57.877907 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 933/1850] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:57.879347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0faa25-c351-411c-969b-454e1ee5c014 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:57.881808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f39957-b916-4452-8467-3d19a6477e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:57.882749 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f39957-b916-4452-8467-3d19a6477e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:57.883056 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f39957-b916-4452-8467-3d19a6477e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:57.883349 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f39957-b916-4452-8467-3d19a6477e45 admin admin] PATH_INFO: `/v3/projects/9bda2f2af79241cdaad42f493db93876` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:57.889036 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f39957-b916-4452-8467-3d19a6477e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bda2f2af79241cdaad42f493db93876)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:57.889036 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f39957-b916-4452-8467-3d19a6477e45 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:57.897984 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0faa25-c351-411c-969b-454e1ee5c014 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:57.912355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a331ef-fd6c-4cfd-bb79-b6f4ca4c9489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:57.912355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a331ef-fd6c-4cfd-bb79-b6f4ca4c9489 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:57.912668 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a331ef-fd6c-4cfd-bb79-b6f4ca4c9489 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:57.913044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a331ef-fd6c-4cfd-bb79-b6f4ca4c9489 admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:57.914039 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a331ef-fd6c-4cfd-bb79-b6f4ca4c9489 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:02:57.914440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a331ef-fd6c-4cfd-bb79-b6f4ca4c9489 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:57.916953 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a331ef-fd6c-4cfd-bb79-b6f4ca4c9489 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:57.942159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 934/1851] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:02:57.951146 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a331ef-fd6c-4cfd-bb79-b6f4ca4c9489 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:57.964680 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a331ef-fd6c-4cfd-bb79-b6f4ca4c9489 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:57.971285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae41374-456b-40cb-a3c8-b59367e4f07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:57.972588 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae41374-456b-40cb-a3c8-b59367e4f07e admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:57.972967 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae41374-456b-40cb-a3c8-b59367e4f07e admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:57.973343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae41374-456b-40cb-a3c8-b59367e4f07e admin admin] PATH_INFO: `/v3/projects/5ed00f9e44304b0f99a9c810d5d092ff/users/048e27bc7bc5411db799a7eb7624bd8b/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:57.993992 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae41374-456b-40cb-a3c8-b59367e4f07e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed00f9e44304b0f99a9c810d5d092ff, user_id=048e27bc7bc5411db799a7eb7624bd8b, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:57.998084 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae41374-456b-40cb-a3c8-b59367e4f07e admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:58.028401 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:58.144171 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 935/1852] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:57 2022] PUT /identity/v3/projects/5ed00f9e44304b0f99a9c810d5d092ff/users/048e27bc7bc5411db799a7eb7624bd8b/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:58.144587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e4f39957-b916-4452-8467-3d19a6477e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bda2f2af79241cdaad42f493db93876', 'request_id': 'req-e4f39957-b916-4452-8467-3d19a6477e45'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:58.145588 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae41374-456b-40cb-a3c8-b59367e4f07e admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:58.160611 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e4f39957-b916-4452-8467-3d19a6477e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bda2f2af79241cdaad42f493db93876', 'request_id': 'req-e4f39957-b916-4452-8467-3d19a6477e45'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:58.178609 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e4f39957-b916-4452-8467-3d19a6477e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bda2f2af79241cdaad42f493db93876', 'request_id': 'req-e4f39957-b916-4452-8467-3d19a6477e45'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:58.255046 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae41374-456b-40cb-a3c8-b59367e4f07e admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:58.308656 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e4f39957-b916-4452-8467-3d19a6477e45 admin admin] The token cache is being invalidate because project 9bda2f2af79241cdaad42f493db93876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:02:58.308656 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e4f39957-b916-4452-8467-3d19a6477e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:58.313246 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e4f39957-b916-4452-8467-3d19a6477e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:58.315913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 918/1853] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:02:57 2022] DELETE /identity/v3/projects/9bda2f2af79241cdaad42f493db93876 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:58.316834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f39957-b916-4452-8467-3d19a6477e45 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:58.320577 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e4f39957-b916-4452-8467-3d19a6477e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:58.383614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bbae1-f636-4942-b7fe-15d7fd23a502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:58.384426 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bbae1-f636-4942-b7fe-15d7fd23a502 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:58.384815 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bbae1-f636-4942-b7fe-15d7fd23a502 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:58.385193 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bbae1-f636-4942-b7fe-15d7fd23a502 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:58.385994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bbae1-f636-4942-b7fe-15d7fd23a502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:58.388858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bbae1-f636-4942-b7fe-15d7fd23a502 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:58.436381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f39957-b916-4452-8467-3d19a6477e45 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:58.452053 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc84f2c-a396-4171-9848-a4898f1f674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:58.453312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc84f2c-a396-4171-9848-a4898f1f674d admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:58.453763 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc84f2c-a396-4171-9848-a4898f1f674d admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:58.454096 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc84f2c-a396-4171-9848-a4898f1f674d admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:58.455458 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc84f2c-a396-4171-9848-a4898f1f674d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:58.458967 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc84f2c-a396-4171-9848-a4898f1f674d admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:58.470054 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 919/1854] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:58.470923 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc84f2c-a396-4171-9848-a4898f1f674d admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:58.472898 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0bc84f2c-a396-4171-9848-a4898f1f674d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:58.488375 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:58.492366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc84f2c-a396-4171-9848-a4898f1f674d admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:58.499136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3c8da-0f4d-42b9-ad69-048d4c012c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:58.506607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 936/1855] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:58 2022] POST /identity/v3/projects => generated 363 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:58.507760 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3c8da-0f4d-42b9-ad69-048d4c012c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:58.507760 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3c8da-0f4d-42b9-ad69-048d4c012c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:58.507760 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3c8da-0f4d-42b9-ad69-048d4c012c7c admin admin] PATH_INFO: `/v3/users/07fc63b6638847d8b6baa61ad3719631` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:58.508232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bbae1-f636-4942-b7fe-15d7fd23a502 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:58.508723 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3c8da-0f4d-42b9-ad69-048d4c012c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=07fc63b6638847d8b6baa61ad3719631)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:58.510533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3c8da-0f4d-42b9-ad69-048d4c012c7c admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:58.586837 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bbae1-f636-4942-b7fe-15d7fd23a502 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:58.592464 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75093f6-0445-496b-822b-be4b7cc938ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:58.593194 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75093f6-0445-496b-822b-be4b7cc938ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:58.593475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75093f6-0445-496b-822b-be4b7cc938ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:58.593752 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75093f6-0445-496b-822b-be4b7cc938ab admin admin] PATH_INFO: `/v3/projects/5ed00f9e44304b0f99a9c810d5d092ff/users/048e27bc7bc5411db799a7eb7624bd8b/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:58.597309 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75093f6-0445-496b-822b-be4b7cc938ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed00f9e44304b0f99a9c810d5d092ff, user_id=048e27bc7bc5411db799a7eb7624bd8b, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:58.600049 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75093f6-0445-496b-822b-be4b7cc938ab admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:58.612808 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 937/1856] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:58 2022] PUT /identity/v3/projects/5ed00f9e44304b0f99a9c810d5d092ff/users/048e27bc7bc5411db799a7eb7624bd8b/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:58.613671 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75093f6-0445-496b-822b-be4b7cc938ab admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:58.615579 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b75093f6-0445-496b-822b-be4b7cc938ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:58.688641 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75093f6-0445-496b-822b-be4b7cc938ab admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:58.694673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87339eae-9d6b-4fad-887e-874dc8227959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:58.696260 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87339eae-9d6b-4fad-887e-874dc8227959 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:58.696260 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87339eae-9d6b-4fad-887e-874dc8227959 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:58.696260 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87339eae-9d6b-4fad-887e-874dc8227959 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:58.696624 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87339eae-9d6b-4fad-887e-874dc8227959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:58.698640 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87339eae-9d6b-4fad-887e-874dc8227959 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:58.775883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-35d3c8da-0f4d-42b9-ad69-048d4c012c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07fc63b6638847d8b6baa61ad3719631'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:58.776562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-35d3c8da-0f4d-42b9-ad69-048d4c012c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07fc63b6638847d8b6baa61ad3719631'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:58.828604 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 938/1857] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:58 2022] POST /identity/v3/users => generated 282 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:02:58.828604 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e31bae-2f5e-4c94-9118-37d9e263c41e None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:58.828604 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e31bae-2f5e-4c94-9118-37d9e263c41e None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:58.828604 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e31bae-2f5e-4c94-9118-37d9e263c41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:58.845855 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-35d3c8da-0f4d-42b9-ad69-048d4c012c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07fc63b6638847d8b6baa61ad3719631'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:58.856202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-35d3c8da-0f4d-42b9-ad69-048d4c012c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07fc63b6638847d8b6baa61ad3719631'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:58.868501 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-62e31bae-2f5e-4c94-9118-37d9e263c41e None None] MFA Rules not processed for user `048e27bc7bc5411db799a7eb7624bd8b`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:58.870149 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-62e31bae-2f5e-4c94-9118-37d9e263c41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:58.881196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-35d3c8da-0f4d-42b9-ad69-048d4c012c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07fc63b6638847d8b6baa61ad3719631'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:58.895599 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 920/1858] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:02:58 2022] DELETE /identity/v3/users/07fc63b6638847d8b6baa61ad3719631 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:58.897297 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3c8da-0f4d-42b9-ad69-048d4c012c7c admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:58.899419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-35d3c8da-0f4d-42b9-ad69-048d4c012c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:59.005000 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 939/1859] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:59.030354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e31bae-2f5e-4c94-9118-37d9e263c41e None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:59.032050 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-62e31bae-2f5e-4c94-9118-37d9e263c41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:59.037599 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3c8da-0f4d-42b9-ad69-048d4c012c7c admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:59.050071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fff5d-a3f2-4809-8926-a54937f59d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:59.051273 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fff5d-a3f2-4809-8926-a54937f59d7e admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:59.052060 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fff5d-a3f2-4809-8926-a54937f59d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:59.052580 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fff5d-a3f2-4809-8926-a54937f59d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:59.054081 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fff5d-a3f2-4809-8926-a54937f59d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:59.057455 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fff5d-a3f2-4809-8926-a54937f59d7e admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:59.076875 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 921/1860] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:59.084014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fff5d-a3f2-4809-8926-a54937f59d7e admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:59.095474 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fff5d-a3f2-4809-8926-a54937f59d7e admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:59.101451 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e49f8-7b3d-44b2-8f0d-f6093b855012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:59.102187 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e49f8-7b3d-44b2-8f0d-f6093b855012 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:59.102550 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e49f8-7b3d-44b2-8f0d-f6093b855012 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:59.103020 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e49f8-7b3d-44b2-8f0d-f6093b855012 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:59.103840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e49f8-7b3d-44b2-8f0d-f6093b855012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:59.107812 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e49f8-7b3d-44b2-8f0d-f6093b855012 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:59.118148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e31bae-2f5e-4c94-9118-37d9e263c41e None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:59.121012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 922/1861] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:02:59.124830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e49f8-7b3d-44b2-8f0d-f6093b855012 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:59.136085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e49f8-7b3d-44b2-8f0d-f6093b855012 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:59.144141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc035c5f-3465-42ab-8f3b-7315fd067248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:59.149069 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc035c5f-3465-42ab-8f3b-7315fd067248 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:59.149069 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc035c5f-3465-42ab-8f3b-7315fd067248 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:59.149069 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc035c5f-3465-42ab-8f3b-7315fd067248 admin admin] PATH_INFO: `/v3/projects/85943328f099472d9cc8feb072772a00/users/4e557d6cc2b54322aca358a811e56548/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:59.166631 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc035c5f-3465-42ab-8f3b-7315fd067248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85943328f099472d9cc8feb072772a00, user_id=4e557d6cc2b54322aca358a811e56548, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:59.170317 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc035c5f-3465-42ab-8f3b-7315fd067248 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:59.190153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172c211-95b0-42c5-9ab8-d5da81350e30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:59.190958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172c211-95b0-42c5-9ab8-d5da81350e30 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:59.191242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172c211-95b0-42c5-9ab8-d5da81350e30 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:59.191552 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172c211-95b0-42c5-9ab8-d5da81350e30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:59.256132 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172c211-95b0-42c5-9ab8-d5da81350e30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:59.257738 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172c211-95b0-42c5-9ab8-d5da81350e30 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:59.263949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 923/1862] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:02:59 2022] PUT /identity/v3/projects/85943328f099472d9cc8feb072772a00/users/4e557d6cc2b54322aca358a811e56548/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:02:59.271298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 940/1863] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:02:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:02:59.278012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed36929-963d-417e-9176-1d6ff2282792 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:59.278600 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed36929-963d-417e-9176-1d6ff2282792 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:59.279044 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed36929-963d-417e-9176-1d6ff2282792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:59.322192 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-9ed36929-963d-417e-9176-1d6ff2282792 None None] MFA Rules not processed for user `4e557d6cc2b54322aca358a811e56548`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:02:59.324943 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9ed36929-963d-417e-9176-1d6ff2282792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:59.365580 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:59.381508 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172c211-95b0-42c5-9ab8-d5da81350e30 service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:59.383565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c172c211-95b0-42c5-9ab8-d5da81350e30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:59.407280 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172c211-95b0-42c5-9ab8-d5da81350e30 service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:59.438551 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 924/1864] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:02:59 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:02:59.439956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed36929-963d-417e-9176-1d6ff2282792 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:59.494016 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6d981-f768-4967-8e5b-93a4dc3e9985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:59.494856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6d981-f768-4967-8e5b-93a4dc3e9985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:59.495128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6d981-f768-4967-8e5b-93a4dc3e9985 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:59.495453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6d981-f768-4967-8e5b-93a4dc3e9985 admin admin] PATH_INFO: `/v3/users/1ff13e56791a4c4ea77b6f6623d2baed` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:59.496829 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6d981-f768-4967-8e5b-93a4dc3e9985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff13e56791a4c4ea77b6f6623d2baed)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:59.499026 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6d981-f768-4967-8e5b-93a4dc3e9985 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:59.550618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed36929-963d-417e-9176-1d6ff2282792 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:59.577817 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca424e87-4d6b-481d-92a0-0d097e441c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:59.578592 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca424e87-4d6b-481d-92a0-0d097e441c8c admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:59.578880 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca424e87-4d6b-481d-92a0-0d097e441c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:59.586336 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca424e87-4d6b-481d-92a0-0d097e441c8c admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:59.586336 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca424e87-4d6b-481d-92a0-0d097e441c8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:59.586336 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca424e87-4d6b-481d-92a0-0d097e441c8c admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:59.723860 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 925/1865] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:02:59 2022] POST /identity/v3/projects => generated 365 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:02:59.723860 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca424e87-4d6b-481d-92a0-0d097e441c8c admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:59.724147 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ca424e87-4d6b-481d-92a0-0d097e441c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:59.803215 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca424e87-4d6b-481d-92a0-0d097e441c8c admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:02:59.813652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be9831-921a-412d-a851-3ddf55d0a28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:02:59.816627 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be9831-921a-412d-a851-3ddf55d0a28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:02:59.816627 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be9831-921a-412d-a851-3ddf55d0a28a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:02:59.816627 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be9831-921a-412d-a851-3ddf55d0a28a admin admin] PATH_INFO: `/v3/projects/d8841660dd974b67bc1ccaf5f5273081` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:02:59.817314 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be9831-921a-412d-a851-3ddf55d0a28a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8841660dd974b67bc1ccaf5f5273081)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:02:59.819376 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be9831-921a-412d-a851-3ddf55d0a28a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:02:59.821666 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-78f6d981-f768-4967-8e5b-93a4dc3e9985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff13e56791a4c4ea77b6f6623d2baed'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:59.822345 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-78f6d981-f768-4967-8e5b-93a4dc3e9985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff13e56791a4c4ea77b6f6623d2baed'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:59.882675 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-78f6d981-f768-4967-8e5b-93a4dc3e9985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff13e56791a4c4ea77b6f6623d2baed'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:59.900233 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-78f6d981-f768-4967-8e5b-93a4dc3e9985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff13e56791a4c4ea77b6f6623d2baed'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:59.907745 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-78f6d981-f768-4967-8e5b-93a4dc3e9985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff13e56791a4c4ea77b6f6623d2baed'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:59.915166 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 941/1866] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:02:59 2022] DELETE /identity/v3/users/1ff13e56791a4c4ea77b6f6623d2baed => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:02:59.916277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6d981-f768-4967-8e5b-93a4dc3e9985 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:02:59.919173 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-78f6d981-f768-4967-8e5b-93a4dc3e9985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:02:59.957745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-12be9831-921a-412d-a851-3ddf55d0a28a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8841660dd974b67bc1ccaf5f5273081', 'request_id': 'req-12be9831-921a-412d-a851-3ddf55d0a28a'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:59.971193 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-12be9831-921a-412d-a851-3ddf55d0a28a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8841660dd974b67bc1ccaf5f5273081', 'request_id': 'req-12be9831-921a-412d-a851-3ddf55d0a28a'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:02:59.998852 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6d981-f768-4967-8e5b-93a4dc3e9985 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:00.011451 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-12be9831-921a-412d-a851-3ddf55d0a28a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8841660dd974b67bc1ccaf5f5273081', 'request_id': 'req-12be9831-921a-412d-a851-3ddf55d0a28a'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:00.084148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e52dc8-623c-488f-9236-62790d246460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:00.084943 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e52dc8-623c-488f-9236-62790d246460 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:00.085293 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e52dc8-623c-488f-9236-62790d246460 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:00.085576 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e52dc8-623c-488f-9236-62790d246460 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:00.086283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e52dc8-623c-488f-9236-62790d246460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:00.088344 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e52dc8-623c-488f-9236-62790d246460 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:00.113547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-12be9831-921a-412d-a851-3ddf55d0a28a admin admin] The token cache is being invalidate because project d8841660dd974b67bc1ccaf5f5273081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:00.114072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-12be9831-921a-412d-a851-3ddf55d0a28a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:00.114568 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:00.115841 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-12be9831-921a-412d-a851-3ddf55d0a28a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:00.121098 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 926/1867] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:02:59 2022] DELETE /identity/v3/projects/d8841660dd974b67bc1ccaf5f5273081 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:00.121098 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fefc2-4cdd-40c7-a12c-3a3e7fa46b21 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:00.121098 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fefc2-4cdd-40c7-a12c-3a3e7fa46b21 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:00.121098 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fefc2-4cdd-40c7-a12c-3a3e7fa46b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:00.142545 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-603fefc2-4cdd-40c7-a12c-3a3e7fa46b21 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:00.144587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-603fefc2-4cdd-40c7-a12c-3a3e7fa46b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:00.159576 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 927/1868] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:00.159576 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7059baf-9fa9-4b86-b24d-5f96d6df4473 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:00.159576 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7059baf-9fa9-4b86-b24d-5f96d6df4473 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:00.159576 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7059baf-9fa9-4b86-b24d-5f96d6df4473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:00.179625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-a7059baf-9fa9-4b86-b24d-5f96d6df4473 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:00.181390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a7059baf-9fa9-4b86-b24d-5f96d6df4473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:00.198356 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 928/1869] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:00.200121 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7059baf-9fa9-4b86-b24d-5f96d6df4473 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:00.202657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a7059baf-9fa9-4b86-b24d-5f96d6df4473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:00.218966 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 942/1870] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:02:59 2022] POST /identity/v3/users => generated 289 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:00.221964 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cb88c-8e2a-478c-b381-c933b3fc1cfa None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:00.222514 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cb88c-8e2a-478c-b381-c933b3fc1cfa None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:00.223004 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cb88c-8e2a-478c-b381-c933b3fc1cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:00.260356 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-973cb88c-8e2a-478c-b381-c933b3fc1cfa None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:00.261888 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-973cb88c-8e2a-478c-b381-c933b3fc1cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:00.270601 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 943/1871] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:00.271945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cb88c-8e2a-478c-b381-c933b3fc1cfa None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:00.275119 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-973cb88c-8e2a-478c-b381-c933b3fc1cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:00.289256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cb88c-8e2a-478c-b381-c933b3fc1cfa None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:00.295805 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7059baf-9fa9-4b86-b24d-5f96d6df4473 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:00.296246 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b80c4-39a2-469d-b0ae-1a90abee1bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:00.297068 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b80c4-39a2-469d-b0ae-1a90abee1bab admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:00.297503 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b80c4-39a2-469d-b0ae-1a90abee1bab admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:00.297917 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b80c4-39a2-469d-b0ae-1a90abee1bab admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:00.299493 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b80c4-39a2-469d-b0ae-1a90abee1bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:00.301275 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b80c4-39a2-469d-b0ae-1a90abee1bab admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:00.301606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4616fe-b990-4f7d-b7a0-68d84a9cf418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:00.302370 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4616fe-b990-4f7d-b7a0-68d84a9cf418 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:00.302752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4616fe-b990-4f7d-b7a0-68d84a9cf418 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:00.303465 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4616fe-b990-4f7d-b7a0-68d84a9cf418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:00.317903 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 944/1872] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:00.317903 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b80c4-39a2-469d-b0ae-1a90abee1bab admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:00.325120 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4616fe-b990-4f7d-b7a0-68d84a9cf418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:00.326058 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4616fe-b990-4f7d-b7a0-68d84a9cf418 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:00.342091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b80c4-39a2-469d-b0ae-1a90abee1bab admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:00.347863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 929/1873] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:00.348813 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4616fe-b990-4f7d-b7a0-68d84a9cf418 service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:00.348941 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaae5bc-f6bd-4044-8345-bcea63ad7db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:00.349992 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaae5bc-f6bd-4044-8345-bcea63ad7db8 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:00.350371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaae5bc-f6bd-4044-8345-bcea63ad7db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:00.350752 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaae5bc-f6bd-4044-8345-bcea63ad7db8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:00.351670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaae5bc-f6bd-4044-8345-bcea63ad7db8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:03:00.352083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaae5bc-f6bd-4044-8345-bcea63ad7db8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:00.353856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaae5bc-f6bd-4044-8345-bcea63ad7db8 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:00.366378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4616fe-b990-4f7d-b7a0-68d84a9cf418 service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:00.370330 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 945/1874] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:03:00.374169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871baed-60fe-4a25-8b0d-88806f7fb0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:00.374863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871baed-60fe-4a25-8b0d-88806f7fb0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:00.375145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871baed-60fe-4a25-8b0d-88806f7fb0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:00.375457 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871baed-60fe-4a25-8b0d-88806f7fb0a2 admin admin] PATH_INFO: `/v3/projects/321e3109e1054d39af73a4989091cb9a/users/596cfdc483024826a6c2b315af17a5c5/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:00.377940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaae5bc-f6bd-4044-8345-bcea63ad7db8 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:00.390418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaae5bc-f6bd-4044-8345-bcea63ad7db8 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:00.397317 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c522b-1f06-41ff-bad7-5837f1dffe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:00.397727 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871baed-60fe-4a25-8b0d-88806f7fb0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=321e3109e1054d39af73a4989091cb9a, user_id=596cfdc483024826a6c2b315af17a5c5, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:00.398307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c522b-1f06-41ff-bad7-5837f1dffe71 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:00.398802 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c522b-1f06-41ff-bad7-5837f1dffe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:00.399171 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c522b-1f06-41ff-bad7-5837f1dffe71 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:00.400064 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c522b-1f06-41ff-bad7-5837f1dffe71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:00.402258 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c522b-1f06-41ff-bad7-5837f1dffe71 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:00.404017 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871baed-60fe-4a25-8b0d-88806f7fb0a2 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:00.518885 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 930/1875] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:00 2022] PUT /identity/v3/projects/321e3109e1054d39af73a4989091cb9a/users/596cfdc483024826a6c2b315af17a5c5/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:00.522821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871baed-60fe-4a25-8b0d-88806f7fb0a2 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:00.567918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 946/1876] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:00 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:00.568981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c522b-1f06-41ff-bad7-5837f1dffe71 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:00.607981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871baed-60fe-4a25-8b0d-88806f7fb0a2 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:00.678390 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c522b-1f06-41ff-bad7-5837f1dffe71 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:00.681479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766380e-9c43-4b61-9d66-7de81ac13782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:00.682048 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766380e-9c43-4b61-9d66-7de81ac13782 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:00.682341 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766380e-9c43-4b61-9d66-7de81ac13782 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:00.682621 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766380e-9c43-4b61-9d66-7de81ac13782 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:00.683409 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766380e-9c43-4b61-9d66-7de81ac13782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:00.684121 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aff104-da22-44a4-9c19-e17d8b03f6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:00.684853 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aff104-da22-44a4-9c19-e17d8b03f6db admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:00.685079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766380e-9c43-4b61-9d66-7de81ac13782 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:00.685402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aff104-da22-44a4-9c19-e17d8b03f6db admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:00.685918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aff104-da22-44a4-9c19-e17d8b03f6db admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:00.686680 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aff104-da22-44a4-9c19-e17d8b03f6db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:00.689136 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aff104-da22-44a4-9c19-e17d8b03f6db admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:00.699365 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 931/1877] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:00.701658 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766380e-9c43-4b61-9d66-7de81ac13782 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:00.714415 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766380e-9c43-4b61-9d66-7de81ac13782 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:00.719953 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecb23f-4d3c-4a34-b7a1-95eaf081df7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:00.725762 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecb23f-4d3c-4a34-b7a1-95eaf081df7c admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:00.725762 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecb23f-4d3c-4a34-b7a1-95eaf081df7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:00.725762 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecb23f-4d3c-4a34-b7a1-95eaf081df7c admin admin] PATH_INFO: `/v3/projects/321e3109e1054d39af73a4989091cb9a/users/596cfdc483024826a6c2b315af17a5c5/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:00.725762 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecb23f-4d3c-4a34-b7a1-95eaf081df7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=321e3109e1054d39af73a4989091cb9a, user_id=596cfdc483024826a6c2b315af17a5c5, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:00.726746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecb23f-4d3c-4a34-b7a1-95eaf081df7c admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:00.752551 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 932/1878] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:00 2022] PUT /identity/v3/projects/321e3109e1054d39af73a4989091cb9a/users/596cfdc483024826a6c2b315af17a5c5/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:00.754171 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f5d85-112e-4671-8576-d70d4755d639 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:00.754467 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f5d85-112e-4671-8576-d70d4755d639 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:00.754759 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f5d85-112e-4671-8576-d70d4755d639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:00.808843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-988f5d85-112e-4671-8576-d70d4755d639 None None] MFA Rules not processed for user `596cfdc483024826a6c2b315af17a5c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:00.808843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:00.809475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-988f5d85-112e-4671-8576-d70d4755d639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:00.813626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 947/1879] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:00 2022] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:00.817875 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aff104-da22-44a4-9c19-e17d8b03f6db admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:00.839058 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aff104-da22-44a4-9c19-e17d8b03f6db admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:00.885685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:00.942473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 933/1880] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:00.954842 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f5d85-112e-4671-8576-d70d4755d639 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:00.956985 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-988f5d85-112e-4671-8576-d70d4755d639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:00.965752 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ba93d-4b9f-4795-881e-0745179eed6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:00.966564 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ba93d-4b9f-4795-881e-0745179eed6a admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:00.966782 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ba93d-4b9f-4795-881e-0745179eed6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:00.967072 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ba93d-4b9f-4795-881e-0745179eed6a admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:00.967796 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ba93d-4b9f-4795-881e-0745179eed6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:00.969459 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ba93d-4b9f-4795-881e-0745179eed6a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:00.983364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 948/1881] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:00.988421 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ba93d-4b9f-4795-881e-0745179eed6a admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:00.998895 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ba93d-4b9f-4795-881e-0745179eed6a admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:01.003998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa979a8-782a-4d27-8e7c-26928f9bb881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:01.004636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa979a8-782a-4d27-8e7c-26928f9bb881 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:01.004925 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa979a8-782a-4d27-8e7c-26928f9bb881 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:01.005184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa979a8-782a-4d27-8e7c-26928f9bb881 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:01.005943 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa979a8-782a-4d27-8e7c-26928f9bb881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:01.007939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa979a8-782a-4d27-8e7c-26928f9bb881 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:01.020807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 949/1882] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:01.025533 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa979a8-782a-4d27-8e7c-26928f9bb881 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:01.037126 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa979a8-782a-4d27-8e7c-26928f9bb881 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:01.042449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f5d85-112e-4671-8576-d70d4755d639 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:01.046442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd6aed-0fcc-45a8-8abc-c8d6786af9f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:01.047194 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd6aed-0fcc-45a8-8abc-c8d6786af9f8 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:01.047600 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd6aed-0fcc-45a8-8abc-c8d6786af9f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:01.047974 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd6aed-0fcc-45a8-8abc-c8d6786af9f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:01.053353 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7d82c-1868-4dda-a0c7-50b5ac9df6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:01.054060 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7d82c-1868-4dda-a0c7-50b5ac9df6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:01.054350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7d82c-1868-4dda-a0c7-50b5ac9df6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:01.054751 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7d82c-1868-4dda-a0c7-50b5ac9df6f5 admin admin] PATH_INFO: `/v3/projects/04f2d005122549cc8e72d901397b2b6d/users/48076560af3444ef8221b0c35eeaf881/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:01.060644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd6aed-0fcc-45a8-8abc-c8d6786af9f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:01.062321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd6aed-0fcc-45a8-8abc-c8d6786af9f8 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:01.076055 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7d82c-1868-4dda-a0c7-50b5ac9df6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f2d005122549cc8e72d901397b2b6d, user_id=48076560af3444ef8221b0c35eeaf881, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:01.078969 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7d82c-1868-4dda-a0c7-50b5ac9df6f5 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:01.087230 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 934/1883] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:01.088982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd6aed-0fcc-45a8-8abc-c8d6786af9f8 service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:01.091601 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b4cd6aed-0fcc-45a8-8abc-c8d6786af9f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:01.124278 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd6aed-0fcc-45a8-8abc-c8d6786af9f8 service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:01.133541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf307ea-bad4-4e5f-a6a8-3143e1d725c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:01.134788 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf307ea-bad4-4e5f-a6a8-3143e1d725c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:01.136280 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf307ea-bad4-4e5f-a6a8-3143e1d725c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:01.136280 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf307ea-bad4-4e5f-a6a8-3143e1d725c0 admin admin] PATH_INFO: `/v3/projects/1e7addf0ae3a43d0adf0d6dd551d8338` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:01.138188 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf307ea-bad4-4e5f-a6a8-3143e1d725c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e7addf0ae3a43d0adf0d6dd551d8338)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:01.142112 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf307ea-bad4-4e5f-a6a8-3143e1d725c0 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:01.161861 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 950/1884] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:01 2022] PUT /identity/v3/projects/04f2d005122549cc8e72d901397b2b6d/users/48076560af3444ef8221b0c35eeaf881/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:01.183172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe51eab-6f35-4e0e-ba65-e5a3ff9baad9 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:01.183496 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe51eab-6f35-4e0e-ba65-e5a3ff9baad9 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:01.183774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe51eab-6f35-4e0e-ba65-e5a3ff9baad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:01.233226 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-4fe51eab-6f35-4e0e-ba65-e5a3ff9baad9 None None] MFA Rules not processed for user `48076560af3444ef8221b0c35eeaf881`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:01.235108 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-4fe51eab-6f35-4e0e-ba65-e5a3ff9baad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:01.296608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-daf307ea-bad4-4e5f-a6a8-3143e1d725c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e7addf0ae3a43d0adf0d6dd551d8338', 'request_id': 'req-daf307ea-bad4-4e5f-a6a8-3143e1d725c0'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:01.304951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-daf307ea-bad4-4e5f-a6a8-3143e1d725c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e7addf0ae3a43d0adf0d6dd551d8338', 'request_id': 'req-daf307ea-bad4-4e5f-a6a8-3143e1d725c0'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:01.313113 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-daf307ea-bad4-4e5f-a6a8-3143e1d725c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e7addf0ae3a43d0adf0d6dd551d8338', 'request_id': 'req-daf307ea-bad4-4e5f-a6a8-3143e1d725c0'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:01.382673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 951/1885] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:01.382673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe51eab-6f35-4e0e-ba65-e5a3ff9baad9 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:01.393951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-daf307ea-bad4-4e5f-a6a8-3143e1d725c0 admin admin] The token cache is being invalidate because project 1e7addf0ae3a43d0adf0d6dd551d8338 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:01.398749 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-daf307ea-bad4-4e5f-a6a8-3143e1d725c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:01.398749 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-daf307ea-bad4-4e5f-a6a8-3143e1d725c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:01.398749 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 935/1886] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:01 2022] DELETE /identity/v3/projects/1e7addf0ae3a43d0adf0d6dd551d8338 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:01.398749 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf307ea-bad4-4e5f-a6a8-3143e1d725c0 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:01.399115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-daf307ea-bad4-4e5f-a6a8-3143e1d725c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:01.471621 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe51eab-6f35-4e0e-ba65-e5a3ff9baad9 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:01.481974 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf307ea-bad4-4e5f-a6a8-3143e1d725c0 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:01.487686 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ce19c-1b84-4130-a6d2-d911f692dafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:01.488419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ce19c-1b84-4130-a6d2-d911f692dafe admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:01.489062 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ce19c-1b84-4130-a6d2-d911f692dafe admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:01.489510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ce19c-1b84-4130-a6d2-d911f692dafe admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:01.490313 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ce19c-1b84-4130-a6d2-d911f692dafe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:01.492484 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ce19c-1b84-4130-a6d2-d911f692dafe admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:01.524112 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8b5c3-ad42-4684-90f2-fa6029b8ecf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:01.524779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8b5c3-ad42-4684-90f2-fa6029b8ecf5 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:01.525059 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8b5c3-ad42-4684-90f2-fa6029b8ecf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:01.525333 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8b5c3-ad42-4684-90f2-fa6029b8ecf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:01.527172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-cde8b5c3-ad42-4684-90f2-fa6029b8ecf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:01.593813 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8b5c3-ad42-4684-90f2-fa6029b8ecf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:01.596428 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8b5c3-ad42-4684-90f2-fa6029b8ecf5 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:01.610609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 952/1887] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:01 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:01.612782 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8b5c3-ad42-4684-90f2-fa6029b8ecf5 service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:01.614482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-cde8b5c3-ad42-4684-90f2-fa6029b8ecf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:01.619082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 936/1888] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:01 2022] POST /identity/v3/projects => generated 383 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:01.620089 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ce19c-1b84-4130-a6d2-d911f692dafe admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:01.636571 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8b5c3-ad42-4684-90f2-fa6029b8ecf5 service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:01.735013 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ce19c-1b84-4130-a6d2-d911f692dafe admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:01.740403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e7cc9-3c6e-4298-b197-cad880ca4b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:01.741280 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e7cc9-3c6e-4298-b197-cad880ca4b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:01.741565 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15ab3f-df82-4373-bb0a-b91d7f352ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:01.741741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e7cc9-3c6e-4298-b197-cad880ca4b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:01.742136 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e7cc9-3c6e-4298-b197-cad880ca4b21 admin admin] PATH_INFO: `/v3/users/048e27bc7bc5411db799a7eb7624bd8b` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:01.742659 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15ab3f-df82-4373-bb0a-b91d7f352ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:01.743154 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15ab3f-df82-4373-bb0a-b91d7f352ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:01.743633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e7cc9-3c6e-4298-b197-cad880ca4b21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=048e27bc7bc5411db799a7eb7624bd8b)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:01.743737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15ab3f-df82-4373-bb0a-b91d7f352ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:01.744997 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15ab3f-df82-4373-bb0a-b91d7f352ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:01.745860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e7cc9-3c6e-4298-b197-cad880ca4b21 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:01.749016 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15ab3f-df82-4373-bb0a-b91d7f352ce9 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:01.880378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 937/1889] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:01 2022] POST /identity/v3/users => generated 298 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:01.884666 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15ab3f-df82-4373-bb0a-b91d7f352ce9 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:01.896762 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15ab3f-df82-4373-bb0a-b91d7f352ce9 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:01.905064 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a582c62-1c44-426f-aeba-f32ca01912a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:01.905220 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a582c62-1c44-426f-aeba-f32ca01912a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:01.905759 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a582c62-1c44-426f-aeba-f32ca01912a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:01.906159 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a582c62-1c44-426f-aeba-f32ca01912a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:01.907406 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a582c62-1c44-426f-aeba-f32ca01912a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:01.910580 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a582c62-1c44-426f-aeba-f32ca01912a4 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:01.922924 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 938/1890] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:01.927563 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a582c62-1c44-426f-aeba-f32ca01912a4 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:01.938028 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a582c62-1c44-426f-aeba-f32ca01912a4 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:01.943561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d0ae6-3d66-4e16-9c76-361f48b9cc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:01.945360 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d0ae6-3d66-4e16-9c76-361f48b9cc53 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:01.945360 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d0ae6-3d66-4e16-9c76-361f48b9cc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:01.945360 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d0ae6-3d66-4e16-9c76-361f48b9cc53 admin admin] PATH_INFO: `/v3/projects/90c52bb6e63c4f0f9d01a5952c013332/users/4ceae1f7e4184b00897abed64923aaf8/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:01.975785 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d0ae6-3d66-4e16-9c76-361f48b9cc53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c52bb6e63c4f0f9d01a5952c013332, user_id=4ceae1f7e4184b00897abed64923aaf8, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:01.978807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d0ae6-3d66-4e16-9c76-361f48b9cc53 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:02.057518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-718e7cc9-3c6e-4298-b197-cad880ca4b21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048e27bc7bc5411db799a7eb7624bd8b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:02.058612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-718e7cc9-3c6e-4298-b197-cad880ca4b21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048e27bc7bc5411db799a7eb7624bd8b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:02.085792 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 939/1891] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:01 2022] PUT /identity/v3/projects/90c52bb6e63c4f0f9d01a5952c013332/users/4ceae1f7e4184b00897abed64923aaf8/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:02.090190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d0ae6-3d66-4e16-9c76-361f48b9cc53 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:02.162604 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-718e7cc9-3c6e-4298-b197-cad880ca4b21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048e27bc7bc5411db799a7eb7624bd8b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:02.181028 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-718e7cc9-3c6e-4298-b197-cad880ca4b21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048e27bc7bc5411db799a7eb7624bd8b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:02.192081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-718e7cc9-3c6e-4298-b197-cad880ca4b21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048e27bc7bc5411db799a7eb7624bd8b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:02.198647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d0ae6-3d66-4e16-9c76-361f48b9cc53 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:02.199428 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 953/1892] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:01 2022] DELETE /identity/v3/users/048e27bc7bc5411db799a7eb7624bd8b => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:02.313774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fb271-21db-4288-886a-c9af50d326e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:02.314515 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fb271-21db-4288-886a-c9af50d326e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:02.315088 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fb271-21db-4288-886a-c9af50d326e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:02.315187 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fb271-21db-4288-886a-c9af50d326e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:02.315907 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fb271-21db-4288-886a-c9af50d326e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:02.317620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fb271-21db-4288-886a-c9af50d326e1 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:02.331719 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 940/1893] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:02.336160 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e7cc9-3c6e-4298-b197-cad880ca4b21 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:02.337291 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-718e7cc9-3c6e-4298-b197-cad880ca4b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:02.351205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e7cc9-3c6e-4298-b197-cad880ca4b21 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:02.357108 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af587f-2f93-400c-bbc2-1cdf53fb58e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:02.358025 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af587f-2f93-400c-bbc2-1cdf53fb58e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:02.358336 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af587f-2f93-400c-bbc2-1cdf53fb58e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:02.358625 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af587f-2f93-400c-bbc2-1cdf53fb58e3 admin admin] PATH_INFO: `/v3/projects/90c52bb6e63c4f0f9d01a5952c013332/users/4ceae1f7e4184b00897abed64923aaf8/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:02.361073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af587f-2f93-400c-bbc2-1cdf53fb58e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c52bb6e63c4f0f9d01a5952c013332, user_id=4ceae1f7e4184b00897abed64923aaf8, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:02.364392 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af587f-2f93-400c-bbc2-1cdf53fb58e3 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:02.377650 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 954/1894] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:02 2022] PUT /identity/v3/projects/90c52bb6e63c4f0f9d01a5952c013332/users/4ceae1f7e4184b00897abed64923aaf8/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:02.414195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0672b8b-9072-4c6d-b809-be6489791241 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:02.414421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0672b8b-9072-4c6d-b809-be6489791241 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:02.414729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0672b8b-9072-4c6d-b809-be6489791241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:02.449546 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-c0672b8b-9072-4c6d-b809-be6489791241 None None] MFA Rules not processed for user `4ceae1f7e4184b00897abed64923aaf8`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:02.451379 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c0672b8b-9072-4c6d-b809-be6489791241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:02.534954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 941/1895] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:02.541354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af587f-2f93-400c-bbc2-1cdf53fb58e3 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:02.543092 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-52af587f-2f93-400c-bbc2-1cdf53fb58e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:02.616006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af587f-2f93-400c-bbc2-1cdf53fb58e3 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:02.630425 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08eb558-ec01-45ae-9cf0-a73d23c3838d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:02.631093 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eb558-ec01-45ae-9cf0-a73d23c3838d service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:02.631401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eb558-ec01-45ae-9cf0-a73d23c3838d service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:02.631831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eb558-ec01-45ae-9cf0-a73d23c3838d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:02.641962 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08eb558-ec01-45ae-9cf0-a73d23c3838d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:02.644388 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08eb558-ec01-45ae-9cf0-a73d23c3838d service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:02.655306 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 955/1896] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:03.524508 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0672b8b-9072-4c6d-b809-be6489791241 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:03.536364 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0672b8b-9072-4c6d-b809-be6489791241 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:03.542573 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0c379-1485-41bd-b5bd-74f2f1fa1418 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:03.543236 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0c379-1485-41bd-b5bd-74f2f1fa1418 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:03.545096 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0c379-1485-41bd-b5bd-74f2f1fa1418 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:03.545096 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0c379-1485-41bd-b5bd-74f2f1fa1418 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:03.547511 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-04c0c379-1485-41bd-b5bd-74f2f1fa1418 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:03.633059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0c379-1485-41bd-b5bd-74f2f1fa1418 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:03.634829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0c379-1485-41bd-b5bd-74f2f1fa1418 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:03.646945 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 942/1897] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:03.827472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08eb558-ec01-45ae-9cf0-a73d23c3838d service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:03.830646 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b08eb558-ec01-45ae-9cf0-a73d23c3838d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:04.052046 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08eb558-ec01-45ae-9cf0-a73d23c3838d service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:04.057441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51bf83-85c0-42d6-a60c-b46ced77aaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:04.058266 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51bf83-85c0-42d6-a60c-b46ced77aaac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:04.058557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51bf83-85c0-42d6-a60c-b46ced77aaac admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:04.058833 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51bf83-85c0-42d6-a60c-b46ced77aaac admin admin] PATH_INFO: `/v3/projects/5ed00f9e44304b0f99a9c810d5d092ff` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:04.060153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51bf83-85c0-42d6-a60c-b46ced77aaac admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed00f9e44304b0f99a9c810d5d092ff)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:04.062159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51bf83-85c0-42d6-a60c-b46ced77aaac admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:04.257584 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ad51bf83-85c0-42d6-a60c-b46ced77aaac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed00f9e44304b0f99a9c810d5d092ff', 'request_id': 'req-ad51bf83-85c0-42d6-a60c-b46ced77aaac'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:04.368413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ad51bf83-85c0-42d6-a60c-b46ced77aaac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed00f9e44304b0f99a9c810d5d092ff', 'request_id': 'req-ad51bf83-85c0-42d6-a60c-b46ced77aaac'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:04.387446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ad51bf83-85c0-42d6-a60c-b46ced77aaac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed00f9e44304b0f99a9c810d5d092ff', 'request_id': 'req-ad51bf83-85c0-42d6-a60c-b46ced77aaac'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:04.405203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ad51bf83-85c0-42d6-a60c-b46ced77aaac admin admin] The token cache is being invalidate because project 5ed00f9e44304b0f99a9c810d5d092ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:04.405498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ad51bf83-85c0-42d6-a60c-b46ced77aaac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:04.413840 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ad51bf83-85c0-42d6-a60c-b46ced77aaac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:04.413840 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 956/1898] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:03 2022] DELETE /identity/v3/projects/5ed00f9e44304b0f99a9c810d5d092ff => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:04.419016 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023621c8-bd04-4554-b64e-30b5ae809a1f None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:04.419310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023621c8-bd04-4554-b64e-30b5ae809a1f None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:04.419617 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023621c8-bd04-4554-b64e-30b5ae809a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:04.442947 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:04.462693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-023621c8-bd04-4554-b64e-30b5ae809a1f None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:04.465798 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-023621c8-bd04-4554-b64e-30b5ae809a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:04.571200 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 943/1899] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:04.578623 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143adbd-56b9-49f7-abaf-1c7bcae1523d None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:04.578907 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143adbd-56b9-49f7-abaf-1c7bcae1523d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:04.579190 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143adbd-56b9-49f7-abaf-1c7bcae1523d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:04.608340 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-e143adbd-56b9-49f7-abaf-1c7bcae1523d None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:04.609773 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e143adbd-56b9-49f7-abaf-1c7bcae1523d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:04.619703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 957/1900] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:04.623871 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:04.624749 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023621c8-bd04-4554-b64e-30b5ae809a1f None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:04.648764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023621c8-bd04-4554-b64e-30b5ae809a1f None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:04.664424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcd219-3222-4abd-864f-e2f60e7ef3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:04.664424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcd219-3222-4abd-864f-e2f60e7ef3cb admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:04.664424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcd219-3222-4abd-864f-e2f60e7ef3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:04.664424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcd219-3222-4abd-864f-e2f60e7ef3cb admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:04.664795 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcd219-3222-4abd-864f-e2f60e7ef3cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:03:04.664795 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcd219-3222-4abd-864f-e2f60e7ef3cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:04.664929 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcd219-3222-4abd-864f-e2f60e7ef3cb admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:04.679824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 944/1901] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:03:04.686230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143adbd-56b9-49f7-abaf-1c7bcae1523d None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:04.701649 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143adbd-56b9-49f7-abaf-1c7bcae1523d None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:04.713463 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df8d9f-f180-4be6-a9ed-9f661e198677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:04.714300 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df8d9f-f180-4be6-a9ed-9f661e198677 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:04.714734 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df8d9f-f180-4be6-a9ed-9f661e198677 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:04.715113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df8d9f-f180-4be6-a9ed-9f661e198677 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:04.715928 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df8d9f-f180-4be6-a9ed-9f661e198677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:04.718625 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df8d9f-f180-4be6-a9ed-9f661e198677 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:04.818583 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 958/1902] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:04 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:04.824913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcd219-3222-4abd-864f-e2f60e7ef3cb admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:04.836803 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcd219-3222-4abd-864f-e2f60e7ef3cb admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:04.911062 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b5524-786c-4717-a776-ca93b6e25373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:04.912060 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5524-786c-4717-a776-ca93b6e25373 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:04.912342 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5524-786c-4717-a776-ca93b6e25373 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:04.912616 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5524-786c-4717-a776-ca93b6e25373 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:04.913339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b5524-786c-4717-a776-ca93b6e25373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:04.915576 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b5524-786c-4717-a776-ca93b6e25373 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:05.000000 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df8d9f-f180-4be6-a9ed-9f661e198677 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:05.003869 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-34df8d9f-f180-4be6-a9ed-9f661e198677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:05.018668 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df8d9f-f180-4be6-a9ed-9f661e198677 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:05.026206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe19561-4de1-42d4-b7bb-a1cea1719319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:05.027063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe19561-4de1-42d4-b7bb-a1cea1719319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:05.027507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe19561-4de1-42d4-b7bb-a1cea1719319 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:05.027862 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe19561-4de1-42d4-b7bb-a1cea1719319 admin admin] PATH_INFO: `/v3/users/48076560af3444ef8221b0c35eeaf881` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:05.029704 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe19561-4de1-42d4-b7bb-a1cea1719319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48076560af3444ef8221b0c35eeaf881)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:05.032248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe19561-4de1-42d4-b7bb-a1cea1719319 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:05.038338 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 945/1903] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:04 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:05.042688 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b5524-786c-4717-a776-ca93b6e25373 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:05.055731 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b5524-786c-4717-a776-ca93b6e25373 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:05.061609 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73858eb-1007-4f5d-b615-e0175fed67a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:05.062657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73858eb-1007-4f5d-b615-e0175fed67a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:05.063094 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73858eb-1007-4f5d-b615-e0175fed67a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:05.063587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73858eb-1007-4f5d-b615-e0175fed67a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:05.064986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73858eb-1007-4f5d-b615-e0175fed67a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:05.066818 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73858eb-1007-4f5d-b615-e0175fed67a4 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:05.083892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 946/1904] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:05.086307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73858eb-1007-4f5d-b615-e0175fed67a4 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:05.108260 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73858eb-1007-4f5d-b615-e0175fed67a4 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:05.118025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c317c-3c4a-44f9-b7f5-41da3dfb2a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:05.118686 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c317c-3c4a-44f9-b7f5-41da3dfb2a10 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:05.118972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c317c-3c4a-44f9-b7f5-41da3dfb2a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:05.123469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c317c-3c4a-44f9-b7f5-41da3dfb2a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:05.124592 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c317c-3c4a-44f9-b7f5-41da3dfb2a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:05.128969 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c317c-3c4a-44f9-b7f5-41da3dfb2a10 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:05.149546 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 947/1905] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:05.152161 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c317c-3c4a-44f9-b7f5-41da3dfb2a10 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:05.176162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c317c-3c4a-44f9-b7f5-41da3dfb2a10 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:05.176162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e8ccd-b387-47b7-8b5c-e9594b22bb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:05.176162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e8ccd-b387-47b7-8b5c-e9594b22bb58 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:05.176162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e8ccd-b387-47b7-8b5c-e9594b22bb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:05.176596 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e8ccd-b387-47b7-8b5c-e9594b22bb58 admin admin] PATH_INFO: `/v3/projects/dc5f32efd1034668b92511b65159d4da/users/228ecbb831884c3a886d48cf918f57b0/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:05.190883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e8ccd-b387-47b7-8b5c-e9594b22bb58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5f32efd1034668b92511b65159d4da, user_id=228ecbb831884c3a886d48cf918f57b0, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:05.194209 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e8ccd-b387-47b7-8b5c-e9594b22bb58 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:05.308843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 948/1906] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:05 2022] PUT /identity/v3/projects/dc5f32efd1034668b92511b65159d4da/users/228ecbb831884c3a886d48cf918f57b0/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:05.315020 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-fbe19561-4de1-42d4-b7bb-a1cea1719319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48076560af3444ef8221b0c35eeaf881'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:05.315020 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-fbe19561-4de1-42d4-b7bb-a1cea1719319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48076560af3444ef8221b0c35eeaf881'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:05.321162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643b35b-f2da-411f-b213-751f70e2d537 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:05.321454 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643b35b-f2da-411f-b213-751f70e2d537 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:05.321732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643b35b-f2da-411f-b213-751f70e2d537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:05.357407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-e643b35b-f2da-411f-b213-751f70e2d537 None None] MFA Rules not processed for user `228ecbb831884c3a886d48cf918f57b0`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:05.358675 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e643b35b-f2da-411f-b213-751f70e2d537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:05.442800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 949/1907] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:05.447224 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643b35b-f2da-411f-b213-751f70e2d537 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:05.456510 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-fbe19561-4de1-42d4-b7bb-a1cea1719319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48076560af3444ef8221b0c35eeaf881'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:05.471252 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-fbe19561-4de1-42d4-b7bb-a1cea1719319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48076560af3444ef8221b0c35eeaf881'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:05.478659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-fbe19561-4de1-42d4-b7bb-a1cea1719319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48076560af3444ef8221b0c35eeaf881'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:05.484782 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 959/1908] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:04 2022] DELETE /identity/v3/users/48076560af3444ef8221b0c35eeaf881 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:05.489192 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b87278-24f8-4487-920f-1938db2b9a1b None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:05.489651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b87278-24f8-4487-920f-1938db2b9a1b None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:05.489930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b87278-24f8-4487-920f-1938db2b9a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:05.513527 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-71b87278-24f8-4487-920f-1938db2b9a1b None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:05.514764 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-71b87278-24f8-4487-920f-1938db2b9a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:05.529918 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643b35b-f2da-411f-b213-751f70e2d537 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:05.593050 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 960/1909] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:05.599924 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa38795-fcca-48d9-a3f2-841ecb4866d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:05.601122 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa38795-fcca-48d9-a3f2-841ecb4866d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:05.602267 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa38795-fcca-48d9-a3f2-841ecb4866d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:05.602767 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa38795-fcca-48d9-a3f2-841ecb4866d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:05.603521 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa38795-fcca-48d9-a3f2-841ecb4866d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:05.605967 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa38795-fcca-48d9-a3f2-841ecb4866d3 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:05.606173 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b87278-24f8-4487-920f-1938db2b9a1b None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:05.607692 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-71b87278-24f8-4487-920f-1938db2b9a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:05.680510 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b87278-24f8-4487-920f-1938db2b9a1b None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:05.685054 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478246bc-a082-485b-aa91-5d3fa88d98aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:05.685681 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478246bc-a082-485b-aa91-5d3fa88d98aa service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:05.685966 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478246bc-a082-485b-aa91-5d3fa88d98aa service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:05.686243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478246bc-a082-485b-aa91-5d3fa88d98aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:05.699955 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478246bc-a082-485b-aa91-5d3fa88d98aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:05.702374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478246bc-a082-485b-aa91-5d3fa88d98aa service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:05.717562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 961/1910] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:03:05.777519 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 950/1911] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:05 2022] POST /identity/v3/projects => generated 387 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:03:05.784992 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478246bc-a082-485b-aa91-5d3fa88d98aa service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:05.787197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-478246bc-a082-485b-aa91-5d3fa88d98aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:05.806663 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478246bc-a082-485b-aa91-5d3fa88d98aa service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:05.901236 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ebdf7-093a-45a2-aa40-e526f713bb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:05.901894 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ebdf7-093a-45a2-aa40-e526f713bb0f admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:05.902171 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ebdf7-093a-45a2-aa40-e526f713bb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:05.902444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ebdf7-093a-45a2-aa40-e526f713bb0f admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:05.903137 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ebdf7-093a-45a2-aa40-e526f713bb0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:05.905599 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ebdf7-093a-45a2-aa40-e526f713bb0f admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:06.051541 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 962/1912] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:05 2022] POST /identity/v3/users => generated 294 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:06.056587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa38795-fcca-48d9-a3f2-841ecb4866d3 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:06.078256 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa38795-fcca-48d9-a3f2-841ecb4866d3 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:06.089164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449720b-66a5-4bdb-851b-c4890d06ce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:06.090245 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449720b-66a5-4bdb-851b-c4890d06ce0e admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:06.091596 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449720b-66a5-4bdb-851b-c4890d06ce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:06.092963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449720b-66a5-4bdb-851b-c4890d06ce0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:06.094631 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449720b-66a5-4bdb-851b-c4890d06ce0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:06.098543 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449720b-66a5-4bdb-851b-c4890d06ce0e admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:06.133156 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 951/1913] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:06.137579 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ebdf7-093a-45a2-aa40-e526f713bb0f admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:06.154919 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ebdf7-093a-45a2-aa40-e526f713bb0f admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:06.164092 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357a3c4-2d2c-445c-8ac1-ef10ac736850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:06.164915 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357a3c4-2d2c-445c-8ac1-ef10ac736850 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:06.165501 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357a3c4-2d2c-445c-8ac1-ef10ac736850 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:06.165926 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357a3c4-2d2c-445c-8ac1-ef10ac736850 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:06.167113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357a3c4-2d2c-445c-8ac1-ef10ac736850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:06.170475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357a3c4-2d2c-445c-8ac1-ef10ac736850 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:06.185956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 963/1914] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:06.191473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449720b-66a5-4bdb-851b-c4890d06ce0e admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:06.206392 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449720b-66a5-4bdb-851b-c4890d06ce0e admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:06.218804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6dbeb-ff09-47aa-a220-3dbf9f0c3da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:06.218804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6dbeb-ff09-47aa-a220-3dbf9f0c3da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:06.218804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6dbeb-ff09-47aa-a220-3dbf9f0c3da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:06.218804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6dbeb-ff09-47aa-a220-3dbf9f0c3da0 admin admin] PATH_INFO: `/v3/projects/28eb31f8941744d1bdc3706726676082/users/e6976cef9d784233a4facc249c5f2028/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:06.240240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6dbeb-ff09-47aa-a220-3dbf9f0c3da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28eb31f8941744d1bdc3706726676082, user_id=e6976cef9d784233a4facc249c5f2028, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:06.244364 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6dbeb-ff09-47aa-a220-3dbf9f0c3da0 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:06.385797 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 952/1915] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:06 2022] PUT /identity/v3/projects/28eb31f8941744d1bdc3706726676082/users/e6976cef9d784233a4facc249c5f2028/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:06.395875 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adc04b-57b9-4372-89cd-1a980335b922 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:06.396349 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adc04b-57b9-4372-89cd-1a980335b922 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:06.396771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07adc04b-57b9-4372-89cd-1a980335b922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:06.441995 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6dbeb-ff09-47aa-a220-3dbf9f0c3da0 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:06.444010 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-fef6dbeb-ff09-47aa-a220-3dbf9f0c3da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:06.444145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-07adc04b-57b9-4372-89cd-1a980335b922 None None] MFA Rules not processed for user `e6976cef9d784233a4facc249c5f2028`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:06.445725 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-07adc04b-57b9-4372-89cd-1a980335b922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:06.561403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6dbeb-ff09-47aa-a220-3dbf9f0c3da0 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:06.575794 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a32ba-f6a4-49d3-8096-85ee829ebadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:06.576530 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a32ba-f6a4-49d3-8096-85ee829ebadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:06.577037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a32ba-f6a4-49d3-8096-85ee829ebadc admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:06.577462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a32ba-f6a4-49d3-8096-85ee829ebadc admin admin] PATH_INFO: `/v3/projects/04f2d005122549cc8e72d901397b2b6d` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:06.579071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a32ba-f6a4-49d3-8096-85ee829ebadc admin admin] RBAC: Authorizing `identity:delete_project(project_id=04f2d005122549cc8e72d901397b2b6d)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:06.582283 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a32ba-f6a4-49d3-8096-85ee829ebadc admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:06.587216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 964/1916] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:06.589276 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:06.591999 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adc04b-57b9-4372-89cd-1a980335b922 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:06.624851 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07adc04b-57b9-4372-89cd-1a980335b922 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:06.631144 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34289b0-3a1d-4644-81ef-5994adde9557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:06.631810 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34289b0-3a1d-4644-81ef-5994adde9557 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:06.632350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34289b0-3a1d-4644-81ef-5994adde9557 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:06.632765 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34289b0-3a1d-4644-81ef-5994adde9557 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:06.633434 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34289b0-3a1d-4644-81ef-5994adde9557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:06.635730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34289b0-3a1d-4644-81ef-5994adde9557 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:06.748961 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-504a32ba-f6a4-49d3-8096-85ee829ebadc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04f2d005122549cc8e72d901397b2b6d', 'request_id': 'req-504a32ba-f6a4-49d3-8096-85ee829ebadc'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:06.759363 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-504a32ba-f6a4-49d3-8096-85ee829ebadc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04f2d005122549cc8e72d901397b2b6d', 'request_id': 'req-504a32ba-f6a4-49d3-8096-85ee829ebadc'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:06.767399 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 965/1917] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:06 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:06.770707 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34289b0-3a1d-4644-81ef-5994adde9557 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:06.789026 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-504a32ba-f6a4-49d3-8096-85ee829ebadc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04f2d005122549cc8e72d901397b2b6d', 'request_id': 'req-504a32ba-f6a4-49d3-8096-85ee829ebadc'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:06.911978 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34289b0-3a1d-4644-81ef-5994adde9557 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:06.918435 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952d660-efb0-4b43-96bd-b9c9b2239bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:06.922090 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952d660-efb0-4b43-96bd-b9c9b2239bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:06.922090 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952d660-efb0-4b43-96bd-b9c9b2239bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:06.922090 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952d660-efb0-4b43-96bd-b9c9b2239bd4 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:06.922090 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952d660-efb0-4b43-96bd-b9c9b2239bd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:06.922491 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952d660-efb0-4b43-96bd-b9c9b2239bd4 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:06.924342 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-504a32ba-f6a4-49d3-8096-85ee829ebadc admin admin] The token cache is being invalidate because project 04f2d005122549cc8e72d901397b2b6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:06.925092 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-504a32ba-f6a4-49d3-8096-85ee829ebadc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:06.927141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-504a32ba-f6a4-49d3-8096-85ee829ebadc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:06.932164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 953/1918] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:06 2022] DELETE /identity/v3/projects/04f2d005122549cc8e72d901397b2b6d => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:06.935988 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64c671-a635-441b-9fc7-7ec821b1259b None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:06.936395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64c671-a635-441b-9fc7-7ec821b1259b None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:06.936740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64c671-a635-441b-9fc7-7ec821b1259b None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:06.938199 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 954/1919] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 28 04:03:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:03:06.938912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64c671-a635-441b-9fc7-7ec821b1259b None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:06.941748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-3c64c671-a635-441b-9fc7-7ec821b1259b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:06.959245 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64c671-a635-441b-9fc7-7ec821b1259b None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:06.964097 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19982f-1466-4ada-8dbb-e1f545883d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:06.964714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19982f-1466-4ada-8dbb-e1f545883d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:06.964992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19982f-1466-4ada-8dbb-e1f545883d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:06.965266 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19982f-1466-4ada-8dbb-e1f545883d96 admin admin] PATH_INFO: `/v3/users/4ceae1f7e4184b00897abed64923aaf8` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:06.966456 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19982f-1466-4ada-8dbb-e1f545883d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ceae1f7e4184b00897abed64923aaf8)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:06.968501 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19982f-1466-4ada-8dbb-e1f545883d96 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:07.045213 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 966/1920] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:06 2022] POST /identity/v3/users => generated 300 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:07.045213 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d84c97-92e8-4584-98bb-75ad0afee819 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:07.045213 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d84c97-92e8-4584-98bb-75ad0afee819 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:07.045213 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d84c97-92e8-4584-98bb-75ad0afee819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:07.069930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-a5d84c97-92e8-4584-98bb-75ad0afee819 None None] MFA Rules not processed for user `5133abf4c32a45b0b2188f71496c572b`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:07.071286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a5d84c97-92e8-4584-98bb-75ad0afee819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:07.163887 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 967/1921] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 28 04:03:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:07.165170 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d84c97-92e8-4584-98bb-75ad0afee819 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:07.166139 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a5d84c97-92e8-4584-98bb-75ad0afee819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:07.180751 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d84c97-92e8-4584-98bb-75ad0afee819 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:07.186123 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1d463-da32-442c-8754-5f6a8fc57dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:07.186865 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1d463-da32-442c-8754-5f6a8fc57dca admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:07.187224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1d463-da32-442c-8754-5f6a8fc57dca admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:07.187622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1d463-da32-442c-8754-5f6a8fc57dca admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:07.188440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1d463-da32-442c-8754-5f6a8fc57dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:07.190753 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1d463-da32-442c-8754-5f6a8fc57dca admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:07.202155 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 968/1922] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:07.203264 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1d463-da32-442c-8754-5f6a8fc57dca admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:07.206346 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e8a1d463-da32-442c-8754-5f6a8fc57dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:07.237849 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1d463-da32-442c-8754-5f6a8fc57dca admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:07.253948 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae63525-0418-46a8-b61a-188cce8ff7ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:07.253948 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae63525-0418-46a8-b61a-188cce8ff7ce service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:07.254293 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:07.254439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae63525-0418-46a8-b61a-188cce8ff7ce service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:07.254439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae63525-0418-46a8-b61a-188cce8ff7ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:07.275299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae63525-0418-46a8-b61a-188cce8ff7ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:07.277540 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae63525-0418-46a8-b61a-188cce8ff7ce service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:07.289398 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1a19982f-1466-4ada-8dbb-e1f545883d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ceae1f7e4184b00897abed64923aaf8'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:07.291640 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1a19982f-1466-4ada-8dbb-e1f545883d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ceae1f7e4184b00897abed64923aaf8'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:07.303556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 969/1923] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:07.305752 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae63525-0418-46a8-b61a-188cce8ff7ce service nova] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:07.327018 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae63525-0418-46a8-b61a-188cce8ff7ce service nova] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:07.336157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdea980-c021-4f46-b383-4e12a1e0c890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:07.337311 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdea980-c021-4f46-b383-4e12a1e0c890 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:07.337983 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdea980-c021-4f46-b383-4e12a1e0c890 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:07.338350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdea980-c021-4f46-b383-4e12a1e0c890 admin admin] PATH_INFO: `/v3/projects/b6be52630fa245edb741a3673d9ef0df/users/d78fda4043884c32ba554c68676895dc/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:07.367215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdea980-c021-4f46-b383-4e12a1e0c890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6be52630fa245edb741a3673d9ef0df, user_id=d78fda4043884c32ba554c68676895dc, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:07.372952 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdea980-c021-4f46-b383-4e12a1e0c890 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:07.394529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1a19982f-1466-4ada-8dbb-e1f545883d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ceae1f7e4184b00897abed64923aaf8'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:07.410349 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1a19982f-1466-4ada-8dbb-e1f545883d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ceae1f7e4184b00897abed64923aaf8'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:07.446409 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1a19982f-1466-4ada-8dbb-e1f545883d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ceae1f7e4184b00897abed64923aaf8'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:07.464145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 970/1925] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:07 2022] PUT /identity/v3/projects/b6be52630fa245edb741a3673d9ef0df/users/d78fda4043884c32ba554c68676895dc/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:07.466105 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 955/1925] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:06 2022] DELETE /identity/v3/users/4ceae1f7e4184b00897abed64923aaf8 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:07.468034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdea980-c021-4f46-b383-4e12a1e0c890 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:07.475807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-7cdea980-c021-4f46-b383-4e12a1e0c890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:07.570775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdea980-c021-4f46-b383-4e12a1e0c890 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:07.688084 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc0e9c-61db-461a-9014-7fb44b7682d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:07.689093 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc0e9c-61db-461a-9014-7fb44b7682d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:07.689237 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc0e9c-61db-461a-9014-7fb44b7682d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:07.689544 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc0e9c-61db-461a-9014-7fb44b7682d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:07.691349 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc0e9c-61db-461a-9014-7fb44b7682d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:07.693567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc0e9c-61db-461a-9014-7fb44b7682d7 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:07.715992 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 971/1926] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:07.718211 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19982f-1466-4ada-8dbb-e1f545883d96 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:07.731666 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19982f-1466-4ada-8dbb-e1f545883d96 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:07.743138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb9315-b13b-4e9c-a617-e91e89c5c6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:07.743880 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb9315-b13b-4e9c-a617-e91e89c5c6cc admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:07.744231 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb9315-b13b-4e9c-a617-e91e89c5c6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:07.744713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb9315-b13b-4e9c-a617-e91e89c5c6cc admin admin] PATH_INFO: `/v3/projects/b6be52630fa245edb741a3673d9ef0df/users/d78fda4043884c32ba554c68676895dc/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:07.770519 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb9315-b13b-4e9c-a617-e91e89c5c6cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6be52630fa245edb741a3673d9ef0df, user_id=d78fda4043884c32ba554c68676895dc, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:07.774836 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb9315-b13b-4e9c-a617-e91e89c5c6cc admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:07.802356 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 956/1927] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:07 2022] PUT /identity/v3/projects/b6be52630fa245edb741a3673d9ef0df/users/d78fda4043884c32ba554c68676895dc/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:07.816714 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c75336-c246-474f-ab30-0ec8dcd53358 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:07.819304 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c75336-c246-474f-ab30-0ec8dcd53358 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:07.821517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c75336-c246-474f-ab30-0ec8dcd53358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:07.921767 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-91c75336-c246-474f-ab30-0ec8dcd53358 None None] MFA Rules not processed for user `d78fda4043884c32ba554c68676895dc`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:07.923173 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-91c75336-c246-474f-ab30-0ec8dcd53358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:08.082320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 972/1928] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:08.113977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb9315-b13b-4e9c-a617-e91e89c5c6cc admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:08.116204 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c3cb9315-b13b-4e9c-a617-e91e89c5c6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:08.202137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb9315-b13b-4e9c-a617-e91e89c5c6cc admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:08.209195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abe717-a80e-4aa7-8787-9e1f26c513b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:08.209195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abe717-a80e-4aa7-8787-9e1f26c513b7 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:08.209195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abe717-a80e-4aa7-8787-9e1f26c513b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:08.209195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abe717-a80e-4aa7-8787-9e1f26c513b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:08.217401 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abe717-a80e-4aa7-8787-9e1f26c513b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:08.218938 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12abe717-a80e-4aa7-8787-9e1f26c513b7 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:08.237995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c75336-c246-474f-ab30-0ec8dcd53358 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:08.238401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-91c75336-c246-474f-ab30-0ec8dcd53358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:08.242556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 957/1929] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:08.356677 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:08.368472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c75336-c246-474f-ab30-0ec8dcd53358 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:08.387187 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb6d33-0244-4099-a876-6758e1267980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:08.387974 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb6d33-0244-4099-a876-6758e1267980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:08.388550 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb6d33-0244-4099-a876-6758e1267980 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:08.390139 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb6d33-0244-4099-a876-6758e1267980 admin admin] PATH_INFO: `/v3/projects/90c52bb6e63c4f0f9d01a5952c013332` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:08.394676 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb6d33-0244-4099-a876-6758e1267980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90c52bb6e63c4f0f9d01a5952c013332)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:08.398971 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb6d33-0244-4099-a876-6758e1267980 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:08.610744 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-0fbb6d33-0244-4099-a876-6758e1267980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90c52bb6e63c4f0f9d01a5952c013332', 'request_id': 'req-0fbb6d33-0244-4099-a876-6758e1267980'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:08.725206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-0fbb6d33-0244-4099-a876-6758e1267980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90c52bb6e63c4f0f9d01a5952c013332', 'request_id': 'req-0fbb6d33-0244-4099-a876-6758e1267980'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:08.732094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-0fbb6d33-0244-4099-a876-6758e1267980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90c52bb6e63c4f0f9d01a5952c013332', 'request_id': 'req-0fbb6d33-0244-4099-a876-6758e1267980'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:08.749768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-0fbb6d33-0244-4099-a876-6758e1267980 admin admin] The token cache is being invalidate because project 90c52bb6e63c4f0f9d01a5952c013332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:08.750079 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-0fbb6d33-0244-4099-a876-6758e1267980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:08.750845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-0fbb6d33-0244-4099-a876-6758e1267980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:08.753216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 973/1930] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:08 2022] DELETE /identity/v3/projects/90c52bb6e63c4f0f9d01a5952c013332 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:08.758878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9f1b1-410b-4bba-a7dc-b45b1c65da21 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:08.758878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9f1b1-410b-4bba-a7dc-b45b1c65da21 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:08.759050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9f1b1-410b-4bba-a7dc-b45b1c65da21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:08.787608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-b1c9f1b1-410b-4bba-a7dc-b45b1c65da21 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:08.791107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b1c9f1b1-410b-4bba-a7dc-b45b1c65da21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:08.881409 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 958/1931] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:08.890477 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165f934-e99c-44f8-b7cb-6744d4426c26 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:08.892847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165f934-e99c-44f8-b7cb-6744d4426c26 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:08.897119 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165f934-e99c-44f8-b7cb-6744d4426c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:08.919686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-2165f934-e99c-44f8-b7cb-6744d4426c26 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:08.920951 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-2165f934-e99c-44f8-b7cb-6744d4426c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:08.930446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 974/1932] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:08.934819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9f1b1-410b-4bba-a7dc-b45b1c65da21 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:08.946122 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9f1b1-410b-4bba-a7dc-b45b1c65da21 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:08.953576 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ba5d3-22b0-4269-b3d4-78912f2c08b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:08.954374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ba5d3-22b0-4269-b3d4-78912f2c08b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:08.955416 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ba5d3-22b0-4269-b3d4-78912f2c08b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:08.956031 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ba5d3-22b0-4269-b3d4-78912f2c08b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:08.956785 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ba5d3-22b0-4269-b3d4-78912f2c08b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:03:08.957094 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ba5d3-22b0-4269-b3d4-78912f2c08b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:08.959155 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ba5d3-22b0-4269-b3d4-78912f2c08b2 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:08.975607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 959/1933] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:03:08.977751 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165f934-e99c-44f8-b7cb-6744d4426c26 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:08.988462 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165f934-e99c-44f8-b7cb-6744d4426c26 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:08.993447 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dbfe8-4103-4a45-99c2-f427466c734c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:08.995850 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dbfe8-4103-4a45-99c2-f427466c734c admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:08.995850 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dbfe8-4103-4a45-99c2-f427466c734c admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:08.995850 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dbfe8-4103-4a45-99c2-f427466c734c admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:08.995850 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258dbfe8-4103-4a45-99c2-f427466c734c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:08.997554 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258dbfe8-4103-4a45-99c2-f427466c734c admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:09.158004 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 975/1934] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:08 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:03:09.162470 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ba5d3-22b0-4269-b3d4-78912f2c08b2 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:09.173383 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ba5d3-22b0-4269-b3d4-78912f2c08b2 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:09.245734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5f1b2-5c1d-4f4f-816d-38af39932d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:09.246428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5f1b2-5c1d-4f4f-816d-38af39932d3a admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:09.246801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5f1b2-5c1d-4f4f-816d-38af39932d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:09.247163 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5f1b2-5c1d-4f4f-816d-38af39932d3a admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:09.248178 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5f1b2-5c1d-4f4f-816d-38af39932d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:09.250372 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5f1b2-5c1d-4f4f-816d-38af39932d3a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:09.390239 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 960/1935] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:09 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:03:09.391577 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dbfe8-4103-4a45-99c2-f427466c734c admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:09.403904 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dbfe8-4103-4a45-99c2-f427466c734c admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:09.415164 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211dcae-9116-4a2e-acd2-9bd060336113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:09.417333 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211dcae-9116-4a2e-acd2-9bd060336113 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:09.417333 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211dcae-9116-4a2e-acd2-9bd060336113 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:09.417333 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211dcae-9116-4a2e-acd2-9bd060336113 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:09.417732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211dcae-9116-4a2e-acd2-9bd060336113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:09.419430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211dcae-9116-4a2e-acd2-9bd060336113 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:09.434917 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 976/1936] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:09.436386 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5f1b2-5c1d-4f4f-816d-38af39932d3a admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:09.437205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211dcae-9116-4a2e-acd2-9bd060336113 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:09.439626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c211dcae-9116-4a2e-acd2-9bd060336113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:09.449742 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5f1b2-5c1d-4f4f-816d-38af39932d3a admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:09.456820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211dcae-9116-4a2e-acd2-9bd060336113 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:09.458372 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f3daa-97bc-4eab-a00b-a74d364e635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:09.459047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f3daa-97bc-4eab-a00b-a74d364e635a admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:09.459364 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f3daa-97bc-4eab-a00b-a74d364e635a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:09.459682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f3daa-97bc-4eab-a00b-a74d364e635a admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:09.460832 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f3daa-97bc-4eab-a00b-a74d364e635a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:09.462619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f3daa-97bc-4eab-a00b-a74d364e635a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:09.462882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37429a7-10b1-4ef0-b728-3f2d7fe4b24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:09.463708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37429a7-10b1-4ef0-b728-3f2d7fe4b24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:09.464164 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37429a7-10b1-4ef0-b728-3f2d7fe4b24d admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:09.464541 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37429a7-10b1-4ef0-b728-3f2d7fe4b24d admin admin] PATH_INFO: `/v3/users/4dbe96e33792428aa75227264be32a2c` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:09.466325 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37429a7-10b1-4ef0-b728-3f2d7fe4b24d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dbe96e33792428aa75227264be32a2c)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:09.468699 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37429a7-10b1-4ef0-b728-3f2d7fe4b24d admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:09.493935 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 961/1937] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:09.498600 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f3daa-97bc-4eab-a00b-a74d364e635a admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:09.519463 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f3daa-97bc-4eab-a00b-a74d364e635a admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:09.524990 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a974f83-2d6f-4359-bf91-b6beb6853e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:09.525808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a974f83-2d6f-4359-bf91-b6beb6853e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:09.526183 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a974f83-2d6f-4359-bf91-b6beb6853e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:09.526552 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a974f83-2d6f-4359-bf91-b6beb6853e7f admin admin] PATH_INFO: `/v3/projects/f7108b459e94479c9660b5830f758cd7/users/e412d68bcabf45278868022cff8a7214/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:09.544359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a974f83-2d6f-4359-bf91-b6beb6853e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7108b459e94479c9660b5830f758cd7, user_id=e412d68bcabf45278868022cff8a7214, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:09.547368 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a974f83-2d6f-4359-bf91-b6beb6853e7f admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:09.651868 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 962/1938] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:09 2022] PUT /identity/v3/projects/f7108b459e94479c9660b5830f758cd7/users/e412d68bcabf45278868022cff8a7214/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:09.668503 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b19141-4edc-480a-81f5-25145a858872 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:09.668932 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b19141-4edc-480a-81f5-25145a858872 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:09.669290 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b19141-4edc-480a-81f5-25145a858872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:09.710908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-a3b19141-4edc-480a-81f5-25145a858872 None None] MFA Rules not processed for user `e412d68bcabf45278868022cff8a7214`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:09.712197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a3b19141-4edc-480a-81f5-25145a858872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:09.797448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b37429a7-10b1-4ef0-b728-3f2d7fe4b24d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dbe96e33792428aa75227264be32a2c'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:09.798147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b37429a7-10b1-4ef0-b728-3f2d7fe4b24d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dbe96e33792428aa75227264be32a2c'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:09.814740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 963/1939] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:09.820733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b19141-4edc-480a-81f5-25145a858872 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:09.928934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b37429a7-10b1-4ef0-b728-3f2d7fe4b24d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dbe96e33792428aa75227264be32a2c'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:09.942433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b19141-4edc-480a-81f5-25145a858872 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:09.956472 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c19f0c-e24c-4c7e-bb47-0fc084420e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:09.962840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c19f0c-e24c-4c7e-bb47-0fc084420e74 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:09.962840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c19f0c-e24c-4c7e-bb47-0fc084420e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:09.962840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c19f0c-e24c-4c7e-bb47-0fc084420e74 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:09.962840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c19f0c-e24c-4c7e-bb47-0fc084420e74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:09.968475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c19f0c-e24c-4c7e-bb47-0fc084420e74 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:09.968562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b37429a7-10b1-4ef0-b728-3f2d7fe4b24d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dbe96e33792428aa75227264be32a2c'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:09.985541 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b37429a7-10b1-4ef0-b728-3f2d7fe4b24d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dbe96e33792428aa75227264be32a2c'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:09.995580 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 977/1940] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:09 2022] DELETE /identity/v3/users/4dbe96e33792428aa75227264be32a2c => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:10.004824 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a81882-2294-4c6a-b0e9-13b7ed34a75b None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:10.005185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a81882-2294-4c6a-b0e9-13b7ed34a75b None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:10.005728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a81882-2294-4c6a-b0e9-13b7ed34a75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:10.039248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-e2a81882-2294-4c6a-b0e9-13b7ed34a75b None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:10.043967 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e2a81882-2294-4c6a-b0e9-13b7ed34a75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:10.066499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:10.081156 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 964/1941] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:09 2022] POST /identity/v3/projects => generated 375 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:03:10.082189 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c19f0c-e24c-4c7e-bb47-0fc084420e74 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:10.087111 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-08c19f0c-e24c-4c7e-bb47-0fc084420e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:10.175280 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 978/1942] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:10.181096 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c19f0c-e24c-4c7e-bb47-0fc084420e74 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:10.186869 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c2f4f-3a3a-49bb-a58e-6e7d6bb8e678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:10.187816 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c2f4f-3a3a-49bb-a58e-6e7d6bb8e678 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:10.188250 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c2f4f-3a3a-49bb-a58e-6e7d6bb8e678 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:10.188673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c2f4f-3a3a-49bb-a58e-6e7d6bb8e678 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:10.190105 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c2f4f-3a3a-49bb-a58e-6e7d6bb8e678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:10.192504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a81882-2294-4c6a-b0e9-13b7ed34a75b None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:10.193222 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c2f4f-3a3a-49bb-a58e-6e7d6bb8e678 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:10.194370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e2a81882-2294-4c6a-b0e9-13b7ed34a75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:10.299198 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a81882-2294-4c6a-b0e9-13b7ed34a75b None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:10.305482 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 965/1943] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:10 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:10.305482 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c2f4f-3a3a-49bb-a58e-6e7d6bb8e678 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:10.305482 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-676c2f4f-3a3a-49bb-a58e-6e7d6bb8e678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:10.393677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c2f4f-3a3a-49bb-a58e-6e7d6bb8e678 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:10.394631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5886c-426a-471d-b47c-cb9dc8badf65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:10.395469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5886c-426a-471d-b47c-cb9dc8badf65 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:10.395861 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5886c-426a-471d-b47c-cb9dc8badf65 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:10.396241 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5886c-426a-471d-b47c-cb9dc8badf65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:10.398142 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227f3de-161d-4173-a7cc-3e4e53ec0006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:10.398809 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227f3de-161d-4173-a7cc-3e4e53ec0006 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:10.399440 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227f3de-161d-4173-a7cc-3e4e53ec0006 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:10.399787 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227f3de-161d-4173-a7cc-3e4e53ec0006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:10.401690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-5227f3de-161d-4173-a7cc-3e4e53ec0006 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:10.409684 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5886c-426a-471d-b47c-cb9dc8badf65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:10.412063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5886c-426a-471d-b47c-cb9dc8badf65 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:10.427476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 979/1944] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:03:10.429059 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5886c-426a-471d-b47c-cb9dc8badf65 service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:10.444925 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5886c-426a-471d-b47c-cb9dc8badf65 service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:10.452264 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8c9d5-fba8-44a4-b87b-f693c74dc7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:10.453084 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8c9d5-fba8-44a4-b87b-f693c74dc7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:10.453508 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8c9d5-fba8-44a4-b87b-f693c74dc7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:10.454038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8c9d5-fba8-44a4-b87b-f693c74dc7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:10.454956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8c9d5-fba8-44a4-b87b-f693c74dc7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:10.457459 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8c9d5-fba8-44a4-b87b-f693c74dc7d5 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:10.479801 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 980/1945] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:10.481131 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8c9d5-fba8-44a4-b87b-f693c74dc7d5 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:10.488733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227f3de-161d-4173-a7cc-3e4e53ec0006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:10.490470 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227f3de-161d-4173-a7cc-3e4e53ec0006 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:10.498653 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8c9d5-fba8-44a4-b87b-f693c74dc7d5 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:10.504273 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 966/1946] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:10.506247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd486f-c921-4ac9-bf49-41c59462a7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:10.507468 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd486f-c921-4ac9-bf49-41c59462a7cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:10.507757 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd486f-c921-4ac9-bf49-41c59462a7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:10.508039 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd486f-c921-4ac9-bf49-41c59462a7cb admin admin] PATH_INFO: `/v3/projects/c712c7e0b43a43b4914df6cb57687829/users/e3e464aa6ee04a4b9ac7d9cfc8a4af7f/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:10.534409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd486f-c921-4ac9-bf49-41c59462a7cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c712c7e0b43a43b4914df6cb57687829, user_id=e3e464aa6ee04a4b9ac7d9cfc8a4af7f, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:10.538766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd486f-c921-4ac9-bf49-41c59462a7cb admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:10.654248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 981/1947] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:10 2022] PUT /identity/v3/projects/c712c7e0b43a43b4914df6cb57687829/users/e3e464aa6ee04a4b9ac7d9cfc8a4af7f/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:10.655565 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227f3de-161d-4173-a7cc-3e4e53ec0006 service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:10.669556 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227f3de-161d-4173-a7cc-3e4e53ec0006 service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:10.744369 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8ae8d-d08b-4223-aa82-7c2e3b4b17b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:10.745001 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8ae8d-d08b-4223-aa82-7c2e3b4b17b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:10.745285 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8ae8d-d08b-4223-aa82-7c2e3b4b17b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:10.745561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8ae8d-d08b-4223-aa82-7c2e3b4b17b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:10.746266 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8ae8d-d08b-4223-aa82-7c2e3b4b17b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:10.747917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8ae8d-d08b-4223-aa82-7c2e3b4b17b2 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:10.759924 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 967/1948] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:10.765734 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd486f-c921-4ac9-bf49-41c59462a7cb admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:10.780094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd486f-c921-4ac9-bf49-41c59462a7cb admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:10.787628 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608152e-4eb8-421c-9f31-ef62d8e3e600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:10.788470 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608152e-4eb8-421c-9f31-ef62d8e3e600 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:10.788850 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608152e-4eb8-421c-9f31-ef62d8e3e600 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:10.789220 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608152e-4eb8-421c-9f31-ef62d8e3e600 admin admin] PATH_INFO: `/v3/projects/c712c7e0b43a43b4914df6cb57687829/users/e3e464aa6ee04a4b9ac7d9cfc8a4af7f/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:10.791409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608152e-4eb8-421c-9f31-ef62d8e3e600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c712c7e0b43a43b4914df6cb57687829, user_id=e3e464aa6ee04a4b9ac7d9cfc8a4af7f, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:10.794223 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608152e-4eb8-421c-9f31-ef62d8e3e600 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:10.808388 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 982/1949] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:10 2022] PUT /identity/v3/projects/c712c7e0b43a43b4914df6cb57687829/users/e3e464aa6ee04a4b9ac7d9cfc8a4af7f/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:10.832714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a59a4-4d2f-4b4a-808d-4480fef29e41 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:10.833289 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a59a4-4d2f-4b4a-808d-4480fef29e41 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:10.833703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a59a4-4d2f-4b4a-808d-4480fef29e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:10.885089 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-674a59a4-4d2f-4b4a-808d-4480fef29e41 None None] MFA Rules not processed for user `e3e464aa6ee04a4b9ac7d9cfc8a4af7f`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:10.886668 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-674a59a4-4d2f-4b4a-808d-4480fef29e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:11.025299 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 968/1950] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:11.173345 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608152e-4eb8-421c-9f31-ef62d8e3e600 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:11.175476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e608152e-4eb8-421c-9f31-ef62d8e3e600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:11.263804 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608152e-4eb8-421c-9f31-ef62d8e3e600 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:11.271264 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2f383-fe20-4a73-9460-18ff9c626a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:11.272164 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2f383-fe20-4a73-9460-18ff9c626a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:11.272531 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2f383-fe20-4a73-9460-18ff9c626a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:11.277647 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2f383-fe20-4a73-9460-18ff9c626a61 admin admin] PATH_INFO: `/v3/projects/eeabe2277acd4a2c961e650dbcacd84f` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:11.277647 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2f383-fe20-4a73-9460-18ff9c626a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeabe2277acd4a2c961e650dbcacd84f)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:11.277647 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2f383-fe20-4a73-9460-18ff9c626a61 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:11.278377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a59a4-4d2f-4b4a-808d-4480fef29e41 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:11.280218 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-674a59a4-4d2f-4b4a-808d-4480fef29e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:11.365148 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a59a4-4d2f-4b4a-808d-4480fef29e41 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:11.371490 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:11.374816 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da7e52-7684-40e9-b90e-a37f8c8ab289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:11.377686 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da7e52-7684-40e9-b90e-a37f8c8ab289 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:11.378254 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da7e52-7684-40e9-b90e-a37f8c8ab289 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:11.378765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da7e52-7684-40e9-b90e-a37f8c8ab289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:11.382275 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c4da7e52-7684-40e9-b90e-a37f8c8ab289 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:11.418995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-53d2f383-fe20-4a73-9460-18ff9c626a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeabe2277acd4a2c961e650dbcacd84f', 'request_id': 'req-53d2f383-fe20-4a73-9460-18ff9c626a61'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:11.485184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da7e52-7684-40e9-b90e-a37f8c8ab289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:11.487470 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da7e52-7684-40e9-b90e-a37f8c8ab289 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:11.500380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 969/1951] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:11.565807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-53d2f383-fe20-4a73-9460-18ff9c626a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeabe2277acd4a2c961e650dbcacd84f', 'request_id': 'req-53d2f383-fe20-4a73-9460-18ff9c626a61'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:11.581588 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-53d2f383-fe20-4a73-9460-18ff9c626a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeabe2277acd4a2c961e650dbcacd84f', 'request_id': 'req-53d2f383-fe20-4a73-9460-18ff9c626a61'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:11.607679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-53d2f383-fe20-4a73-9460-18ff9c626a61 admin admin] The token cache is being invalidate because project eeabe2277acd4a2c961e650dbcacd84f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:11.607679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-53d2f383-fe20-4a73-9460-18ff9c626a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:11.607679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-53d2f383-fe20-4a73-9460-18ff9c626a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:11.607679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 983/1952] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:11 2022] DELETE /identity/v3/projects/eeabe2277acd4a2c961e650dbcacd84f => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:11.608769 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da7e52-7684-40e9-b90e-a37f8c8ab289 service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:11.622354 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da7e52-7684-40e9-b90e-a37f8c8ab289 service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:11.739193 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3966b5b-00a0-4e88-bb08-c5d633ed1bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:11.739971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3966b5b-00a0-4e88-bb08-c5d633ed1bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:11.740676 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3966b5b-00a0-4e88-bb08-c5d633ed1bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:11.740676 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3966b5b-00a0-4e88-bb08-c5d633ed1bf8 admin admin] PATH_INFO: `/v3/users/1531699bcd2b490b8220b7d856e5ad22` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:11.742198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3966b5b-00a0-4e88-bb08-c5d633ed1bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1531699bcd2b490b8220b7d856e5ad22)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:11.745154 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3966b5b-00a0-4e88-bb08-c5d633ed1bf8 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:11.989412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-a3966b5b-00a0-4e88-bb08-c5d633ed1bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1531699bcd2b490b8220b7d856e5ad22'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:11.990433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-a3966b5b-00a0-4e88-bb08-c5d633ed1bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1531699bcd2b490b8220b7d856e5ad22'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:12.125980 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-a3966b5b-00a0-4e88-bb08-c5d633ed1bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1531699bcd2b490b8220b7d856e5ad22'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:12.152122 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-a3966b5b-00a0-4e88-bb08-c5d633ed1bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1531699bcd2b490b8220b7d856e5ad22'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:12.179126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-a3966b5b-00a0-4e88-bb08-c5d633ed1bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1531699bcd2b490b8220b7d856e5ad22'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:12.190132 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 970/1953] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:11 2022] DELETE /identity/v3/users/1531699bcd2b490b8220b7d856e5ad22 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:12.762880 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:13.312673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2f383-fe20-4a73-9460-18ff9c626a61 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:13.314323 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-53d2f383-fe20-4a73-9460-18ff9c626a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:13.349922 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2f383-fe20-4a73-9460-18ff9c626a61 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:13.447262 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3966b5b-00a0-4e88-bb08-c5d633ed1bf8 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:13.449415 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a3966b5b-00a0-4e88-bb08-c5d633ed1bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:13.453438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324bb78-6089-4f45-bedd-f422f68133b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:13.454227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324bb78-6089-4f45-bedd-f422f68133b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:13.454661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324bb78-6089-4f45-bedd-f422f68133b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:13.455017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324bb78-6089-4f45-bedd-f422f68133b3 admin admin] PATH_INFO: `/v3/users/4e557d6cc2b54322aca358a811e56548` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:13.456265 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324bb78-6089-4f45-bedd-f422f68133b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e557d6cc2b54322aca358a811e56548)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:13.458268 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324bb78-6089-4f45-bedd-f422f68133b3 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:13.469748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3966b5b-00a0-4e88-bb08-c5d633ed1bf8 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:13.484884 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf362896-cb76-4224-bb40-05e2e9c870dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:13.487077 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf362896-cb76-4224-bb40-05e2e9c870dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:13.487627 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf362896-cb76-4224-bb40-05e2e9c870dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:13.488413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf362896-cb76-4224-bb40-05e2e9c870dd admin admin] PATH_INFO: `/v3/projects/197c2418a7784b37b603a483b3142165` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:13.491550 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf362896-cb76-4224-bb40-05e2e9c870dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=197c2418a7784b37b603a483b3142165)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:13.494450 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf362896-cb76-4224-bb40-05e2e9c870dd admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:13.739713 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:13.764149 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-bf362896-cb76-4224-bb40-05e2e9c870dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '197c2418a7784b37b603a483b3142165', 'request_id': 'req-bf362896-cb76-4224-bb40-05e2e9c870dd'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:13.765527 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-a324bb78-6089-4f45-bedd-f422f68133b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e557d6cc2b54322aca358a811e56548'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:13.766345 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-a324bb78-6089-4f45-bedd-f422f68133b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e557d6cc2b54322aca358a811e56548'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:13.773654 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-bf362896-cb76-4224-bb40-05e2e9c870dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '197c2418a7784b37b603a483b3142165', 'request_id': 'req-bf362896-cb76-4224-bb40-05e2e9c870dd'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:13.781673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-bf362896-cb76-4224-bb40-05e2e9c870dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '197c2418a7784b37b603a483b3142165', 'request_id': 'req-bf362896-cb76-4224-bb40-05e2e9c870dd'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:13.880086 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-a324bb78-6089-4f45-bedd-f422f68133b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e557d6cc2b54322aca358a811e56548'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:13.902566 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-a324bb78-6089-4f45-bedd-f422f68133b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e557d6cc2b54322aca358a811e56548'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:13.910961 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-a324bb78-6089-4f45-bedd-f422f68133b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e557d6cc2b54322aca358a811e56548'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:13.917710 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 984/1954] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:13 2022] DELETE /identity/v3/users/4e557d6cc2b54322aca358a811e56548 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:13.926873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e7ac8-946b-43eb-8155-5330a0cde8d6 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:13.927404 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e7ac8-946b-43eb-8155-5330a0cde8d6 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:13.927697 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e7ac8-946b-43eb-8155-5330a0cde8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:13.959914 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-bf362896-cb76-4224-bb40-05e2e9c870dd admin admin] The token cache is being invalidate because project 197c2418a7784b37b603a483b3142165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:13.965765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-bf362896-cb76-4224-bb40-05e2e9c870dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:13.965765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-bf362896-cb76-4224-bb40-05e2e9c870dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:13.965765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 971/1955] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:13 2022] DELETE /identity/v3/projects/197c2418a7784b37b603a483b3142165 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:13.966201 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-aa7e7ac8-946b-43eb-8155-5330a0cde8d6 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:13.970026 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83fb8b-bce7-483d-8f45-8e9701ceadfd None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:13.970355 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83fb8b-bce7-483d-8f45-8e9701ceadfd None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:13.970632 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83fb8b-bce7-483d-8f45-8e9701ceadfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:13.973638 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-aa7e7ac8-946b-43eb-8155-5330a0cde8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:13.999081 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-aa83fb8b-bce7-483d-8f45-8e9701ceadfd None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:14.000268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-aa83fb8b-bce7-483d-8f45-8e9701ceadfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:14.081920 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 972/1956] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:14.084155 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b9564-717d-4bcb-8d00-78f727df3ba0 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:14.084666 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b9564-717d-4bcb-8d00-78f727df3ba0 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:14.084959 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b9564-717d-4bcb-8d00-78f727df3ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:14.087855 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 985/1957] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:14.113516 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-576b9564-717d-4bcb-8d00-78f727df3ba0 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:14.114424 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e7ac8-946b-43eb-8155-5330a0cde8d6 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:14.114938 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-576b9564-717d-4bcb-8d00-78f727df3ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:14.117357 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-aa7e7ac8-946b-43eb-8155-5330a0cde8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:14.126777 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 973/1958] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:14.139280 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b9564-717d-4bcb-8d00-78f727df3ba0 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:14.150219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b9564-717d-4bcb-8d00-78f727df3ba0 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:14.170007 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb916de-4383-41a5-bb43-b70c8ac1bc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:14.175683 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb916de-4383-41a5-bb43-b70c8ac1bc30 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:14.176101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb916de-4383-41a5-bb43-b70c8ac1bc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:14.176385 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb916de-4383-41a5-bb43-b70c8ac1bc30 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:14.177135 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb916de-4383-41a5-bb43-b70c8ac1bc30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:03:14.177443 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb916de-4383-41a5-bb43-b70c8ac1bc30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:14.180023 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb916de-4383-41a5-bb43-b70c8ac1bc30 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:14.201546 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 974/1959] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:03:14.202794 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb916de-4383-41a5-bb43-b70c8ac1bc30 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:14.209031 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e7ac8-946b-43eb-8155-5330a0cde8d6 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:14.215347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9af56-7d9b-4ba2-ae6d-92c5be0d7b8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:14.216045 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9af56-7d9b-4ba2-ae6d-92c5be0d7b8e service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:14.216326 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9af56-7d9b-4ba2-ae6d-92c5be0d7b8e service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:14.216492 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb916de-4383-41a5-bb43-b70c8ac1bc30 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:14.216670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9af56-7d9b-4ba2-ae6d-92c5be0d7b8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:14.222166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59426de-f59a-4528-b943-ac458916d836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:14.222815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59426de-f59a-4528-b943-ac458916d836 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:14.223090 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59426de-f59a-4528-b943-ac458916d836 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:14.223621 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59426de-f59a-4528-b943-ac458916d836 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:14.224263 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59426de-f59a-4528-b943-ac458916d836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:14.226258 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59426de-f59a-4528-b943-ac458916d836 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:14.229715 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9af56-7d9b-4ba2-ae6d-92c5be0d7b8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:14.231174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9af56-7d9b-4ba2-ae6d-92c5be0d7b8e service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:14.243277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 986/1960] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:03:14.399484 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 975/1961] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:14 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:14.400791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9af56-7d9b-4ba2-ae6d-92c5be0d7b8e service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:14.411573 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9af56-7d9b-4ba2-ae6d-92c5be0d7b8e service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:14.552827 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f5f3b-dbf6-40ff-b7b6-c08afc1403f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:14.553494 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f5f3b-dbf6-40ff-b7b6-c08afc1403f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:14.553778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f5f3b-dbf6-40ff-b7b6-c08afc1403f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:14.554259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f5f3b-dbf6-40ff-b7b6-c08afc1403f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:14.555145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f5f3b-dbf6-40ff-b7b6-c08afc1403f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:14.557333 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f5f3b-dbf6-40ff-b7b6-c08afc1403f2 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:14.685555 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 987/1962] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:14 2022] POST /identity/v3/users => generated 290 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:14.690352 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59426de-f59a-4528-b943-ac458916d836 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:14.704562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59426de-f59a-4528-b943-ac458916d836 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:14.727676 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696c58a-79f1-46e4-a237-c434a591b196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:14.728605 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696c58a-79f1-46e4-a237-c434a591b196 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:14.729028 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696c58a-79f1-46e4-a237-c434a591b196 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:14.729439 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696c58a-79f1-46e4-a237-c434a591b196 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:14.730328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696c58a-79f1-46e4-a237-c434a591b196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:14.733160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696c58a-79f1-46e4-a237-c434a591b196 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:14.762907 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f5f3b-dbf6-40ff-b7b6-c08afc1403f2 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:14.768691 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 976/1963] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:14.776856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f5f3b-dbf6-40ff-b7b6-c08afc1403f2 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:14.788719 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0610e-bf07-4cc8-a74b-739cd50093b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:14.789661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0610e-bf07-4cc8-a74b-739cd50093b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:14.792231 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0610e-bf07-4cc8-a74b-739cd50093b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:14.793164 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0610e-bf07-4cc8-a74b-739cd50093b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:14.796229 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0610e-bf07-4cc8-a74b-739cd50093b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:14.798871 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0610e-bf07-4cc8-a74b-739cd50093b2 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:14.821113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 988/1964] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:14.822656 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696c58a-79f1-46e4-a237-c434a591b196 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:14.841668 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696c58a-79f1-46e4-a237-c434a591b196 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:14.848582 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39604e6-2989-4c4c-997d-fb78d11bd5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:14.849761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39604e6-2989-4c4c-997d-fb78d11bd5d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:14.850267 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39604e6-2989-4c4c-997d-fb78d11bd5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:14.850754 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39604e6-2989-4c4c-997d-fb78d11bd5d0 admin admin] PATH_INFO: `/v3/projects/42d0701517124a9f921abad4f03172e4/users/ed5b938f1cac433787bb7c4852dffe01/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:14.869113 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39604e6-2989-4c4c-997d-fb78d11bd5d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d0701517124a9f921abad4f03172e4, user_id=ed5b938f1cac433787bb7c4852dffe01, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:14.872619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39604e6-2989-4c4c-997d-fb78d11bd5d0 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:14.919632 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0610e-bf07-4cc8-a74b-739cd50093b2 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:14.925418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-40a0610e-bf07-4cc8-a74b-739cd50093b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:15.003792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0610e-bf07-4cc8-a74b-739cd50093b2 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:15.011788 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 977/1965] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:14 2022] PUT /identity/v3/projects/42d0701517124a9f921abad4f03172e4/users/ed5b938f1cac433787bb7c4852dffe01/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:15.023307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a85d3-604c-44b5-aecd-584f1622eb2d None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:15.024108 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a85d3-604c-44b5-aecd-584f1622eb2d None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:15.024403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a85d3-604c-44b5-aecd-584f1622eb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:15.087293 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-f15a85d3-604c-44b5-aecd-584f1622eb2d None None] MFA Rules not processed for user `ed5b938f1cac433787bb7c4852dffe01`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:15.088588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f15a85d3-604c-44b5-aecd-584f1622eb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:15.108546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7a96e-8b2b-46e0-91ef-de8722c80d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:15.112778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7a96e-8b2b-46e0-91ef-de8722c80d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:15.114143 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7a96e-8b2b-46e0-91ef-de8722c80d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:15.120024 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7a96e-8b2b-46e0-91ef-de8722c80d11 admin admin] PATH_INFO: `/v3/projects/85943328f099472d9cc8feb072772a00` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:15.122389 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7a96e-8b2b-46e0-91ef-de8722c80d11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85943328f099472d9cc8feb072772a00)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:15.124504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7a96e-8b2b-46e0-91ef-de8722c80d11 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:15.163511 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:15.235381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 978/1966] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:15.248036 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a85d3-604c-44b5-aecd-584f1622eb2d None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:15.263363 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a85d3-604c-44b5-aecd-584f1622eb2d None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:15.270561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e9097-6240-42c5-ac92-c10b024fbd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:15.271412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e9097-6240-42c5-ac92-c10b024fbd6a admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:15.271778 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e9097-6240-42c5-ac92-c10b024fbd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:15.272173 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e9097-6240-42c5-ac92-c10b024fbd6a admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:15.272983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e9097-6240-42c5-ac92-c10b024fbd6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:15.276443 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e9097-6240-42c5-ac92-c10b024fbd6a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:15.405087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b6f7a96e-8b2b-46e0-91ef-de8722c80d11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85943328f099472d9cc8feb072772a00', 'request_id': 'req-b6f7a96e-8b2b-46e0-91ef-de8722c80d11'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:15.459372 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 979/1967] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:15 2022] POST /identity/v3/projects => generated 377 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:15.461908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e9097-6240-42c5-ac92-c10b024fbd6a admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:15.558677 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b6f7a96e-8b2b-46e0-91ef-de8722c80d11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85943328f099472d9cc8feb072772a00', 'request_id': 'req-b6f7a96e-8b2b-46e0-91ef-de8722c80d11'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:15.569007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b6f7a96e-8b2b-46e0-91ef-de8722c80d11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85943328f099472d9cc8feb072772a00', 'request_id': 'req-b6f7a96e-8b2b-46e0-91ef-de8722c80d11'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:15.570637 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e9097-6240-42c5-ac92-c10b024fbd6a admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:15.584534 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b6f7a96e-8b2b-46e0-91ef-de8722c80d11 admin admin] The token cache is being invalidate because project 85943328f099472d9cc8feb072772a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:15.584774 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607af21b-e46d-4fac-9ea1-3a8eb145807b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:15.585376 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b6f7a96e-8b2b-46e0-91ef-de8722c80d11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:15.585483 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607af21b-e46d-4fac-9ea1-3a8eb145807b admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:15.585755 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607af21b-e46d-4fac-9ea1-3a8eb145807b admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:15.586053 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607af21b-e46d-4fac-9ea1-3a8eb145807b admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:15.586859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607af21b-e46d-4fac-9ea1-3a8eb145807b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:15.587303 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b6f7a96e-8b2b-46e0-91ef-de8722c80d11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:15.593010 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607af21b-e46d-4fac-9ea1-3a8eb145807b admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:15.598112 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 989/1968] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:14 2022] DELETE /identity/v3/projects/85943328f099472d9cc8feb072772a00 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:15.601208 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7a96e-8b2b-46e0-91ef-de8722c80d11 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:15.603418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b6f7a96e-8b2b-46e0-91ef-de8722c80d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:15.716231 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7a96e-8b2b-46e0-91ef-de8722c80d11 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:15.723559 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461793f-4c9d-4b72-90ee-7cb1a7f8563c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:15.724409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461793f-4c9d-4b72-90ee-7cb1a7f8563c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:15.724708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461793f-4c9d-4b72-90ee-7cb1a7f8563c admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:15.724992 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461793f-4c9d-4b72-90ee-7cb1a7f8563c admin admin] PATH_INFO: `/v3/users/596cfdc483024826a6c2b315af17a5c5` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:15.726242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461793f-4c9d-4b72-90ee-7cb1a7f8563c admin admin] RBAC: Authorizing `identity:delete_user(user_id=596cfdc483024826a6c2b315af17a5c5)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:15.728539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461793f-4c9d-4b72-90ee-7cb1a7f8563c admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:15.825824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 980/1969] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:15 2022] POST /identity/v3/users => generated 295 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:15.828525 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607af21b-e46d-4fac-9ea1-3a8eb145807b admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:15.831976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-607af21b-e46d-4fac-9ea1-3a8eb145807b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:15.855956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607af21b-e46d-4fac-9ea1-3a8eb145807b admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:15.862722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260ca16-21c9-4612-b2b1-b4484d03b645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:15.871546 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260ca16-21c9-4612-b2b1-b4484d03b645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:15.872526 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260ca16-21c9-4612-b2b1-b4484d03b645 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:15.872978 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260ca16-21c9-4612-b2b1-b4484d03b645 admin admin] PATH_INFO: `/v3/users/e412d68bcabf45278868022cff8a7214` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:15.875036 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260ca16-21c9-4612-b2b1-b4484d03b645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e412d68bcabf45278868022cff8a7214)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:15.878595 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260ca16-21c9-4612-b2b1-b4484d03b645 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:16.108936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-5461793f-4c9d-4b72-90ee-7cb1a7f8563c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '596cfdc483024826a6c2b315af17a5c5'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:16.109734 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-5461793f-4c9d-4b72-90ee-7cb1a7f8563c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '596cfdc483024826a6c2b315af17a5c5'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:16.193578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-2260ca16-21c9-4612-b2b1-b4484d03b645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e412d68bcabf45278868022cff8a7214'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:16.194236 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-2260ca16-21c9-4612-b2b1-b4484d03b645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e412d68bcabf45278868022cff8a7214'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:16.205592 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:16.207030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-5461793f-4c9d-4b72-90ee-7cb1a7f8563c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '596cfdc483024826a6c2b315af17a5c5'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:16.222878 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-5461793f-4c9d-4b72-90ee-7cb1a7f8563c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '596cfdc483024826a6c2b315af17a5c5'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:16.230396 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-5461793f-4c9d-4b72-90ee-7cb1a7f8563c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '596cfdc483024826a6c2b315af17a5c5'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:16.237850 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 990/1970] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:15 2022] DELETE /identity/v3/users/596cfdc483024826a6c2b315af17a5c5 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:16.239626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461793f-4c9d-4b72-90ee-7cb1a7f8563c admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:16.249935 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-5461793f-4c9d-4b72-90ee-7cb1a7f8563c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:16.350068 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461793f-4c9d-4b72-90ee-7cb1a7f8563c admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:16.354546 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-2260ca16-21c9-4612-b2b1-b4484d03b645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e412d68bcabf45278868022cff8a7214'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:16.367505 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-2260ca16-21c9-4612-b2b1-b4484d03b645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e412d68bcabf45278868022cff8a7214'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:16.372813 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49675c43-6217-42e0-9915-7d99cd68b29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:16.373479 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49675c43-6217-42e0-9915-7d99cd68b29c admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:16.376271 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49675c43-6217-42e0-9915-7d99cd68b29c admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:16.377152 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49675c43-6217-42e0-9915-7d99cd68b29c admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:16.378125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49675c43-6217-42e0-9915-7d99cd68b29c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:16.379888 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49675c43-6217-42e0-9915-7d99cd68b29c admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:16.403357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-2260ca16-21c9-4612-b2b1-b4484d03b645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e412d68bcabf45278868022cff8a7214'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:16.413275 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 991/1971] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:16.414354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49675c43-6217-42e0-9915-7d99cd68b29c admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:16.425581 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49675c43-6217-42e0-9915-7d99cd68b29c admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:16.432066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 981/1972] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:15 2022] DELETE /identity/v3/users/e412d68bcabf45278868022cff8a7214 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:16.437852 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d854833-2433-4f77-802a-afa46566233c None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:16.438137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d854833-2433-4f77-802a-afa46566233c None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:16.438414 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d854833-2433-4f77-802a-afa46566233c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:16.466599 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-2d854833-2433-4f77-802a-afa46566233c None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:16.468824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-2d854833-2433-4f77-802a-afa46566233c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:16.563431 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d98e2b-e4cf-4e3b-ba93-a75ef3e5da11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:16.565260 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d98e2b-e4cf-4e3b-ba93-a75ef3e5da11 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:16.565821 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d98e2b-e4cf-4e3b-ba93-a75ef3e5da11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:16.566447 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d98e2b-e4cf-4e3b-ba93-a75ef3e5da11 admin admin] PATH_INFO: `/v3/projects/d14afe98728748618166da6a9465c7f0/users/541f0566859846f9802774c355b34683/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:16.593781 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d98e2b-e4cf-4e3b-ba93-a75ef3e5da11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14afe98728748618166da6a9465c7f0, user_id=541f0566859846f9802774c355b34683, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:16.596962 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 982/1973] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:16.600816 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d98e2b-e4cf-4e3b-ba93-a75ef3e5da11 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:16.607336 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d854833-2433-4f77-802a-afa46566233c None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:16.613719 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-2d854833-2433-4f77-802a-afa46566233c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:16.712371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d854833-2433-4f77-802a-afa46566233c None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:16.717993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b23f0-35c4-4fee-bd88-c28489c7fad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:16.718678 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b23f0-35c4-4fee-bd88-c28489c7fad6 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:16.718966 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b23f0-35c4-4fee-bd88-c28489c7fad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:16.719282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b23f0-35c4-4fee-bd88-c28489c7fad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:16.739411 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b23f0-35c4-4fee-bd88-c28489c7fad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:16.741300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b23f0-35c4-4fee-bd88-c28489c7fad6 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:16.756594 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 992/1974] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:16 2022] PUT /identity/v3/projects/d14afe98728748618166da6a9465c7f0/users/541f0566859846f9802774c355b34683/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:16.757357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 983/1975] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:03:16.760672 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d98e2b-e4cf-4e3b-ba93-a75ef3e5da11 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:16.879630 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d98e2b-e4cf-4e3b-ba93-a75ef3e5da11 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:16.890291 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf60f0-a3d7-4c72-a832-0ce3c082cdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:16.891100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf60f0-a3d7-4c72-a832-0ce3c082cdcf admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:16.891540 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf60f0-a3d7-4c72-a832-0ce3c082cdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:16.891937 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf60f0-a3d7-4c72-a832-0ce3c082cdcf admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:16.893355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf60f0-a3d7-4c72-a832-0ce3c082cdcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:16.895141 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf60f0-a3d7-4c72-a832-0ce3c082cdcf admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:16.909798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 993/1976] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:16.911033 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b23f0-35c4-4fee-bd88-c28489c7fad6 service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:16.923293 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b23f0-35c4-4fee-bd88-c28489c7fad6 service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:16.929149 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053780d-77d1-4dce-ad3a-16e7465f1fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:16.929935 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053780d-77d1-4dce-ad3a-16e7465f1fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:16.930293 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053780d-77d1-4dce-ad3a-16e7465f1fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:16.931026 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053780d-77d1-4dce-ad3a-16e7465f1fa4 admin admin] PATH_INFO: `/v3/projects/d14afe98728748618166da6a9465c7f0/users/541f0566859846f9802774c355b34683/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:16.933217 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053780d-77d1-4dce-ad3a-16e7465f1fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14afe98728748618166da6a9465c7f0, user_id=541f0566859846f9802774c355b34683, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:16.939679 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053780d-77d1-4dce-ad3a-16e7465f1fa4 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:16.959804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 984/1977] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:16 2022] PUT /identity/v3/projects/d14afe98728748618166da6a9465c7f0/users/541f0566859846f9802774c355b34683/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:16.964896 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf60f0-a3d7-4c72-a832-0ce3c082cdcf admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:16.968897 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-4bcf60f0-a3d7-4c72-a832-0ce3c082cdcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:16.974980 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b22cc-50be-4d42-8cbf-d47ee6180355 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:16.979119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b22cc-50be-4d42-8cbf-d47ee6180355 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:16.980448 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b22cc-50be-4d42-8cbf-d47ee6180355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:17.052400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-c79b22cc-50be-4d42-8cbf-d47ee6180355 None None] MFA Rules not processed for user `541f0566859846f9802774c355b34683`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:17.053920 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c79b22cc-50be-4d42-8cbf-d47ee6180355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:17.102191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf60f0-a3d7-4c72-a832-0ce3c082cdcf admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:17.173955 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 985/1978] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:17.180194 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b22cc-50be-4d42-8cbf-d47ee6180355 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:17.182005 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c79b22cc-50be-4d42-8cbf-d47ee6180355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:17.251249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eef7f1-0657-4337-832b-07187f004256 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:17.262809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eef7f1-0657-4337-832b-07187f004256 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:17.262809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eef7f1-0657-4337-832b-07187f004256 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:17.262809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eef7f1-0657-4337-832b-07187f004256 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:17.262809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-60eef7f1-0657-4337-832b-07187f004256 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:17.302147 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b22cc-50be-4d42-8cbf-d47ee6180355 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:17.314401 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c75734-3430-48e8-84c6-3471995f5d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:17.314401 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c75734-3430-48e8-84c6-3471995f5d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:17.314401 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c75734-3430-48e8-84c6-3471995f5d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:17.314401 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c75734-3430-48e8-84c6-3471995f5d1a admin admin] PATH_INFO: `/v3/projects/321e3109e1054d39af73a4989091cb9a` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:17.315681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c75734-3430-48e8-84c6-3471995f5d1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=321e3109e1054d39af73a4989091cb9a)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:17.315954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c75734-3430-48e8-84c6-3471995f5d1a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:17.401686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eef7f1-0657-4337-832b-07187f004256 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:17.403275 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eef7f1-0657-4337-832b-07187f004256 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:17.413314 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 994/1979] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:17.414159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eef7f1-0657-4337-832b-07187f004256 service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:17.415469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-60eef7f1-0657-4337-832b-07187f004256 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:17.428608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eef7f1-0657-4337-832b-07187f004256 service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:17.433825 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fce78-c8a0-40c5-b742-4026a75a12c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:17.434715 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fce78-c8a0-40c5-b742-4026a75a12c7 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:17.435031 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fce78-c8a0-40c5-b742-4026a75a12c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:17.435182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fce78-c8a0-40c5-b742-4026a75a12c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:17.437115 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d21fce78-c8a0-40c5-b742-4026a75a12c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:17.513047 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fce78-c8a0-40c5-b742-4026a75a12c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:17.514668 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fce78-c8a0-40c5-b742-4026a75a12c7 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:17.530207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 995/1980] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:17.569770 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fce78-c8a0-40c5-b742-4026a75a12c7 service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:17.571692 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d21fce78-c8a0-40c5-b742-4026a75a12c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:17.592635 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fce78-c8a0-40c5-b742-4026a75a12c7 service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:17.597743 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c1c75734-3430-48e8-84c6-3471995f5d1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '321e3109e1054d39af73a4989091cb9a', 'request_id': 'req-c1c75734-3430-48e8-84c6-3471995f5d1a'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:17.617166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c1c75734-3430-48e8-84c6-3471995f5d1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '321e3109e1054d39af73a4989091cb9a', 'request_id': 'req-c1c75734-3430-48e8-84c6-3471995f5d1a'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:17.625990 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c1c75734-3430-48e8-84c6-3471995f5d1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '321e3109e1054d39af73a4989091cb9a', 'request_id': 'req-c1c75734-3430-48e8-84c6-3471995f5d1a'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:17.687432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b37de-1c0b-4a99-972c-3589b57eea04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:17.690954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b37de-1c0b-4a99-972c-3589b57eea04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:17.691290 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b37de-1c0b-4a99-972c-3589b57eea04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:17.693626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b37de-1c0b-4a99-972c-3589b57eea04 admin admin] PATH_INFO: `/v3/projects/f7108b459e94479c9660b5830f758cd7` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:17.695653 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b37de-1c0b-4a99-972c-3589b57eea04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7108b459e94479c9660b5830f758cd7)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:17.698447 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b37de-1c0b-4a99-972c-3589b57eea04 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:17.797093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c1c75734-3430-48e8-84c6-3471995f5d1a admin admin] The token cache is being invalidate because project 321e3109e1054d39af73a4989091cb9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:17.797390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c1c75734-3430-48e8-84c6-3471995f5d1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:17.798075 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c1c75734-3430-48e8-84c6-3471995f5d1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:17.800272 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 986/1981] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:17 2022] DELETE /identity/v3/projects/321e3109e1054d39af73a4989091cb9a => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:17.806222 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781d428-b489-45da-bd90-22784233014a None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:17.806515 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781d428-b489-45da-bd90-22784233014a None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:17.806806 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781d428-b489-45da-bd90-22784233014a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:17.829665 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-b781d428-b489-45da-bd90-22784233014a None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:17.831083 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b781d428-b489-45da-bd90-22784233014a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:17.841786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 987/1982] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:17.850613 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfab3f-0512-4069-97b0-453d054f5e8d None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:17.851130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfab3f-0512-4069-97b0-453d054f5e8d None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:17.851485 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfab3f-0512-4069-97b0-453d054f5e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:17.865280 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b74b37de-1c0b-4a99-972c-3589b57eea04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7108b459e94479c9660b5830f758cd7', 'request_id': 'req-b74b37de-1c0b-4a99-972c-3589b57eea04'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:17.874422 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-99bfab3f-0512-4069-97b0-453d054f5e8d None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:17.875840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-99bfab3f-0512-4069-97b0-453d054f5e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:17.935778 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 988/1983] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:17.940912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfab3f-0512-4069-97b0-453d054f5e8d None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:17.952348 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfab3f-0512-4069-97b0-453d054f5e8d None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:17.960106 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a255f4-4a35-4b2e-a306-0d57c0dc3663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:17.961636 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a255f4-4a35-4b2e-a306-0d57c0dc3663 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:17.962121 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a255f4-4a35-4b2e-a306-0d57c0dc3663 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:17.968897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a255f4-4a35-4b2e-a306-0d57c0dc3663 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:17.968897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a255f4-4a35-4b2e-a306-0d57c0dc3663 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:03:17.968897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a255f4-4a35-4b2e-a306-0d57c0dc3663 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:17.969186 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b74b37de-1c0b-4a99-972c-3589b57eea04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7108b459e94479c9660b5830f758cd7', 'request_id': 'req-b74b37de-1c0b-4a99-972c-3589b57eea04'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:17.969263 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a255f4-4a35-4b2e-a306-0d57c0dc3663 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:17.977382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b74b37de-1c0b-4a99-972c-3589b57eea04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7108b459e94479c9660b5830f758cd7', 'request_id': 'req-b74b37de-1c0b-4a99-972c-3589b57eea04'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:17.979864 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 989/1984] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:03:17.986476 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a255f4-4a35-4b2e-a306-0d57c0dc3663 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:17.999958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a255f4-4a35-4b2e-a306-0d57c0dc3663 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:18.001285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b74b37de-1c0b-4a99-972c-3589b57eea04 admin admin] The token cache is being invalidate because project f7108b459e94479c9660b5830f758cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:18.002781 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b74b37de-1c0b-4a99-972c-3589b57eea04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:18.004552 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b74b37de-1c0b-4a99-972c-3589b57eea04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:18.006055 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a02cf1-a09c-475c-a57e-2aa82e12df7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:18.006837 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a02cf1-a09c-475c-a57e-2aa82e12df7a admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:18.007411 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a02cf1-a09c-475c-a57e-2aa82e12df7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:18.007696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a02cf1-a09c-475c-a57e-2aa82e12df7a admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:18.009541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a02cf1-a09c-475c-a57e-2aa82e12df7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:18.012135 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a02cf1-a09c-475c-a57e-2aa82e12df7a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:18.013123 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 996/1985] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:17 2022] DELETE /identity/v3/projects/f7108b459e94479c9660b5830f758cd7 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:18.018625 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b37de-1c0b-4a99-972c-3589b57eea04 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:18.021042 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b74b37de-1c0b-4a99-972c-3589b57eea04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:18.037812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b37de-1c0b-4a99-972c-3589b57eea04 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:18.042577 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394cb986-5e7f-4140-891e-72c67e1f4653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:18.043220 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cb986-5e7f-4140-891e-72c67e1f4653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:18.046565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cb986-5e7f-4140-891e-72c67e1f4653 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:18.046565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cb986-5e7f-4140-891e-72c67e1f4653 admin admin] PATH_INFO: `/v3/users/e3e464aa6ee04a4b9ac7d9cfc8a4af7f` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:18.046565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394cb986-5e7f-4140-891e-72c67e1f4653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3e464aa6ee04a4b9ac7d9cfc8a4af7f)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:18.047012 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394cb986-5e7f-4140-891e-72c67e1f4653 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:18.134305 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 990/1986] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:17 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:03:18.135455 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a02cf1-a09c-475c-a57e-2aa82e12df7a admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:18.138869 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-28a02cf1-a09c-475c-a57e-2aa82e12df7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:18.174055 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:18.202924 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a02cf1-a09c-475c-a57e-2aa82e12df7a admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:18.208462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a6f4a-0c39-465d-9729-b0e69b8e5059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:18.209206 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a6f4a-0c39-465d-9729-b0e69b8e5059 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:18.209494 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a6f4a-0c39-465d-9729-b0e69b8e5059 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:18.209770 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a6f4a-0c39-465d-9729-b0e69b8e5059 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:18.210452 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a6f4a-0c39-465d-9729-b0e69b8e5059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:18.212424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a6f4a-0c39-465d-9729-b0e69b8e5059 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:18.324003 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-394cb986-5e7f-4140-891e-72c67e1f4653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3e464aa6ee04a4b9ac7d9cfc8a4af7f'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:18.324721 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-394cb986-5e7f-4140-891e-72c67e1f4653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3e464aa6ee04a4b9ac7d9cfc8a4af7f'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:18.421818 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 991/1987] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:18 2022] POST /identity/v3/users => generated 291 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:18.426328 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a6f4a-0c39-465d-9729-b0e69b8e5059 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:18.436541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a6f4a-0c39-465d-9729-b0e69b8e5059 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:18.442579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52739b13-afe9-43d7-ae83-21ec2ede37f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:18.443195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52739b13-afe9-43d7-ae83-21ec2ede37f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:18.443513 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52739b13-afe9-43d7-ae83-21ec2ede37f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:18.443788 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52739b13-afe9-43d7-ae83-21ec2ede37f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:18.444510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52739b13-afe9-43d7-ae83-21ec2ede37f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:18.446100 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52739b13-afe9-43d7-ae83-21ec2ede37f9 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:18.457342 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 992/1988] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:18.461166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52739b13-afe9-43d7-ae83-21ec2ede37f9 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:18.471423 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52739b13-afe9-43d7-ae83-21ec2ede37f9 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:18.476388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cbf32-d98f-4c83-910b-4f2772aea9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:18.476998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cbf32-d98f-4c83-910b-4f2772aea9bd admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:18.477283 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cbf32-d98f-4c83-910b-4f2772aea9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:18.477557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cbf32-d98f-4c83-910b-4f2772aea9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:18.478249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cbf32-d98f-4c83-910b-4f2772aea9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:18.480023 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cbf32-d98f-4c83-910b-4f2772aea9bd admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:18.491728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 993/1989] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:18.496091 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cbf32-d98f-4c83-910b-4f2772aea9bd admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:18.506592 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cbf32-d98f-4c83-910b-4f2772aea9bd admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:18.511554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8867a24-244c-4b90-b9bd-f9b7f9e4f63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:18.512248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8867a24-244c-4b90-b9bd-f9b7f9e4f63e admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:18.512607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8867a24-244c-4b90-b9bd-f9b7f9e4f63e admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:18.513018 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8867a24-244c-4b90-b9bd-f9b7f9e4f63e admin admin] PATH_INFO: `/v3/projects/816dd51a73a040958905a7b137aabbf3/users/c13cdedbbb3444d2996ed820a301f723/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:18.528398 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8867a24-244c-4b90-b9bd-f9b7f9e4f63e admin admin] RBAC: Authorizing `identity:create_grant(project_id=816dd51a73a040958905a7b137aabbf3, user_id=c13cdedbbb3444d2996ed820a301f723, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:18.531231 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8867a24-244c-4b90-b9bd-f9b7f9e4f63e admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:18.541923 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-394cb986-5e7f-4140-891e-72c67e1f4653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3e464aa6ee04a4b9ac7d9cfc8a4af7f'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:18.556586 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-394cb986-5e7f-4140-891e-72c67e1f4653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3e464aa6ee04a4b9ac7d9cfc8a4af7f'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:18.563432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-394cb986-5e7f-4140-891e-72c67e1f4653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3e464aa6ee04a4b9ac7d9cfc8a4af7f'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:18.570105 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 997/1990] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:18 2022] DELETE /identity/v3/users/e3e464aa6ee04a4b9ac7d9cfc8a4af7f => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:18.615396 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 994/1991] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:18 2022] PUT /identity/v3/projects/816dd51a73a040958905a7b137aabbf3/users/c13cdedbbb3444d2996ed820a301f723/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:18.625609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868a0cd-54c5-4dc8-8319-5b47889ab299 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:18.625901 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868a0cd-54c5-4dc8-8319-5b47889ab299 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:18.626193 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868a0cd-54c5-4dc8-8319-5b47889ab299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:18.677776 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-0868a0cd-54c5-4dc8-8319-5b47889ab299 None None] MFA Rules not processed for user `c13cdedbbb3444d2996ed820a301f723`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:18.679030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-0868a0cd-54c5-4dc8-8319-5b47889ab299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:18.749972 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 998/1992] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:18.755666 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8867a24-244c-4b90-b9bd-f9b7f9e4f63e admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:18.757638 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f8867a24-244c-4b90-b9bd-f9b7f9e4f63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:18.837153 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8867a24-244c-4b90-b9bd-f9b7f9e4f63e admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:18.848203 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29a8a8-ff2d-4cbf-98a6-c6dd8cac225c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:18.849336 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29a8a8-ff2d-4cbf-98a6-c6dd8cac225c admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:18.849846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29a8a8-ff2d-4cbf-98a6-c6dd8cac225c admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:18.850394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29a8a8-ff2d-4cbf-98a6-c6dd8cac225c admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:18.863205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29a8a8-ff2d-4cbf-98a6-c6dd8cac225c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:18.865287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29a8a8-ff2d-4cbf-98a6-c6dd8cac225c admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:19.002277 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 995/1993] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:18 2022] POST /identity/v3/projects => generated 383 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:19.006415 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868a0cd-54c5-4dc8-8319-5b47889ab299 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:19.020173 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868a0cd-54c5-4dc8-8319-5b47889ab299 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:19.085613 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790ed32-b897-4141-ad16-d41b2c99076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:19.086271 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790ed32-b897-4141-ad16-d41b2c99076a admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:19.086588 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790ed32-b897-4141-ad16-d41b2c99076a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:19.086864 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790ed32-b897-4141-ad16-d41b2c99076a admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:19.087604 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790ed32-b897-4141-ad16-d41b2c99076a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:19.089932 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29a8a8-ff2d-4cbf-98a6-c6dd8cac225c admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:19.090260 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790ed32-b897-4141-ad16-d41b2c99076a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:19.091846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-6e29a8a8-ff2d-4cbf-98a6-c6dd8cac225c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:19.111990 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29a8a8-ff2d-4cbf-98a6-c6dd8cac225c admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:19.118841 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062de0e6-f11f-4298-a302-94b9938796b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:19.119184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062de0e6-f11f-4298-a302-94b9938796b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:19.119561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062de0e6-f11f-4298-a302-94b9938796b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:19.119844 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062de0e6-f11f-4298-a302-94b9938796b8 admin admin] PATH_INFO: `/v3/projects/c712c7e0b43a43b4914df6cb57687829` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:19.121135 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062de0e6-f11f-4298-a302-94b9938796b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c712c7e0b43a43b4914df6cb57687829)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:19.123221 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062de0e6-f11f-4298-a302-94b9938796b8 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:19.234140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 999/1994] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:19 2022] POST /identity/v3/users => generated 298 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:19.239049 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790ed32-b897-4141-ad16-d41b2c99076a admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:19.250856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790ed32-b897-4141-ad16-d41b2c99076a admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:19.257887 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb3838-1cd2-43dc-ada8-b1ac856e683f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:19.264340 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb3838-1cd2-43dc-ada8-b1ac856e683f admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:19.264340 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb3838-1cd2-43dc-ada8-b1ac856e683f admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:19.264340 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb3838-1cd2-43dc-ada8-b1ac856e683f admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:19.264340 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb3838-1cd2-43dc-ada8-b1ac856e683f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:19.264340 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb3838-1cd2-43dc-ada8-b1ac856e683f admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:19.273907 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1000/1995] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:19.280437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb3838-1cd2-43dc-ada8-b1ac856e683f admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:19.293041 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb3838-1cd2-43dc-ada8-b1ac856e683f admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:19.309939 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-062de0e6-f11f-4298-a302-94b9938796b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c712c7e0b43a43b4914df6cb57687829', 'request_id': 'req-062de0e6-f11f-4298-a302-94b9938796b8'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:19.319383 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-062de0e6-f11f-4298-a302-94b9938796b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c712c7e0b43a43b4914df6cb57687829', 'request_id': 'req-062de0e6-f11f-4298-a302-94b9938796b8'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:19.325685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-062de0e6-f11f-4298-a302-94b9938796b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c712c7e0b43a43b4914df6cb57687829', 'request_id': 'req-062de0e6-f11f-4298-a302-94b9938796b8'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:19.346434 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:19.366243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d83be-d558-431b-a3d0-99c4ffd3823a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:19.367438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d83be-d558-431b-a3d0-99c4ffd3823a admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:19.367935 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d83be-d558-431b-a3d0-99c4ffd3823a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:19.368470 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d83be-d558-431b-a3d0-99c4ffd3823a admin admin] PATH_INFO: `/v3/projects/25c6c676d27b4f8fb35b98e16f66a722/users/0b498c80fc5a4f5a9b5a91d43d353507/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:19.396040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d83be-d558-431b-a3d0-99c4ffd3823a admin admin] RBAC: Authorizing `identity:create_grant(project_id=25c6c676d27b4f8fb35b98e16f66a722, user_id=0b498c80fc5a4f5a9b5a91d43d353507, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:19.403154 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d83be-d558-431b-a3d0-99c4ffd3823a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:19.404583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-062de0e6-f11f-4298-a302-94b9938796b8 admin admin] The token cache is being invalidate because project c712c7e0b43a43b4914df6cb57687829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:19.405022 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-062de0e6-f11f-4298-a302-94b9938796b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:19.405792 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-062de0e6-f11f-4298-a302-94b9938796b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:19.407743 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 996/1996] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:19 2022] DELETE /identity/v3/projects/c712c7e0b43a43b4914df6cb57687829 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:19.412593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23be4a-8a91-49c1-bdbe-1f5a19c93d02 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:19.412971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23be4a-8a91-49c1-bdbe-1f5a19c93d02 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:19.413316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23be4a-8a91-49c1-bdbe-1f5a19c93d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:19.437352 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-da23be4a-8a91-49c1-bdbe-1f5a19c93d02 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:19.438423 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-da23be4a-8a91-49c1-bdbe-1f5a19c93d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:19.453251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 997/1997] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:19.465942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310663ba-576c-47e5-a31b-65ac990abc09 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:19.466252 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310663ba-576c-47e5-a31b-65ac990abc09 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:19.466510 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310663ba-576c-47e5-a31b-65ac990abc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:19.489591 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-310663ba-576c-47e5-a31b-65ac990abc09 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:19.491030 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-310663ba-576c-47e5-a31b-65ac990abc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:19.506345 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 998/1998] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:19.509144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310663ba-576c-47e5-a31b-65ac990abc09 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:19.526289 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1001/1999] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:19 2022] PUT /identity/v3/projects/25c6c676d27b4f8fb35b98e16f66a722/users/0b498c80fc5a4f5a9b5a91d43d353507/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:19.530512 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d83be-d558-431b-a3d0-99c4ffd3823a admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:19.534736 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-611d83be-d558-431b-a3d0-99c4ffd3823a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:19.536336 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310663ba-576c-47e5-a31b-65ac990abc09 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:19.666636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d83be-d558-431b-a3d0-99c4ffd3823a admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:19.667219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af05ac4-41c6-4c3b-b3b1-a11bc2f8f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:19.667762 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af05ac4-41c6-4c3b-b3b1-a11bc2f8f2bb admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:19.668259 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af05ac4-41c6-4c3b-b3b1-a11bc2f8f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:19.669005 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af05ac4-41c6-4c3b-b3b1-a11bc2f8f2bb admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:19.670406 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af05ac4-41c6-4c3b-b3b1-a11bc2f8f2bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:03:19.671048 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af05ac4-41c6-4c3b-b3b1-a11bc2f8f2bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:19.672322 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350f704-da5e-4df5-a95a-8e7c275a6eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:19.673156 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350f704-da5e-4df5-a95a-8e7c275a6eff admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:19.674166 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350f704-da5e-4df5-a95a-8e7c275a6eff admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:19.674846 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350f704-da5e-4df5-a95a-8e7c275a6eff admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:19.675748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af05ac4-41c6-4c3b-b3b1-a11bc2f8f2bb admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:19.676387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350f704-da5e-4df5-a95a-8e7c275a6eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:19.678346 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350f704-da5e-4df5-a95a-8e7c275a6eff admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:19.692402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1002/2000] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:19.697066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350f704-da5e-4df5-a95a-8e7c275a6eff admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:19.709962 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 999/2001] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 04:03:19.709962 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af05ac4-41c6-4c3b-b3b1-a11bc2f8f2bb admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:19.720578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af05ac4-41c6-4c3b-b3b1-a11bc2f8f2bb admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:19.725298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350f704-da5e-4df5-a95a-8e7c275a6eff admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:19.726619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf565f52-b372-44ab-9604-62e0ec7fa123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:19.727743 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf565f52-b372-44ab-9604-62e0ec7fa123 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:19.727932 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89ff5b-52ef-42d0-b1f7-43d4b9ac565b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:19.728069 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf565f52-b372-44ab-9604-62e0ec7fa123 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:19.728069 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf565f52-b372-44ab-9604-62e0ec7fa123 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:19.728422 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89ff5b-52ef-42d0-b1f7-43d4b9ac565b admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:19.728909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf565f52-b372-44ab-9604-62e0ec7fa123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:19.729065 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89ff5b-52ef-42d0-b1f7-43d4b9ac565b admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:19.729411 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89ff5b-52ef-42d0-b1f7-43d4b9ac565b admin admin] PATH_INFO: `/v3/projects/25c6c676d27b4f8fb35b98e16f66a722/users/0b498c80fc5a4f5a9b5a91d43d353507/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:19.731219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf565f52-b372-44ab-9604-62e0ec7fa123 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:19.732103 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89ff5b-52ef-42d0-b1f7-43d4b9ac565b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25c6c676d27b4f8fb35b98e16f66a722, user_id=0b498c80fc5a4f5a9b5a91d43d353507, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:19.735428 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89ff5b-52ef-42d0-b1f7-43d4b9ac565b admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:19.748763 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1003/2002] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:19 2022] PUT /identity/v3/projects/25c6c676d27b4f8fb35b98e16f66a722/users/0b498c80fc5a4f5a9b5a91d43d353507/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:19.761494 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404b2b9-2947-47ab-86ae-f5e9ad9808f9 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:19.761722 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404b2b9-2947-47ab-86ae-f5e9ad9808f9 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:19.761995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404b2b9-2947-47ab-86ae-f5e9ad9808f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:19.794436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-b404b2b9-2947-47ab-86ae-f5e9ad9808f9 None None] MFA Rules not processed for user `0b498c80fc5a4f5a9b5a91d43d353507`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:19.797859 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b404b2b9-2947-47ab-86ae-f5e9ad9808f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:19.872672 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1004/2003] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:19.890641 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1000/2004] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:19 2022] POST /identity/v3/projects => generated 363 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:19.891829 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404b2b9-2947-47ab-86ae-f5e9ad9808f9 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:19.962507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404b2b9-2947-47ab-86ae-f5e9ad9808f9 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:20.006240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf565f52-b372-44ab-9604-62e0ec7fa123 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:20.008552 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-bf565f52-b372-44ab-9604-62e0ec7fa123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:20.039709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f472238-e501-416c-8a29-9ed817fa12a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:20.039709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f472238-e501-416c-8a29-9ed817fa12a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:20.039709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f472238-e501-416c-8a29-9ed817fa12a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:20.039709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f472238-e501-416c-8a29-9ed817fa12a2 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:20.040001 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f472238-e501-416c-8a29-9ed817fa12a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:20.040001 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f472238-e501-416c-8a29-9ed817fa12a2 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:20.092878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf565f52-b372-44ab-9604-62e0ec7fa123 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:20.101070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a763d0f-1ce9-40af-9540-8b63f9980265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:20.107587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a763d0f-1ce9-40af-9540-8b63f9980265 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:20.107587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a763d0f-1ce9-40af-9540-8b63f9980265 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:20.107587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a763d0f-1ce9-40af-9540-8b63f9980265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:20.149412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1005/2005] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:19 2022] POST /identity/v3/users => generated 282 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:03:20.156230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f472238-e501-416c-8a29-9ed817fa12a2 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:20.169474 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f472238-e501-416c-8a29-9ed817fa12a2 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:20.183848 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41dfcf-0372-4bc1-bef5-b37a12cd96de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:20.185034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41dfcf-0372-4bc1-bef5-b37a12cd96de admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:20.185578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41dfcf-0372-4bc1-bef5-b37a12cd96de admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:20.186351 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41dfcf-0372-4bc1-bef5-b37a12cd96de admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:20.187720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41dfcf-0372-4bc1-bef5-b37a12cd96de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:20.193042 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41dfcf-0372-4bc1-bef5-b37a12cd96de admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:20.210250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1006/2006] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:20.217037 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41dfcf-0372-4bc1-bef5-b37a12cd96de admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:20.221762 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a763d0f-1ce9-40af-9540-8b63f9980265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:20.223546 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a763d0f-1ce9-40af-9540-8b63f9980265 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:20.239604 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41dfcf-0372-4bc1-bef5-b37a12cd96de admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:20.241253 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1001/2007] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:20.246560 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2590711-78ad-4d65-a755-6572443b681b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:20.247233 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2590711-78ad-4d65-a755-6572443b681b admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:20.247539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2590711-78ad-4d65-a755-6572443b681b admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:20.247818 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2590711-78ad-4d65-a755-6572443b681b admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:20.248541 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2590711-78ad-4d65-a755-6572443b681b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:20.250249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2590711-78ad-4d65-a755-6572443b681b admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:20.275395 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1007/2008] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:20.280953 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a763d0f-1ce9-40af-9540-8b63f9980265 service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:20.306251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a763d0f-1ce9-40af-9540-8b63f9980265 service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:20.315192 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddd604-7068-4cb1-8029-981f221c5c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:20.316635 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddd604-7068-4cb1-8029-981f221c5c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:20.318698 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddd604-7068-4cb1-8029-981f221c5c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:20.319278 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddd604-7068-4cb1-8029-981f221c5c67 admin admin] PATH_INFO: `/v3/projects/fefdefb2c1bb43c2a9d202d402f2c390/users/989e7599b8534f2eadc51f9ac3604ad0/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:20.351273 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddd604-7068-4cb1-8029-981f221c5c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fefdefb2c1bb43c2a9d202d402f2c390, user_id=989e7599b8534f2eadc51f9ac3604ad0, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:20.357083 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ddd604-7068-4cb1-8029-981f221c5c67 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:20.497161 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1002/2009] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:20 2022] PUT /identity/v3/projects/fefdefb2c1bb43c2a9d202d402f2c390/users/989e7599b8534f2eadc51f9ac3604ad0/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:20.499219 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2590711-78ad-4d65-a755-6572443b681b admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:20.511419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68850f4-130b-4bfc-b569-9f8189415af2 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:20.511709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68850f4-130b-4bfc-b569-9f8189415af2 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:20.511988 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68850f4-130b-4bfc-b569-9f8189415af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:20.512617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2590711-78ad-4d65-a755-6572443b681b admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:20.547470 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-d68850f4-130b-4bfc-b569-9f8189415af2 None None] MFA Rules not processed for user `989e7599b8534f2eadc51f9ac3604ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:20.549827 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-d68850f4-130b-4bfc-b569-9f8189415af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:20.576744 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a792c3-a7c1-4991-a612-6ff9d5d01e2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:20.577994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a792c3-a7c1-4991-a612-6ff9d5d01e2d service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:20.577994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a792c3-a7c1-4991-a612-6ff9d5d01e2d service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:20.578239 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a792c3-a7c1-4991-a612-6ff9d5d01e2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:20.581392 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-57a792c3-a7c1-4991-a612-6ff9d5d01e2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:20.621935 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1003/2010] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:20.654904 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a792c3-a7c1-4991-a612-6ff9d5d01e2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:20.657778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a792c3-a7c1-4991-a612-6ff9d5d01e2d service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:20.667360 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1008/2011] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:20.685353 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:20.727982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68850f4-130b-4bfc-b569-9f8189415af2 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:20.745891 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68850f4-130b-4bfc-b569-9f8189415af2 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:20.752560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19243f01-1040-4804-94e8-57a022c283a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:20.753666 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19243f01-1040-4804-94e8-57a022c283a0 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:20.754486 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19243f01-1040-4804-94e8-57a022c283a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:20.755571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19243f01-1040-4804-94e8-57a022c283a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:20.758861 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-19243f01-1040-4804-94e8-57a022c283a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:20.764156 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a792c3-a7c1-4991-a612-6ff9d5d01e2d service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:20.765767 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-57a792c3-a7c1-4991-a612-6ff9d5d01e2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:20.782021 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a792c3-a7c1-4991-a612-6ff9d5d01e2d service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:20.786435 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5236f-63c7-4c77-aca1-33fa51ba08fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:20.787190 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5236f-63c7-4c77-aca1-33fa51ba08fe service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:20.787574 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5236f-63c7-4c77-aca1-33fa51ba08fe service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:20.788019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5236f-63c7-4c77-aca1-33fa51ba08fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:20.797873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5236f-63c7-4c77-aca1-33fa51ba08fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:20.801432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5236f-63c7-4c77-aca1-33fa51ba08fe service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:20.808324 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:20.822279 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1009/2012] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:20 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:20.849993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19243f01-1040-4804-94e8-57a022c283a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:20.851555 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19243f01-1040-4804-94e8-57a022c283a0 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:20.866752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1004/2013] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:22.139513 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:22.365895 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:23.832933 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5236f-63c7-4c77-aca1-33fa51ba08fe service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:23.834449 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-3cb5236f-63c7-4c77-aca1-33fa51ba08fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:23.918257 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5236f-63c7-4c77-aca1-33fa51ba08fe service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:23.923891 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201bde8-2aec-4597-96f3-ada3c53a1056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:23.925166 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201bde8-2aec-4597-96f3-ada3c53a1056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:23.925400 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201bde8-2aec-4597-96f3-ada3c53a1056 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:23.925674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201bde8-2aec-4597-96f3-ada3c53a1056 admin admin] PATH_INFO: `/v3/users/228ecbb831884c3a886d48cf918f57b0` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:23.926941 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201bde8-2aec-4597-96f3-ada3c53a1056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=228ecbb831884c3a886d48cf918f57b0)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:23.928926 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201bde8-2aec-4597-96f3-ada3c53a1056 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:24.153348 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6201bde8-2aec-4597-96f3-ada3c53a1056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '228ecbb831884c3a886d48cf918f57b0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:24.154890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6201bde8-2aec-4597-96f3-ada3c53a1056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '228ecbb831884c3a886d48cf918f57b0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:24.238645 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6201bde8-2aec-4597-96f3-ada3c53a1056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '228ecbb831884c3a886d48cf918f57b0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:24.251846 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6201bde8-2aec-4597-96f3-ada3c53a1056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '228ecbb831884c3a886d48cf918f57b0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:24.259306 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6201bde8-2aec-4597-96f3-ada3c53a1056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '228ecbb831884c3a886d48cf918f57b0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:24.270528 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1010/2014] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:23 2022] DELETE /identity/v3/users/228ecbb831884c3a886d48cf918f57b0 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:24.270752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:24.271448 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8176f-9fef-43fc-b709-51d0e82d8b28 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:24.271743 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8176f-9fef-43fc-b709-51d0e82d8b28 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:24.272027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8176f-9fef-43fc-b709-51d0e82d8b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:24.292602 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-9fe8176f-9fef-43fc-b709-51d0e82d8b28 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:24.294154 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9fe8176f-9fef-43fc-b709-51d0e82d8b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:24.356210 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1005/2015] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:24.367994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201bde8-2aec-4597-96f3-ada3c53a1056 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:24.372460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-6201bde8-2aec-4597-96f3-ada3c53a1056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:24.433958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201bde8-2aec-4597-96f3-ada3c53a1056 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:24.440572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6870f7-3594-4e1a-ae7b-460090e5b0bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:24.441220 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6870f7-3594-4e1a-ae7b-460090e5b0bf service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:24.441515 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6870f7-3594-4e1a-ae7b-460090e5b0bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:24.441770 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6870f7-3594-4e1a-ae7b-460090e5b0bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:24.451799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6870f7-3594-4e1a-ae7b-460090e5b0bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:24.453270 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6870f7-3594-4e1a-ae7b-460090e5b0bf service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:24.464798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1011/2016] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:24.479392 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:24.943707 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8176f-9fef-43fc-b709-51d0e82d8b28 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:24.945221 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9fe8176f-9fef-43fc-b709-51d0e82d8b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:24.962758 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8176f-9fef-43fc-b709-51d0e82d8b28 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:24.968043 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ff98b-fb13-43af-8b76-6eb71f2df17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:24.969717 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ff98b-fb13-43af-8b76-6eb71f2df17a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:24.970093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ff98b-fb13-43af-8b76-6eb71f2df17a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:24.970625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ff98b-fb13-43af-8b76-6eb71f2df17a admin admin] PATH_INFO: `/v3/users/c13cdedbbb3444d2996ed820a301f723` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:24.972252 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ff98b-fb13-43af-8b76-6eb71f2df17a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c13cdedbbb3444d2996ed820a301f723)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:24.976061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ff98b-fb13-43af-8b76-6eb71f2df17a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:25.264742 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-633ff98b-fb13-43af-8b76-6eb71f2df17a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c13cdedbbb3444d2996ed820a301f723'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:25.266458 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-633ff98b-fb13-43af-8b76-6eb71f2df17a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c13cdedbbb3444d2996ed820a301f723'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:25.363370 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-633ff98b-fb13-43af-8b76-6eb71f2df17a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c13cdedbbb3444d2996ed820a301f723'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:25.373172 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-633ff98b-fb13-43af-8b76-6eb71f2df17a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c13cdedbbb3444d2996ed820a301f723'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:25.388168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-633ff98b-fb13-43af-8b76-6eb71f2df17a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c13cdedbbb3444d2996ed820a301f723'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:25.395596 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1006/2017] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:24 2022] DELETE /identity/v3/users/c13cdedbbb3444d2996ed820a301f723 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:25.399756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9f2b0-fc69-41e1-9ff0-5d20c07ac075 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:25.400256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9f2b0-fc69-41e1-9ff0-5d20c07ac075 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:25.400344 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9f2b0-fc69-41e1-9ff0-5d20c07ac075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:25.431252 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-e2b9f2b0-fc69-41e1-9ff0-5d20c07ac075 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:25.432998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e2b9f2b0-fc69-41e1-9ff0-5d20c07ac075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:25.511412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1012/2018] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:25.526819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ff98b-fb13-43af-8b76-6eb71f2df17a admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:25.536968 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-633ff98b-fb13-43af-8b76-6eb71f2df17a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:25.554622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9f2b0-fc69-41e1-9ff0-5d20c07ac075 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:25.556712 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e2b9f2b0-fc69-41e1-9ff0-5d20c07ac075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:25.569819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9f2b0-fc69-41e1-9ff0-5d20c07ac075 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:25.574847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d3d2f-7c3d-41f3-91db-1e4de76bbc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:25.575843 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d3d2f-7c3d-41f3-91db-1e4de76bbc6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:25.576363 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d3d2f-7c3d-41f3-91db-1e4de76bbc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:25.576805 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d3d2f-7c3d-41f3-91db-1e4de76bbc6f admin admin] PATH_INFO: `/v3/projects/dc5f32efd1034668b92511b65159d4da` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:25.578282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d3d2f-7c3d-41f3-91db-1e4de76bbc6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5f32efd1034668b92511b65159d4da)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:25.580786 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d3d2f-7c3d-41f3-91db-1e4de76bbc6f admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:25.626323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ff98b-fb13-43af-8b76-6eb71f2df17a admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:25.631288 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11708a-2807-42f2-b7da-c4d38bcd2e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:25.632372 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11708a-2807-42f2-b7da-c4d38bcd2e6b service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:25.632684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11708a-2807-42f2-b7da-c4d38bcd2e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:25.633041 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11708a-2807-42f2-b7da-c4d38bcd2e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:25.644945 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11708a-2807-42f2-b7da-c4d38bcd2e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:25.646537 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11708a-2807-42f2-b7da-c4d38bcd2e6b service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:25.652469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:25.671777 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1007/2019] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:25.704282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-db8d3d2f-7c3d-41f3-91db-1e4de76bbc6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5f32efd1034668b92511b65159d4da', 'request_id': 'req-db8d3d2f-7c3d-41f3-91db-1e4de76bbc6f'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:25.805159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-db8d3d2f-7c3d-41f3-91db-1e4de76bbc6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5f32efd1034668b92511b65159d4da', 'request_id': 'req-db8d3d2f-7c3d-41f3-91db-1e4de76bbc6f'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:25.814695 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-db8d3d2f-7c3d-41f3-91db-1e4de76bbc6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5f32efd1034668b92511b65159d4da', 'request_id': 'req-db8d3d2f-7c3d-41f3-91db-1e4de76bbc6f'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:25.835001 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-db8d3d2f-7c3d-41f3-91db-1e4de76bbc6f admin admin] The token cache is being invalidate because project dc5f32efd1034668b92511b65159d4da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:25.835552 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-db8d3d2f-7c3d-41f3-91db-1e4de76bbc6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:25.840162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-db8d3d2f-7c3d-41f3-91db-1e4de76bbc6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:25.840162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1013/2020] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:25 2022] DELETE /identity/v3/projects/dc5f32efd1034668b92511b65159d4da => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:25.843523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11708a-2807-42f2-b7da-c4d38bcd2e6b service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:25.855123 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11708a-2807-42f2-b7da-c4d38bcd2e6b service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:25.926840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf8324-fff6-4e15-9d6b-d7cee34baee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:25.927656 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf8324-fff6-4e15-9d6b-d7cee34baee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:25.928011 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf8324-fff6-4e15-9d6b-d7cee34baee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:25.928398 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf8324-fff6-4e15-9d6b-d7cee34baee9 admin admin] PATH_INFO: `/v3/users/e6976cef9d784233a4facc249c5f2028` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:25.932145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf8324-fff6-4e15-9d6b-d7cee34baee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6976cef9d784233a4facc249c5f2028)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:25.934547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf8324-fff6-4e15-9d6b-d7cee34baee9 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:26.151059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:26.302939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d3d2f-7c3d-41f3-91db-1e4de76bbc6f admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:26.304829 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-db8d3d2f-7c3d-41f3-91db-1e4de76bbc6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:26.311396 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-21cf8324-fff6-4e15-9d6b-d7cee34baee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6976cef9d784233a4facc249c5f2028'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:26.312647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-21cf8324-fff6-4e15-9d6b-d7cee34baee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6976cef9d784233a4facc249c5f2028'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:26.320760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d3d2f-7c3d-41f3-91db-1e4de76bbc6f admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:26.325689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14cf21-6f26-40ce-a88a-9cf1c3379b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:26.326443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14cf21-6f26-40ce-a88a-9cf1c3379b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:26.326714 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14cf21-6f26-40ce-a88a-9cf1c3379b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:26.326993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14cf21-6f26-40ce-a88a-9cf1c3379b2a admin admin] PATH_INFO: `/v3/projects/816dd51a73a040958905a7b137aabbf3` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:26.329083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14cf21-6f26-40ce-a88a-9cf1c3379b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=816dd51a73a040958905a7b137aabbf3)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:26.331376 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14cf21-6f26-40ce-a88a-9cf1c3379b2a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:26.538108 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-21cf8324-fff6-4e15-9d6b-d7cee34baee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6976cef9d784233a4facc249c5f2028'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:26.543209 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-21cf8324-fff6-4e15-9d6b-d7cee34baee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6976cef9d784233a4facc249c5f2028'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:26.554320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-dc14cf21-6f26-40ce-a88a-9cf1c3379b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816dd51a73a040958905a7b137aabbf3', 'request_id': 'req-dc14cf21-6f26-40ce-a88a-9cf1c3379b2a'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:26.557144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-21cf8324-fff6-4e15-9d6b-d7cee34baee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6976cef9d784233a4facc249c5f2028'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:26.569734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1008/2021] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:25 2022] DELETE /identity/v3/users/e6976cef9d784233a4facc249c5f2028 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:26.569734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf8324-fff6-4e15-9d6b-d7cee34baee9 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:26.571770 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-21cf8324-fff6-4e15-9d6b-d7cee34baee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:26.646316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf8324-fff6-4e15-9d6b-d7cee34baee9 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:26.651308 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d15099-b35b-4f65-80e8-ac1d680d768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:26.652162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d15099-b35b-4f65-80e8-ac1d680d768b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:26.652450 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d15099-b35b-4f65-80e8-ac1d680d768b admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:26.652734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d15099-b35b-4f65-80e8-ac1d680d768b admin admin] PATH_INFO: `/v3/users/ed5b938f1cac433787bb7c4852dffe01` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:26.653967 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d15099-b35b-4f65-80e8-ac1d680d768b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed5b938f1cac433787bb7c4852dffe01)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:26.655954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d15099-b35b-4f65-80e8-ac1d680d768b admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:26.719130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-dc14cf21-6f26-40ce-a88a-9cf1c3379b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816dd51a73a040958905a7b137aabbf3', 'request_id': 'req-dc14cf21-6f26-40ce-a88a-9cf1c3379b2a'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:26.726947 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-dc14cf21-6f26-40ce-a88a-9cf1c3379b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816dd51a73a040958905a7b137aabbf3', 'request_id': 'req-dc14cf21-6f26-40ce-a88a-9cf1c3379b2a'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:26.740745 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-dc14cf21-6f26-40ce-a88a-9cf1c3379b2a admin admin] The token cache is being invalidate because project 816dd51a73a040958905a7b137aabbf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:26.741029 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-dc14cf21-6f26-40ce-a88a-9cf1c3379b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:26.741716 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-dc14cf21-6f26-40ce-a88a-9cf1c3379b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:26.743290 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1014/2022] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:26 2022] DELETE /identity/v3/projects/816dd51a73a040958905a7b137aabbf3 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:26.749754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14cf21-6f26-40ce-a88a-9cf1c3379b2a admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:26.749754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-dc14cf21-6f26-40ce-a88a-9cf1c3379b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:26.826145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14cf21-6f26-40ce-a88a-9cf1c3379b2a admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:26.833057 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd56f9d-cfb7-4c66-a7a7-1f783a7df023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:26.833912 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd56f9d-cfb7-4c66-a7a7-1f783a7df023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:26.835675 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd56f9d-cfb7-4c66-a7a7-1f783a7df023 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:26.835675 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd56f9d-cfb7-4c66-a7a7-1f783a7df023 admin admin] PATH_INFO: `/v3/users/0b498c80fc5a4f5a9b5a91d43d353507` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:26.837240 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd56f9d-cfb7-4c66-a7a7-1f783a7df023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b498c80fc5a4f5a9b5a91d43d353507)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:26.839206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd56f9d-cfb7-4c66-a7a7-1f783a7df023 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:26.875747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-57d15099-b35b-4f65-80e8-ac1d680d768b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed5b938f1cac433787bb7c4852dffe01'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:26.877435 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-57d15099-b35b-4f65-80e8-ac1d680d768b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed5b938f1cac433787bb7c4852dffe01'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:26.947642 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-57d15099-b35b-4f65-80e8-ac1d680d768b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed5b938f1cac433787bb7c4852dffe01'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:26.956873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-57d15099-b35b-4f65-80e8-ac1d680d768b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed5b938f1cac433787bb7c4852dffe01'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:26.972075 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-57d15099-b35b-4f65-80e8-ac1d680d768b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed5b938f1cac433787bb7c4852dffe01'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:26.978716 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1009/2023] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:26 2022] DELETE /identity/v3/users/ed5b938f1cac433787bb7c4852dffe01 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:26.989620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c38391-3479-4e2e-8aa0-e82ef497d190 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:26.994632 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c38391-3479-4e2e-8aa0-e82ef497d190 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:26.994632 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c38391-3479-4e2e-8aa0-e82ef497d190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:27.015425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-65c38391-3479-4e2e-8aa0-e82ef497d190 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:27.016089 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-65c38391-3479-4e2e-8aa0-e82ef497d190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:27.054395 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-8dd56f9d-cfb7-4c66-a7a7-1f783a7df023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b498c80fc5a4f5a9b5a91d43d353507'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:27.055038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-8dd56f9d-cfb7-4c66-a7a7-1f783a7df023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b498c80fc5a4f5a9b5a91d43d353507'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:27.113789 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1010/2024] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:27.114735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c38391-3479-4e2e-8aa0-e82ef497d190 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:27.118934 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-65c38391-3479-4e2e-8aa0-e82ef497d190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:27.137541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c38391-3479-4e2e-8aa0-e82ef497d190 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:27.143085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2aa0e-386a-4011-a999-dcbede3da25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:27.145298 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2aa0e-386a-4011-a999-dcbede3da25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:27.145298 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2aa0e-386a-4011-a999-dcbede3da25b admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:27.145298 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2aa0e-386a-4011-a999-dcbede3da25b admin admin] PATH_INFO: `/v3/projects/28eb31f8941744d1bdc3706726676082` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:27.145648 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2aa0e-386a-4011-a999-dcbede3da25b admin admin] RBAC: Authorizing `identity:delete_project(project_id=28eb31f8941744d1bdc3706726676082)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:27.147672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2aa0e-386a-4011-a999-dcbede3da25b admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:27.164206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-8dd56f9d-cfb7-4c66-a7a7-1f783a7df023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b498c80fc5a4f5a9b5a91d43d353507'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:27.182252 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-8dd56f9d-cfb7-4c66-a7a7-1f783a7df023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b498c80fc5a4f5a9b5a91d43d353507'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:27.192297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-8dd56f9d-cfb7-4c66-a7a7-1f783a7df023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b498c80fc5a4f5a9b5a91d43d353507'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:27.199755 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1015/2025] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:26 2022] DELETE /identity/v3/users/0b498c80fc5a4f5a9b5a91d43d353507 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:27.204589 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd56f9d-cfb7-4c66-a7a7-1f783a7df023 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:27.208354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-8dd56f9d-cfb7-4c66-a7a7-1f783a7df023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:27.311649 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:27.312024 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd56f9d-cfb7-4c66-a7a7-1f783a7df023 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:27.317776 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36c522-4942-4566-b480-1d407bf768dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:27.318536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36c522-4942-4566-b480-1d407bf768dc service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:27.318889 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36c522-4942-4566-b480-1d407bf768dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:27.319234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36c522-4942-4566-b480-1d407bf768dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:27.321241 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-fe36c522-4942-4566-b480-1d407bf768dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:27.333838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e4c2aa0e-386a-4011-a999-dcbede3da25b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28eb31f8941744d1bdc3706726676082', 'request_id': 'req-e4c2aa0e-386a-4011-a999-dcbede3da25b'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:27.340445 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e4c2aa0e-386a-4011-a999-dcbede3da25b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28eb31f8941744d1bdc3706726676082', 'request_id': 'req-e4c2aa0e-386a-4011-a999-dcbede3da25b'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:27.346289 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e4c2aa0e-386a-4011-a999-dcbede3da25b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28eb31f8941744d1bdc3706726676082', 'request_id': 'req-e4c2aa0e-386a-4011-a999-dcbede3da25b'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:27.397325 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36c522-4942-4566-b480-1d407bf768dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:27.398958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36c522-4942-4566-b480-1d407bf768dc service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:27.410363 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1016/2026] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:27.436191 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e4c2aa0e-386a-4011-a999-dcbede3da25b admin admin] The token cache is being invalidate because project 28eb31f8941744d1bdc3706726676082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:27.436473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e4c2aa0e-386a-4011-a999-dcbede3da25b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:27.437454 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e4c2aa0e-386a-4011-a999-dcbede3da25b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:27.440267 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1011/2027] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:27 2022] DELETE /identity/v3/projects/28eb31f8941744d1bdc3706726676082 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:27.444321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36c522-4942-4566-b480-1d407bf768dc service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:27.445977 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-fe36c522-4942-4566-b480-1d407bf768dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:27.460888 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36c522-4942-4566-b480-1d407bf768dc service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:27.547483 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fcea2-c7ff-48c2-aec9-2f2f7ec1c9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:27.550562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fcea2-c7ff-48c2-aec9-2f2f7ec1c9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:27.551920 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fcea2-c7ff-48c2-aec9-2f2f7ec1c9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:27.552519 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fcea2-c7ff-48c2-aec9-2f2f7ec1c9f6 admin admin] PATH_INFO: `/v3/users/d78fda4043884c32ba554c68676895dc` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:27.556333 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fcea2-c7ff-48c2-aec9-2f2f7ec1c9f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d78fda4043884c32ba554c68676895dc)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:27.560819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fcea2-c7ff-48c2-aec9-2f2f7ec1c9f6 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:27.740099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2aa0e-386a-4011-a999-dcbede3da25b admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:27.741751 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e4c2aa0e-386a-4011-a999-dcbede3da25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:27.753583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:27.759845 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2aa0e-386a-4011-a999-dcbede3da25b admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:27.768692 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-299fcea2-c7ff-48c2-aec9-2f2f7ec1c9f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd78fda4043884c32ba554c68676895dc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:27.769597 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-299fcea2-c7ff-48c2-aec9-2f2f7ec1c9f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd78fda4043884c32ba554c68676895dc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:27.770165 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57cb2c-2752-4340-95a6-261812469fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:27.771613 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57cb2c-2752-4340-95a6-261812469fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:27.772848 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57cb2c-2752-4340-95a6-261812469fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:27.775666 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57cb2c-2752-4340-95a6-261812469fb8 admin admin] PATH_INFO: `/v3/projects/25c6c676d27b4f8fb35b98e16f66a722` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:27.776090 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57cb2c-2752-4340-95a6-261812469fb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25c6c676d27b4f8fb35b98e16f66a722)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:27.782224 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57cb2c-2752-4340-95a6-261812469fb8 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:27.872439 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-299fcea2-c7ff-48c2-aec9-2f2f7ec1c9f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd78fda4043884c32ba554c68676895dc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:27.886974 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-299fcea2-c7ff-48c2-aec9-2f2f7ec1c9f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd78fda4043884c32ba554c68676895dc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:27.895243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-299fcea2-c7ff-48c2-aec9-2f2f7ec1c9f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd78fda4043884c32ba554c68676895dc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:27.902587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1017/2028] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:27 2022] DELETE /identity/v3/users/d78fda4043884c32ba554c68676895dc => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:27.948258 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1d57cb2c-2752-4340-95a6-261812469fb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25c6c676d27b4f8fb35b98e16f66a722', 'request_id': 'req-1d57cb2c-2752-4340-95a6-261812469fb8'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:27.956437 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1d57cb2c-2752-4340-95a6-261812469fb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25c6c676d27b4f8fb35b98e16f66a722', 'request_id': 'req-1d57cb2c-2752-4340-95a6-261812469fb8'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:27.961723 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fcea2-c7ff-48c2-aec9-2f2f7ec1c9f6 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:27.963344 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-299fcea2-c7ff-48c2-aec9-2f2f7ec1c9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:27.976238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1d57cb2c-2752-4340-95a6-261812469fb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25c6c676d27b4f8fb35b98e16f66a722', 'request_id': 'req-1d57cb2c-2752-4340-95a6-261812469fb8'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:28.067803 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fcea2-c7ff-48c2-aec9-2f2f7ec1c9f6 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:28.093870 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1d57cb2c-2752-4340-95a6-261812469fb8 admin admin] The token cache is being invalidate because project 25c6c676d27b4f8fb35b98e16f66a722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:28.094286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1d57cb2c-2752-4340-95a6-261812469fb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:28.095831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1d57cb2c-2752-4340-95a6-261812469fb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:28.098637 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1012/2029] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:27 2022] DELETE /identity/v3/projects/25c6c676d27b4f8fb35b98e16f66a722 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:28.105393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a09cc5-dbda-4237-864d-9ace25d1724e None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:28.105788 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a09cc5-dbda-4237-864d-9ace25d1724e None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:28.106135 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a09cc5-dbda-4237-864d-9ace25d1724e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:28.137129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-01a09cc5-dbda-4237-864d-9ace25d1724e None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:28.138907 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-01a09cc5-dbda-4237-864d-9ace25d1724e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:28.200542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8495bf-c226-4c40-abf4-ff54dd198272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:28.201744 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8495bf-c226-4c40-abf4-ff54dd198272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:28.213772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8495bf-c226-4c40-abf4-ff54dd198272 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:28.214458 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8495bf-c226-4c40-abf4-ff54dd198272 admin admin] PATH_INFO: `/v3/projects/42d0701517124a9f921abad4f03172e4` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:28.219413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8495bf-c226-4c40-abf4-ff54dd198272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42d0701517124a9f921abad4f03172e4)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:28.225934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8495bf-c226-4c40-abf4-ff54dd198272 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:28.277275 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1013/2030] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:28.290721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447c151-ef87-4dc0-8034-fb24e15cb464 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:28.291144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447c151-ef87-4dc0-8034-fb24e15cb464 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:28.292419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447c151-ef87-4dc0-8034-fb24e15cb464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:28.327314 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:28.343665 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-b447c151-ef87-4dc0-8034-fb24e15cb464 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:28.346444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b447c151-ef87-4dc0-8034-fb24e15cb464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:28.366458 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1014/2031] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:28.370625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447c151-ef87-4dc0-8034-fb24e15cb464 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:28.388813 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447c151-ef87-4dc0-8034-fb24e15cb464 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:28.400364 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db32e2a-aebb-4712-addf-17459fbc95d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:28.401020 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db32e2a-aebb-4712-addf-17459fbc95d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:28.402216 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db32e2a-aebb-4712-addf-17459fbc95d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:28.402216 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db32e2a-aebb-4712-addf-17459fbc95d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:28.402687 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db32e2a-aebb-4712-addf-17459fbc95d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:03:28.402811 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db32e2a-aebb-4712-addf-17459fbc95d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:28.404694 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db32e2a-aebb-4712-addf-17459fbc95d6 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:28.423924 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1015/2032] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:03:28.428067 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db32e2a-aebb-4712-addf-17459fbc95d6 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:28.445279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db32e2a-aebb-4712-addf-17459fbc95d6 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:28.446896 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-eb8495bf-c226-4c40-abf4-ff54dd198272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d0701517124a9f921abad4f03172e4', 'request_id': 'req-eb8495bf-c226-4c40-abf4-ff54dd198272'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:28.526802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed100ff6-01b8-4ea3-bfd9-63b4cb3e9d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:28.527494 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed100ff6-01b8-4ea3-bfd9-63b4cb3e9d86 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:28.527820 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed100ff6-01b8-4ea3-bfd9-63b4cb3e9d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:28.528049 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed100ff6-01b8-4ea3-bfd9-63b4cb3e9d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:28.528742 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed100ff6-01b8-4ea3-bfd9-63b4cb3e9d86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:28.530702 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed100ff6-01b8-4ea3-bfd9-63b4cb3e9d86 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:28.554101 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-eb8495bf-c226-4c40-abf4-ff54dd198272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d0701517124a9f921abad4f03172e4', 'request_id': 'req-eb8495bf-c226-4c40-abf4-ff54dd198272'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:28.570283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-eb8495bf-c226-4c40-abf4-ff54dd198272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d0701517124a9f921abad4f03172e4', 'request_id': 'req-eb8495bf-c226-4c40-abf4-ff54dd198272'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:28.587877 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-eb8495bf-c226-4c40-abf4-ff54dd198272 admin admin] The token cache is being invalidate because project 42d0701517124a9f921abad4f03172e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:28.588183 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-eb8495bf-c226-4c40-abf4-ff54dd198272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:28.588897 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-eb8495bf-c226-4c40-abf4-ff54dd198272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:28.590537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1018/2033] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:27 2022] DELETE /identity/v3/projects/42d0701517124a9f921abad4f03172e4 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:28.591560 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8495bf-c226-4c40-abf4-ff54dd198272 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:28.593334 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-eb8495bf-c226-4c40-abf4-ff54dd198272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:28.610326 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8495bf-c226-4c40-abf4-ff54dd198272 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:28.616478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b932b3c-25e3-422c-8cdf-a19106d67ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:28.617165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b932b3c-25e3-422c-8cdf-a19106d67ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:28.617443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b932b3c-25e3-422c-8cdf-a19106d67ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:28.617723 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b932b3c-25e3-422c-8cdf-a19106d67ae4 admin admin] PATH_INFO: `/v3/projects/b6be52630fa245edb741a3673d9ef0df` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:28.618948 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b932b3c-25e3-422c-8cdf-a19106d67ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6be52630fa245edb741a3673d9ef0df)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:28.621428 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b932b3c-25e3-422c-8cdf-a19106d67ae4 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:28.666821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1016/2034] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:28 2022] POST /identity/v3/projects => generated 385 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:28.667627 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed100ff6-01b8-4ea3-bfd9-63b4cb3e9d86 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:28.670159 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ed100ff6-01b8-4ea3-bfd9-63b4cb3e9d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:28.755449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed100ff6-01b8-4ea3-bfd9-63b4cb3e9d86 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:28.760797 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0551c4-5104-4538-9072-4384b2fc60e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:28.761506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0551c4-5104-4538-9072-4384b2fc60e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:28.761794 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0551c4-5104-4538-9072-4384b2fc60e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:28.762104 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0551c4-5104-4538-9072-4384b2fc60e9 admin admin] PATH_INFO: `/v3/users/541f0566859846f9802774c355b34683` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:28.764913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0551c4-5104-4538-9072-4384b2fc60e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=541f0566859846f9802774c355b34683)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:28.767044 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0551c4-5104-4538-9072-4384b2fc60e9 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:28.812405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-5b932b3c-25e3-422c-8cdf-a19106d67ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6be52630fa245edb741a3673d9ef0df', 'request_id': 'req-5b932b3c-25e3-422c-8cdf-a19106d67ae4'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:28.968815 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-5b932b3c-25e3-422c-8cdf-a19106d67ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6be52630fa245edb741a3673d9ef0df', 'request_id': 'req-5b932b3c-25e3-422c-8cdf-a19106d67ae4'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:28.992783 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-5b932b3c-25e3-422c-8cdf-a19106d67ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6be52630fa245edb741a3673d9ef0df', 'request_id': 'req-5b932b3c-25e3-422c-8cdf-a19106d67ae4'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:29.018196 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-5b932b3c-25e3-422c-8cdf-a19106d67ae4 admin admin] The token cache is being invalidate because project b6be52630fa245edb741a3673d9ef0df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:29.018503 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-5b932b3c-25e3-422c-8cdf-a19106d67ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:29.021481 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-5b932b3c-25e3-422c-8cdf-a19106d67ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:29.026004 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1019/2035] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:28 2022] DELETE /identity/v3/projects/b6be52630fa245edb741a3673d9ef0df => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:29.027100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b932b3c-25e3-422c-8cdf-a19106d67ae4 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:29.029434 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-5b932b3c-25e3-422c-8cdf-a19106d67ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:29.106572 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-cf0551c4-5104-4538-9072-4384b2fc60e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '541f0566859846f9802774c355b34683'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:29.108114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-cf0551c4-5104-4538-9072-4384b2fc60e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '541f0566859846f9802774c355b34683'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:29.112492 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b932b3c-25e3-422c-8cdf-a19106d67ae4 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:29.117906 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0860de-e6da-41f5-8090-5c21dacf9920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:29.118975 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0860de-e6da-41f5-8090-5c21dacf9920 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:29.119247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0860de-e6da-41f5-8090-5c21dacf9920 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:29.119562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0860de-e6da-41f5-8090-5c21dacf9920 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:29.120257 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0860de-e6da-41f5-8090-5c21dacf9920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:29.122309 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0860de-e6da-41f5-8090-5c21dacf9920 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:29.211642 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-cf0551c4-5104-4538-9072-4384b2fc60e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '541f0566859846f9802774c355b34683'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:29.222763 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1020/2036] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:29 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:29.225189 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-cf0551c4-5104-4538-9072-4384b2fc60e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '541f0566859846f9802774c355b34683'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:29.225413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2c14e-8851-47ec-8c29-e898c5def759 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:29.225921 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2c14e-8851-47ec-8c29-e898c5def759 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:29.226350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2c14e-8851-47ec-8c29-e898c5def759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:29.246082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-cf0551c4-5104-4538-9072-4384b2fc60e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '541f0566859846f9802774c355b34683'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:29.255482 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1017/2037] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:28 2022] DELETE /identity/v3/users/541f0566859846f9802774c355b34683 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:29.257600 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0551c4-5104-4538-9072-4384b2fc60e9 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:29.259848 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-cf0551c4-5104-4538-9072-4384b2fc60e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:29.264544 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-d5c2c14e-8851-47ec-8c29-e898c5def759 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:29.281170 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d5c2c14e-8851-47ec-8c29-e898c5def759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:29.370517 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0551c4-5104-4538-9072-4384b2fc60e9 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:29.375850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088f4c4-8d7e-4c96-87e3-c452dd2939b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:29.377520 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088f4c4-8d7e-4c96-87e3-c452dd2939b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:29.378135 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088f4c4-8d7e-4c96-87e3-c452dd2939b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:29.378519 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088f4c4-8d7e-4c96-87e3-c452dd2939b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:29.379465 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088f4c4-8d7e-4c96-87e3-c452dd2939b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:29.381325 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088f4c4-8d7e-4c96-87e3-c452dd2939b1 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:29.393793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1018/2038] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:29.397933 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088f4c4-8d7e-4c96-87e3-c452dd2939b1 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:29.409434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088f4c4-8d7e-4c96-87e3-c452dd2939b1 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:29.414869 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1021/2039] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:29.416695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4d44f-3fa1-4528-a8d2-c169f345d874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:29.417376 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4d44f-3fa1-4528-a8d2-c169f345d874 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:29.418940 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4d44f-3fa1-4528-a8d2-c169f345d874 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:29.418940 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4d44f-3fa1-4528-a8d2-c169f345d874 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:29.418940 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4d44f-3fa1-4528-a8d2-c169f345d874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:29.420480 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4d44f-3fa1-4528-a8d2-c169f345d874 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:29.427874 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6390b-b9da-44e3-b8db-2e071d95cd8b None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:29.428169 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6390b-b9da-44e3-b8db-2e071d95cd8b None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:29.428444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6390b-b9da-44e3-b8db-2e071d95cd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:29.433051 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1019/2040] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:29.437378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4d44f-3fa1-4528-a8d2-c169f345d874 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:29.451742 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4d44f-3fa1-4528-a8d2-c169f345d874 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:29.456593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-35b6390b-b9da-44e3-b8db-2e071d95cd8b None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:29.459512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ca6b3-8051-4048-9013-5b71bda8f63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:29.460027 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-35b6390b-b9da-44e3-b8db-2e071d95cd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:29.460218 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ca6b3-8051-4048-9013-5b71bda8f63e admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:29.460500 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ca6b3-8051-4048-9013-5b71bda8f63e admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:29.460781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ca6b3-8051-4048-9013-5b71bda8f63e admin admin] PATH_INFO: `/v3/projects/7fedbbb43820455d8c168c04739197d2/users/31ae6302470c4c5a89ffe2c39d264e70/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:29.474774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1022/2041] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:29.480459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ca6b3-8051-4048-9013-5b71bda8f63e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fedbbb43820455d8c168c04739197d2, user_id=31ae6302470c4c5a89ffe2c39d264e70, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:29.480924 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6390b-b9da-44e3-b8db-2e071d95cd8b None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:29.483296 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ca6b3-8051-4048-9013-5b71bda8f63e admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:29.496895 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:29.498567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6390b-b9da-44e3-b8db-2e071d95cd8b None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:29.506107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65f009-aa29-4512-9a11-e41f494be7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:29.506684 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65f009-aa29-4512-9a11-e41f494be7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:29.507234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65f009-aa29-4512-9a11-e41f494be7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:29.507541 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65f009-aa29-4512-9a11-e41f494be7c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:29.508275 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65f009-aa29-4512-9a11-e41f494be7c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:03:29.508568 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65f009-aa29-4512-9a11-e41f494be7c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:29.510231 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65f009-aa29-4512-9a11-e41f494be7c6 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:29.525672 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1023/2042] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 04:03:29.530464 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65f009-aa29-4512-9a11-e41f494be7c6 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:29.542368 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65f009-aa29-4512-9a11-e41f494be7c6 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:29.547473 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371b14f-e7dd-4b4f-a7af-96d32b361daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:29.548142 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371b14f-e7dd-4b4f-a7af-96d32b361daa admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:29.548513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371b14f-e7dd-4b4f-a7af-96d32b361daa admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:29.549479 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371b14f-e7dd-4b4f-a7af-96d32b361daa admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:29.550189 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371b14f-e7dd-4b4f-a7af-96d32b361daa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:29.552199 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371b14f-e7dd-4b4f-a7af-96d32b361daa admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:29.593238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1020/2043] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:29 2022] PUT /identity/v3/projects/7fedbbb43820455d8c168c04739197d2/users/31ae6302470c4c5a89ffe2c39d264e70/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:29.608348 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369cfa7-3426-43fa-887d-e49600ced0cb None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:29.608662 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369cfa7-3426-43fa-887d-e49600ced0cb None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:29.608972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369cfa7-3426-43fa-887d-e49600ced0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:29.643164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-4369cfa7-3426-43fa-887d-e49600ced0cb None None] MFA Rules not processed for user `31ae6302470c4c5a89ffe2c39d264e70`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:29.644502 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-4369cfa7-3426-43fa-887d-e49600ced0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:29.698722 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1024/2044] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:29 2022] POST /identity/v3/projects => generated 389 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:03:29.701230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371b14f-e7dd-4b4f-a7af-96d32b361daa admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:29.746859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1021/2045] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:29.765033 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369cfa7-3426-43fa-887d-e49600ced0cb None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:29.770932 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-4369cfa7-3426-43fa-887d-e49600ced0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:29.794212 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371b14f-e7dd-4b4f-a7af-96d32b361daa admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:29.801615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812de2c6-f0d8-4885-8a6b-aff8efb8b7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:29.802288 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812de2c6-f0d8-4885-8a6b-aff8efb8b7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:29.802576 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812de2c6-f0d8-4885-8a6b-aff8efb8b7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:29.802860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812de2c6-f0d8-4885-8a6b-aff8efb8b7f5 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:29.803637 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812de2c6-f0d8-4885-8a6b-aff8efb8b7f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:29.805605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812de2c6-f0d8-4885-8a6b-aff8efb8b7f5 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:29.852994 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369cfa7-3426-43fa-887d-e49600ced0cb None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:29.901055 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1025/2046] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:29 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:29.901055 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812de2c6-f0d8-4885-8a6b-aff8efb8b7f5 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:29.901055 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-812de2c6-f0d8-4885-8a6b-aff8efb8b7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:29.914192 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812de2c6-f0d8-4885-8a6b-aff8efb8b7f5 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:29.919261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4deac-9995-4253-8167-1d173e22f92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:29.921091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4deac-9995-4253-8167-1d173e22f92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:29.921091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4deac-9995-4253-8167-1d173e22f92f admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:29.921091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4deac-9995-4253-8167-1d173e22f92f admin admin] PATH_INFO: `/v3/projects/d14afe98728748618166da6a9465c7f0` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:29.928142 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4deac-9995-4253-8167-1d173e22f92f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d14afe98728748618166da6a9465c7f0)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:29.928142 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4deac-9995-4253-8167-1d173e22f92f admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:29.928443 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc56f9-1bfb-4b5a-9f8a-988583b64151 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:29.929059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc56f9-1bfb-4b5a-9f8a-988583b64151 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:29.929342 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc56f9-1bfb-4b5a-9f8a-988583b64151 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:29.929623 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc56f9-1bfb-4b5a-9f8a-988583b64151 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:30.003488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc56f9-1bfb-4b5a-9f8a-988583b64151 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:30.007576 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc56f9-1bfb-4b5a-9f8a-988583b64151 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:30.015308 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1022/2047] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:30.016209 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc56f9-1bfb-4b5a-9f8a-988583b64151 service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:30.029033 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc56f9-1bfb-4b5a-9f8a-988583b64151 service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:30.037047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648817fc-2bc5-42f1-ad6b-e51a89be01e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:30.037885 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648817fc-2bc5-42f1-ad6b-e51a89be01e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:30.038284 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648817fc-2bc5-42f1-ad6b-e51a89be01e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:30.038459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648817fc-2bc5-42f1-ad6b-e51a89be01e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:30.039311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648817fc-2bc5-42f1-ad6b-e51a89be01e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:30.041206 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648817fc-2bc5-42f1-ad6b-e51a89be01e4 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:30.054479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1023/2048] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:30.055392 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648817fc-2bc5-42f1-ad6b-e51a89be01e4 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:30.068318 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648817fc-2bc5-42f1-ad6b-e51a89be01e4 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:30.077565 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac2f99-bfef-46bf-a3c9-1b3b04459616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:30.079201 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac2f99-bfef-46bf-a3c9-1b3b04459616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:30.079405 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac2f99-bfef-46bf-a3c9-1b3b04459616 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:30.080473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac2f99-bfef-46bf-a3c9-1b3b04459616 admin admin] PATH_INFO: `/v3/users/31ae6302470c4c5a89ffe2c39d264e70` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:30.083721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac2f99-bfef-46bf-a3c9-1b3b04459616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ae6302470c4c5a89ffe2c39d264e70)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:30.087652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac2f99-bfef-46bf-a3c9-1b3b04459616 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:30.092596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-97a4deac-9995-4253-8167-1d173e22f92f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd14afe98728748618166da6a9465c7f0', 'request_id': 'req-97a4deac-9995-4253-8167-1d173e22f92f'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:30.185154 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-97a4deac-9995-4253-8167-1d173e22f92f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd14afe98728748618166da6a9465c7f0', 'request_id': 'req-97a4deac-9995-4253-8167-1d173e22f92f'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:30.195285 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-97a4deac-9995-4253-8167-1d173e22f92f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd14afe98728748618166da6a9465c7f0', 'request_id': 'req-97a4deac-9995-4253-8167-1d173e22f92f'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:30.212303 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-97a4deac-9995-4253-8167-1d173e22f92f admin admin] The token cache is being invalidate because project d14afe98728748618166da6a9465c7f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:30.212500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-97a4deac-9995-4253-8167-1d173e22f92f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:30.213182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-97a4deac-9995-4253-8167-1d173e22f92f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:30.215073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1026/2049] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:29 2022] DELETE /identity/v3/projects/d14afe98728748618166da6a9465c7f0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:30.219291 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4deac-9995-4253-8167-1d173e22f92f admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:30.222113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-97a4deac-9995-4253-8167-1d173e22f92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:30.293176 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4deac-9995-4253-8167-1d173e22f92f admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:30.299246 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bf222-8b1e-403a-8f65-619eb1093c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:30.300124 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bf222-8b1e-403a-8f65-619eb1093c1b admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:30.300410 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bf222-8b1e-403a-8f65-619eb1093c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:30.300690 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bf222-8b1e-403a-8f65-619eb1093c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:30.301407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bf222-8b1e-403a-8f65-619eb1093c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:30.303172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bf222-8b1e-403a-8f65-619eb1093c1b admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:30.320147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1027/2050] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:30.320147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f7021-d6a5-4d2b-b351-c95ead939829 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:30.320147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f7021-d6a5-4d2b-b351-c95ead939829 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:30.320147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f7021-d6a5-4d2b-b351-c95ead939829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:30.340541 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-ca2f7021-d6a5-4d2b-b351-c95ead939829 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:30.340753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-d0ac2f99-bfef-46bf-a3c9-1b3b04459616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ae6302470c4c5a89ffe2c39d264e70'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:30.342071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-d0ac2f99-bfef-46bf-a3c9-1b3b04459616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ae6302470c4c5a89ffe2c39d264e70'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:30.342216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ca2f7021-d6a5-4d2b-b351-c95ead939829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:30.351835 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1028/2051] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:30.352836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f7021-d6a5-4d2b-b351-c95ead939829 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:30.354175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ca2f7021-d6a5-4d2b-b351-c95ead939829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:30.367031 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f7021-d6a5-4d2b-b351-c95ead939829 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:30.371747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2a887-7f3c-4891-9a8f-1d287267234b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:30.372435 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2a887-7f3c-4891-9a8f-1d287267234b admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:30.372714 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2a887-7f3c-4891-9a8f-1d287267234b admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:30.372987 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2a887-7f3c-4891-9a8f-1d287267234b admin admin] PATH_INFO: `/v3/projects/2da2e747a23c46b8a547c80ac6fdb6fa/users/65853e85d5e648519939dc0baa05b9e4/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:30.390824 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2a887-7f3c-4891-9a8f-1d287267234b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da2e747a23c46b8a547c80ac6fdb6fa, user_id=65853e85d5e648519939dc0baa05b9e4, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:30.393785 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2a887-7f3c-4891-9a8f-1d287267234b admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:30.433918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:30.435345 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-d0ac2f99-bfef-46bf-a3c9-1b3b04459616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ae6302470c4c5a89ffe2c39d264e70'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:30.450327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-d0ac2f99-bfef-46bf-a3c9-1b3b04459616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ae6302470c4c5a89ffe2c39d264e70'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:30.466571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-d0ac2f99-bfef-46bf-a3c9-1b3b04459616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ae6302470c4c5a89ffe2c39d264e70'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:30.474674 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1024/2052] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:30 2022] DELETE /identity/v3/users/31ae6302470c4c5a89ffe2c39d264e70 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:30.479352 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ea149-9a45-4860-b975-8e4f991057dd None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:30.479617 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ea149-9a45-4860-b975-8e4f991057dd None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:30.480063 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ea149-9a45-4860-b975-8e4f991057dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:30.505615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1029/2053] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:30 2022] PUT /identity/v3/projects/2da2e747a23c46b8a547c80ac6fdb6fa/users/65853e85d5e648519939dc0baa05b9e4/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:30.507741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f2bd8-90f8-4f29-ba55-2d74d9a77b8e None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:30.507987 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f2bd8-90f8-4f29-ba55-2d74d9a77b8e None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:30.508354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f2bd8-90f8-4f29-ba55-2d74d9a77b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:30.535673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-ba6ea149-9a45-4860-b975-8e4f991057dd None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:30.535673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ba6ea149-9a45-4860-b975-8e4f991057dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:30.549511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-d39f2bd8-90f8-4f29-ba55-2d74d9a77b8e None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:30.550767 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d39f2bd8-90f8-4f29-ba55-2d74d9a77b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:30.617472 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1025/2054] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:30.618905 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51060319-92b5-4386-80c5-27e23ed2faf3 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:30.619266 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51060319-92b5-4386-80c5-27e23ed2faf3 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:30.619898 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51060319-92b5-4386-80c5-27e23ed2faf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:30.631202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1030/2055] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:30.632946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f2bd8-90f8-4f29-ba55-2d74d9a77b8e None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:30.644265 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f2bd8-90f8-4f29-ba55-2d74d9a77b8e None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:30.650403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c13fa-e2bc-4d28-99d2-4742d4de8980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:30.651049 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c13fa-e2bc-4d28-99d2-4742d4de8980 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:30.651360 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c13fa-e2bc-4d28-99d2-4742d4de8980 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:30.651626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c13fa-e2bc-4d28-99d2-4742d4de8980 admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:30.652342 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c13fa-e2bc-4d28-99d2-4742d4de8980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:03:30.652644 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c13fa-e2bc-4d28-99d2-4742d4de8980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:30.654043 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-51060319-92b5-4386-80c5-27e23ed2faf3 None None] MFA Rules not processed for user `65853e85d5e648519939dc0baa05b9e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:30.656221 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c13fa-e2bc-4d28-99d2-4742d4de8980 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:30.656667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-51060319-92b5-4386-80c5-27e23ed2faf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:30.686532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1031/2056] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:03:30.686532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c13fa-e2bc-4d28-99d2-4742d4de8980 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:30.686532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a30c13fa-e2bc-4d28-99d2-4742d4de8980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:30.741647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1026/2057] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:30.743161 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51060319-92b5-4386-80c5-27e23ed2faf3 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:30.755247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c13fa-e2bc-4d28-99d2-4742d4de8980 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:30.759094 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51060319-92b5-4386-80c5-27e23ed2faf3 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:30.759670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60764097-1c09-4d89-b5a9-2d9f38e0d11e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:30.760393 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60764097-1c09-4d89-b5a9-2d9f38e0d11e service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:30.760683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60764097-1c09-4d89-b5a9-2d9f38e0d11e service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:30.760962 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60764097-1c09-4d89-b5a9-2d9f38e0d11e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:30.764521 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a47d3-1a2b-47ac-9677-f487c94130cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:30.765169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a47d3-1a2b-47ac-9677-f487c94130cd admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:30.766093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a47d3-1a2b-47ac-9677-f487c94130cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:30.766093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a47d3-1a2b-47ac-9677-f487c94130cd admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:30.779687 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a47d3-1a2b-47ac-9677-f487c94130cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:30.779687 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a47d3-1a2b-47ac-9677-f487c94130cd admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:30.780282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60764097-1c09-4d89-b5a9-2d9f38e0d11e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:30.780282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60764097-1c09-4d89-b5a9-2d9f38e0d11e service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:30.788302 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1032/2058] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:30.789168 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60764097-1c09-4d89-b5a9-2d9f38e0d11e service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:30.802677 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60764097-1c09-4d89-b5a9-2d9f38e0d11e service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:30.810301 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d927b7-a6ec-4506-9572-0040ff9fd7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:30.811042 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d927b7-a6ec-4506-9572-0040ff9fd7fd admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:30.811424 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d927b7-a6ec-4506-9572-0040ff9fd7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:30.811750 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d927b7-a6ec-4506-9572-0040ff9fd7fd admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:30.812484 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d927b7-a6ec-4506-9572-0040ff9fd7fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:30.816464 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d927b7-a6ec-4506-9572-0040ff9fd7fd admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:30.858820 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1027/2059] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:30 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:30.863172 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a47d3-1a2b-47ac-9677-f487c94130cd admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:30.926487 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a47d3-1a2b-47ac-9677-f487c94130cd admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:30.931953 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b256c5d-b442-4ee7-9ab5-4057654a60b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:30.932619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b256c5d-b442-4ee7-9ab5-4057654a60b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:30.932905 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b256c5d-b442-4ee7-9ab5-4057654a60b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:30.933181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b256c5d-b442-4ee7-9ab5-4057654a60b8 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:30.933937 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b256c5d-b442-4ee7-9ab5-4057654a60b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:30.935872 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b256c5d-b442-4ee7-9ab5-4057654a60b8 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:30.973532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1033/2060] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:30 2022] POST /identity/v3/projects => generated 389 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:30.974671 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d927b7-a6ec-4506-9572-0040ff9fd7fd admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:31.037517 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1028/2061] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:30 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:03:31.043122 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b256c5d-b442-4ee7-9ab5-4057654a60b8 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:31.065778 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b256c5d-b442-4ee7-9ab5-4057654a60b8 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:31.134798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d927b7-a6ec-4506-9572-0040ff9fd7fd admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:31.140283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88e884-314b-4e22-a9a6-463af577ef77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:31.140529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88e884-314b-4e22-a9a6-463af577ef77 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:31.140815 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88e884-314b-4e22-a9a6-463af577ef77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:31.141092 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88e884-314b-4e22-a9a6-463af577ef77 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:31.141827 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88e884-314b-4e22-a9a6-463af577ef77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:31.144583 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d88e884-314b-4e22-a9a6-463af577ef77 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:31.172765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be92b0c-b121-4ef2-9da5-e61e6cc2f79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:31.174292 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be92b0c-b121-4ef2-9da5-e61e6cc2f79a admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:31.174624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be92b0c-b121-4ef2-9da5-e61e6cc2f79a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:31.175043 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be92b0c-b121-4ef2-9da5-e61e6cc2f79a admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:31.175815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be92b0c-b121-4ef2-9da5-e61e6cc2f79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:31.177292 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be92b0c-b121-4ef2-9da5-e61e6cc2f79a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:31.191366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1029/2062] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:31.194006 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be92b0c-b121-4ef2-9da5-e61e6cc2f79a admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:31.205440 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be92b0c-b121-4ef2-9da5-e61e6cc2f79a admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:31.211870 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc2cef-9020-4eb0-81b1-14f963506fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:31.212530 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc2cef-9020-4eb0-81b1-14f963506fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:31.212989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc2cef-9020-4eb0-81b1-14f963506fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:31.213279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc2cef-9020-4eb0-81b1-14f963506fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:31.214006 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc2cef-9020-4eb0-81b1-14f963506fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:31.215888 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc2cef-9020-4eb0-81b1-14f963506fd6 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:31.229619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1030/2063] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:31.233811 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc2cef-9020-4eb0-81b1-14f963506fd6 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:31.244164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc2cef-9020-4eb0-81b1-14f963506fd6 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:31.249755 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ed9e9-dde9-4cb3-a4bb-592dea9e03c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:31.250446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ed9e9-dde9-4cb3-a4bb-592dea9e03c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:31.250724 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ed9e9-dde9-4cb3-a4bb-592dea9e03c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:31.250996 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ed9e9-dde9-4cb3-a4bb-592dea9e03c2 admin admin] PATH_INFO: `/v3/projects/98e30ade167c4f3da2cf944cc52f6bd8/users/a7ec9c5e6ce1480687cc4b705d7d0467/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:31.263896 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1034/2064] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:30 2022] POST /identity/v3/users => generated 301 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:31.271181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ed9e9-dde9-4cb3-a4bb-592dea9e03c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98e30ade167c4f3da2cf944cc52f6bd8, user_id=a7ec9c5e6ce1480687cc4b705d7d0467, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:31.273926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ed9e9-dde9-4cb3-a4bb-592dea9e03c2 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:31.275478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88e884-314b-4e22-a9a6-463af577ef77 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:31.287477 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88e884-314b-4e22-a9a6-463af577ef77 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:31.294863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:31.295438 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a94364-13ac-4b93-a3f4-cf4801cb4dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:31.296143 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a94364-13ac-4b93-a3f4-cf4801cb4dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:31.296504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a94364-13ac-4b93-a3f4-cf4801cb4dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:31.296782 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a94364-13ac-4b93-a3f4-cf4801cb4dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:31.297511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a94364-13ac-4b93-a3f4-cf4801cb4dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:31.299251 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a94364-13ac-4b93-a3f4-cf4801cb4dc3 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:31.327649 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1035/2065] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:31.332850 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a94364-13ac-4b93-a3f4-cf4801cb4dc3 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:31.346253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a94364-13ac-4b93-a3f4-cf4801cb4dc3 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:31.351715 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6f066-26ec-43eb-be97-7b83d9c4748c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:31.352513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6f066-26ec-43eb-be97-7b83d9c4748c admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:31.352867 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6f066-26ec-43eb-be97-7b83d9c4748c admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:31.353348 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6f066-26ec-43eb-be97-7b83d9c4748c admin admin] PATH_INFO: `/v3/projects/7c71d3e0346d4fbb9f647227d44fcd77/users/6bddbd1359aa49dfa6452a82ced13b92/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:31.371094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6f066-26ec-43eb-be97-7b83d9c4748c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c71d3e0346d4fbb9f647227d44fcd77, user_id=6bddbd1359aa49dfa6452a82ced13b92, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:31.374213 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6f066-26ec-43eb-be97-7b83d9c4748c admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:31.412671 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1031/2066] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:31 2022] PUT /identity/v3/projects/98e30ade167c4f3da2cf944cc52f6bd8/users/a7ec9c5e6ce1480687cc4b705d7d0467/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:31.424365 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880341b-fefb-46e7-9aaf-dbc34c512bb7 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:31.424714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880341b-fefb-46e7-9aaf-dbc34c512bb7 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:31.424919 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880341b-fefb-46e7-9aaf-dbc34c512bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:31.457559 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-3880341b-fefb-46e7-9aaf-dbc34c512bb7 None None] MFA Rules not processed for user `a7ec9c5e6ce1480687cc4b705d7d0467`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:31.458958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-3880341b-fefb-46e7-9aaf-dbc34c512bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:31.488442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1036/2067] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:31 2022] PUT /identity/v3/projects/7c71d3e0346d4fbb9f647227d44fcd77/users/6bddbd1359aa49dfa6452a82ced13b92/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:31.492273 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6f066-26ec-43eb-be97-7b83d9c4748c admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:31.534933 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1032/2068] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:31.548091 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880341b-fefb-46e7-9aaf-dbc34c512bb7 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:31.550475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-3880341b-fefb-46e7-9aaf-dbc34c512bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:31.586167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6f066-26ec-43eb-be97-7b83d9c4748c admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:31.596222 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df7721-206c-4d7f-a5f3-9db5299c638e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:31.597177 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df7721-206c-4d7f-a5f3-9db5299c638e admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:31.597469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df7721-206c-4d7f-a5f3-9db5299c638e admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:31.602828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df7721-206c-4d7f-a5f3-9db5299c638e admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:31.602828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df7721-206c-4d7f-a5f3-9db5299c638e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:31.602828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df7721-206c-4d7f-a5f3-9db5299c638e admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:31.619223 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1037/2069] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:31.628970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df7721-206c-4d7f-a5f3-9db5299c638e admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:31.630354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b3df7721-206c-4d7f-a5f3-9db5299c638e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:31.654401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df7721-206c-4d7f-a5f3-9db5299c638e admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:31.660161 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b4a67-ad88-47c9-aa2f-0717ab1f8fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:31.660847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b4a67-ad88-47c9-aa2f-0717ab1f8fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:31.661135 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b4a67-ad88-47c9-aa2f-0717ab1f8fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:31.661415 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b4a67-ad88-47c9-aa2f-0717ab1f8fc2 admin admin] PATH_INFO: `/v3/projects/7fedbbb43820455d8c168c04739197d2` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:31.663873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880341b-fefb-46e7-9aaf-dbc34c512bb7 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:31.664341 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b4a67-ad88-47c9-aa2f-0717ab1f8fc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fedbbb43820455d8c168c04739197d2)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:31.667596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b4a67-ad88-47c9-aa2f-0717ab1f8fc2 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:31.735232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e918f-27e1-4799-b1d7-1beca80974a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:31.735987 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e918f-27e1-4799-b1d7-1beca80974a4 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:31.736267 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e918f-27e1-4799-b1d7-1beca80974a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:31.736546 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e918f-27e1-4799-b1d7-1beca80974a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:31.823305 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e918f-27e1-4799-b1d7-1beca80974a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:31.825960 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e918f-27e1-4799-b1d7-1beca80974a4 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:31.834129 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-0c8b4a67-ad88-47c9-aa2f-0717ab1f8fc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fedbbb43820455d8c168c04739197d2', 'request_id': 'req-0c8b4a67-ad88-47c9-aa2f-0717ab1f8fc2'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:31.843214 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1033/2070] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:31.845761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e918f-27e1-4799-b1d7-1beca80974a4 service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:31.864973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e918f-27e1-4799-b1d7-1beca80974a4 service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:31.937280 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ccc06-802b-4c12-8b18-399fc47d1655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:31.937976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ccc06-802b-4c12-8b18-399fc47d1655 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:31.938257 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ccc06-802b-4c12-8b18-399fc47d1655 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:31.938533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ccc06-802b-4c12-8b18-399fc47d1655 admin admin] PATH_INFO: `/v3/projects/7c71d3e0346d4fbb9f647227d44fcd77/users/6bddbd1359aa49dfa6452a82ced13b92/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:31.941131 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ccc06-802b-4c12-8b18-399fc47d1655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c71d3e0346d4fbb9f647227d44fcd77, user_id=6bddbd1359aa49dfa6452a82ced13b92, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:31.947527 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-0c8b4a67-ad88-47c9-aa2f-0717ab1f8fc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fedbbb43820455d8c168c04739197d2', 'request_id': 'req-0c8b4a67-ad88-47c9-aa2f-0717ab1f8fc2'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:31.947670 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ccc06-802b-4c12-8b18-399fc47d1655 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:31.947794 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-0c8b4a67-ad88-47c9-aa2f-0717ab1f8fc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fedbbb43820455d8c168c04739197d2', 'request_id': 'req-0c8b4a67-ad88-47c9-aa2f-0717ab1f8fc2'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:31.957062 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1034/2071] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:31 2022] PUT /identity/v3/projects/7c71d3e0346d4fbb9f647227d44fcd77/users/6bddbd1359aa49dfa6452a82ced13b92/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:31.957757 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ccc06-802b-4c12-8b18-399fc47d1655 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:31.967477 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-0c8b4a67-ad88-47c9-aa2f-0717ab1f8fc2 admin admin] The token cache is being invalidate because project 7fedbbb43820455d8c168c04739197d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:31.967770 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-0c8b4a67-ad88-47c9-aa2f-0717ab1f8fc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:31.968451 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-0c8b4a67-ad88-47c9-aa2f-0717ab1f8fc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:31.970966 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1038/2072] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:31 2022] DELETE /identity/v3/projects/7fedbbb43820455d8c168c04739197d2 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:31.972298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4326bc-9b2b-405f-bac3-d2353649747f None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:31.972583 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4326bc-9b2b-405f-bac3-d2353649747f None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:31.972971 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4326bc-9b2b-405f-bac3-d2353649747f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:32.005796 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-8d4326bc-9b2b-405f-bac3-d2353649747f None None] MFA Rules not processed for user `6bddbd1359aa49dfa6452a82ced13b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:32.007407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-8d4326bc-9b2b-405f-bac3-d2353649747f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:32.023613 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:32.031575 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ccc06-802b-4c12-8b18-399fc47d1655 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:32.038347 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a4cca-b30f-4c46-8a07-5cd1c0f22deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:32.039010 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a4cca-b30f-4c46-8a07-5cd1c0f22deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:32.039299 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a4cca-b30f-4c46-8a07-5cd1c0f22deb admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:32.039610 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a4cca-b30f-4c46-8a07-5cd1c0f22deb admin admin] PATH_INFO: `/v3/users/a7ec9c5e6ce1480687cc4b705d7d0467` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:32.041062 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a4cca-b30f-4c46-8a07-5cd1c0f22deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ec9c5e6ce1480687cc4b705d7d0467)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:32.043077 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a4cca-b30f-4c46-8a07-5cd1c0f22deb admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:32.098681 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1039/2073] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:32.100289 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b285a2-5f30-414d-a9d2-950296480aa6 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:32.100597 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b285a2-5f30-414d-a9d2-950296480aa6 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:32.100861 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b285a2-5f30-414d-a9d2-950296480aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:32.135789 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-01b285a2-5f30-414d-a9d2-950296480aa6 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:32.137350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-01b285a2-5f30-414d-a9d2-950296480aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:32.160513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1040/2074] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:32.160513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b285a2-5f30-414d-a9d2-950296480aa6 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:32.160513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-01b285a2-5f30-414d-a9d2-950296480aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:32.237275 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b285a2-5f30-414d-a9d2-950296480aa6 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:32.260809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c74f76-ff20-4bd0-80a3-a204c8f10c50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:32.261871 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c74f76-ff20-4bd0-80a3-a204c8f10c50 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:32.262379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c74f76-ff20-4bd0-80a3-a204c8f10c50 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:32.262925 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c74f76-ff20-4bd0-80a3-a204c8f10c50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:32.281471 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c74f76-ff20-4bd0-80a3-a204c8f10c50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:32.286499 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c74f76-ff20-4bd0-80a3-a204c8f10c50 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:32.306702 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-ed2a4cca-b30f-4c46-8a07-5cd1c0f22deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ec9c5e6ce1480687cc4b705d7d0467'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:32.307625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-ed2a4cca-b30f-4c46-8a07-5cd1c0f22deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ec9c5e6ce1480687cc4b705d7d0467'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:32.328595 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1041/2075] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:32 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:32.328595 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edcab3-fc2b-492f-941a-b13a2d95707c None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:32.328595 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edcab3-fc2b-492f-941a-b13a2d95707c None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:32.328595 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edcab3-fc2b-492f-941a-b13a2d95707c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:32.359197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-c0edcab3-fc2b-492f-941a-b13a2d95707c None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:32.362128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c0edcab3-fc2b-492f-941a-b13a2d95707c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:32.375633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1042/2076] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:32.381854 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edcab3-fc2b-492f-941a-b13a2d95707c None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:32.408532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edcab3-fc2b-492f-941a-b13a2d95707c None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:32.417096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29873c-8a96-4956-8692-b7532b8d647f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:32.418012 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29873c-8a96-4956-8692-b7532b8d647f admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:32.418367 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29873c-8a96-4956-8692-b7532b8d647f admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:32.418716 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29873c-8a96-4956-8692-b7532b8d647f admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:32.419690 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29873c-8a96-4956-8692-b7532b8d647f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:03:32.420039 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29873c-8a96-4956-8692-b7532b8d647f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:32.421493 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-ed2a4cca-b30f-4c46-8a07-5cd1c0f22deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ec9c5e6ce1480687cc4b705d7d0467'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:32.422287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29873c-8a96-4956-8692-b7532b8d647f admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:32.434031 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-ed2a4cca-b30f-4c46-8a07-5cd1c0f22deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ec9c5e6ce1480687cc4b705d7d0467'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:32.443079 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1043/2077] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:03:32.448019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29873c-8a96-4956-8692-b7532b8d647f admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:32.454291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-ed2a4cca-b30f-4c46-8a07-5cd1c0f22deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ec9c5e6ce1480687cc4b705d7d0467'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:32.463722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1035/2078] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:31 2022] DELETE /identity/v3/users/a7ec9c5e6ce1480687cc4b705d7d0467 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:32.468751 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576f432-6bc5-4101-a6fe-18f8eb182c46 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:32.469108 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576f432-6bc5-4101-a6fe-18f8eb182c46 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:32.469552 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576f432-6bc5-4101-a6fe-18f8eb182c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:32.472072 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29873c-8a96-4956-8692-b7532b8d647f admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:32.494597 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-2576f432-6bc5-4101-a6fe-18f8eb182c46 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:32.495897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-2576f432-6bc5-4101-a6fe-18f8eb182c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:32.590864 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1036/2079] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:32.591116 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91cece-e84e-4dfa-92d3-4995d2a9a131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:32.591905 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91cece-e84e-4dfa-92d3-4995d2a9a131 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:32.592231 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91cece-e84e-4dfa-92d3-4995d2a9a131 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:32.592456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91cece-e84e-4dfa-92d3-4995d2a9a131 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:32.593139 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91cece-e84e-4dfa-92d3-4995d2a9a131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:32.594822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576f432-6bc5-4101-a6fe-18f8eb182c46 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:32.597181 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91cece-e84e-4dfa-92d3-4995d2a9a131 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:32.612293 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-2576f432-6bc5-4101-a6fe-18f8eb182c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:32.638634 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576f432-6bc5-4101-a6fe-18f8eb182c46 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:32.648316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcaa33-c4c4-4d4d-bf66-91c260664863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:32.649205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcaa33-c4c4-4d4d-bf66-91c260664863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:32.649549 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcaa33-c4c4-4d4d-bf66-91c260664863 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:32.649956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcaa33-c4c4-4d4d-bf66-91c260664863 admin admin] PATH_INFO: `/v3/users/65853e85d5e648519939dc0baa05b9e4` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:32.651721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcaa33-c4c4-4d4d-bf66-91c260664863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65853e85d5e648519939dc0baa05b9e4)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:32.654955 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcaa33-c4c4-4d4d-bf66-91c260664863 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:32.713652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1044/2080] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:32 2022] POST /identity/v3/projects => generated 361 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:32.713652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91cece-e84e-4dfa-92d3-4995d2a9a131 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:32.714082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ea91cece-e84e-4dfa-92d3-4995d2a9a131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:32.879072 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91cece-e84e-4dfa-92d3-4995d2a9a131 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:32.889288 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d457f0-a42a-47ca-80aa-c91afed8f7e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:32.890896 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d457f0-a42a-47ca-80aa-c91afed8f7e9 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:32.891299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d457f0-a42a-47ca-80aa-c91afed8f7e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:32.892446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d457f0-a42a-47ca-80aa-c91afed8f7e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:32.941454 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f6dcaa33-c4c4-4d4d-bf66-91c260664863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65853e85d5e648519939dc0baa05b9e4'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:32.943818 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f6dcaa33-c4c4-4d4d-bf66-91c260664863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65853e85d5e648519939dc0baa05b9e4'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:32.974448 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:33.010573 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d457f0-a42a-47ca-80aa-c91afed8f7e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:33.012176 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d457f0-a42a-47ca-80aa-c91afed8f7e9 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:33.030123 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1045/2081] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:33.038125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d457f0-a42a-47ca-80aa-c91afed8f7e9 service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:33.068285 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f6dcaa33-c4c4-4d4d-bf66-91c260664863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65853e85d5e648519939dc0baa05b9e4'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:33.081858 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f6dcaa33-c4c4-4d4d-bf66-91c260664863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65853e85d5e648519939dc0baa05b9e4'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:33.082074 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:33.083933 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d457f0-a42a-47ca-80aa-c91afed8f7e9 service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:33.105782 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a8a01-8395-47ba-b6ba-061ae76219ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:33.106440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a8a01-8395-47ba-b6ba-061ae76219ba admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:33.106713 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a8a01-8395-47ba-b6ba-061ae76219ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:33.106991 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a8a01-8395-47ba-b6ba-061ae76219ba admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:33.107721 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a8a01-8395-47ba-b6ba-061ae76219ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:33.109714 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a8a01-8395-47ba-b6ba-061ae76219ba admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:33.124239 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f6dcaa33-c4c4-4d4d-bf66-91c260664863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65853e85d5e648519939dc0baa05b9e4'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:33.134558 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1037/2082] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:32 2022] DELETE /identity/v3/users/65853e85d5e648519939dc0baa05b9e4 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:33.141338 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1e297-caba-4b63-a392-0808522a5e8d None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:33.141902 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1e297-caba-4b63-a392-0808522a5e8d None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:33.142650 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1e297-caba-4b63-a392-0808522a5e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:33.184968 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-8cd1e297-caba-4b63-a392-0808522a5e8d None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:33.186830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-8cd1e297-caba-4b63-a392-0808522a5e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:33.229816 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1046/2083] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:33 2022] POST /identity/v3/users => generated 281 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:33.236137 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a8a01-8395-47ba-b6ba-061ae76219ba admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:33.243988 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-760a8a01-8395-47ba-b6ba-061ae76219ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:33.273065 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a8a01-8395-47ba-b6ba-061ae76219ba admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:33.303207 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1038/2084] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:33.314736 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1e297-caba-4b63-a392-0808522a5e8d None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:33.316315 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-8cd1e297-caba-4b63-a392-0808522a5e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:33.380157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6619a-0f40-40a5-98bc-98da0811341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:33.380823 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6619a-0f40-40a5-98bc-98da0811341b admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:33.381107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6619a-0f40-40a5-98bc-98da0811341b admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:33.381387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6619a-0f40-40a5-98bc-98da0811341b admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:33.382537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6619a-0f40-40a5-98bc-98da0811341b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:33.384323 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6619a-0f40-40a5-98bc-98da0811341b admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:33.423217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1047/2085] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:33.427198 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6619a-0f40-40a5-98bc-98da0811341b admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:33.438040 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1e297-caba-4b63-a392-0808522a5e8d None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:33.447965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51926699-4672-43ef-86c4-f0c785976029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:33.448348 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51926699-4672-43ef-86c4-f0c785976029 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:33.448644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51926699-4672-43ef-86c4-f0c785976029 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:33.448927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51926699-4672-43ef-86c4-f0c785976029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:33.473346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51926699-4672-43ef-86c4-f0c785976029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:33.478614 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51926699-4672-43ef-86c4-f0c785976029 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:33.480883 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6619a-0f40-40a5-98bc-98da0811341b admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:33.487359 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9f2c2-14a7-4f85-bd3d-93ec70d5ab87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:33.488255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9f2c2-14a7-4f85-bd3d-93ec70d5ab87 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:33.488634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9f2c2-14a7-4f85-bd3d-93ec70d5ab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:33.489015 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9f2c2-14a7-4f85-bd3d-93ec70d5ab87 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:33.489835 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9f2c2-14a7-4f85-bd3d-93ec70d5ab87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:33.491696 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9f2c2-14a7-4f85-bd3d-93ec70d5ab87 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:33.528232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1048/2086] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:33.528426 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1039/2087] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:03:33.531155 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9f2c2-14a7-4f85-bd3d-93ec70d5ab87 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:33.554373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9f2c2-14a7-4f85-bd3d-93ec70d5ab87 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:33.566324 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02113a74-4e06-4bf3-8651-415d03e506a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:33.567189 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02113a74-4e06-4bf3-8651-415d03e506a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:33.567456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02113a74-4e06-4bf3-8651-415d03e506a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:33.568077 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02113a74-4e06-4bf3-8651-415d03e506a4 admin admin] PATH_INFO: `/v3/projects/f968f420744a49f0a1ea91fdb2a0b741/users/d771a6fbee694246954e0ec988fa5304/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:33.591657 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02113a74-4e06-4bf3-8651-415d03e506a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f968f420744a49f0a1ea91fdb2a0b741, user_id=d771a6fbee694246954e0ec988fa5304, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:33.594512 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02113a74-4e06-4bf3-8651-415d03e506a4 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:33.781835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51926699-4672-43ef-86c4-f0c785976029 service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:33.784775 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-51926699-4672-43ef-86c4-f0c785976029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:33.801308 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51926699-4672-43ef-86c4-f0c785976029 service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:33.807273 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cf995-079b-4708-8277-0d16660121b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:33.808850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cf995-079b-4708-8277-0d16660121b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:33.809368 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cf995-079b-4708-8277-0d16660121b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:33.809890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cf995-079b-4708-8277-0d16660121b4 admin admin] PATH_INFO: `/v3/users/9fe9f02c14f5491aa6ef52ccf1a57586` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:33.811543 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205cf995-079b-4708-8277-0d16660121b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe9f02c14f5491aa6ef52ccf1a57586)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:33.820829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205cf995-079b-4708-8277-0d16660121b4 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:33.839985 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1049/2088] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:33 2022] PUT /identity/v3/projects/f968f420744a49f0a1ea91fdb2a0b741/users/d771a6fbee694246954e0ec988fa5304/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:33.842383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9f350-5cdf-41d9-b2ea-994c3a32152b None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:33.842679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9f350-5cdf-41d9-b2ea-994c3a32152b None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:33.843011 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9f350-5cdf-41d9-b2ea-994c3a32152b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:33.912764 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-28c9f350-5cdf-41d9-b2ea-994c3a32152b None None] MFA Rules not processed for user `d771a6fbee694246954e0ec988fa5304`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:33.914057 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-28c9f350-5cdf-41d9-b2ea-994c3a32152b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:34.020434 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1050/2089] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:34.067647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-205cf995-079b-4708-8277-0d16660121b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe9f02c14f5491aa6ef52ccf1a57586'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:34.068509 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-205cf995-079b-4708-8277-0d16660121b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe9f02c14f5491aa6ef52ccf1a57586'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:34.079247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9f350-5cdf-41d9-b2ea-994c3a32152b None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:34.082375 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-28c9f350-5cdf-41d9-b2ea-994c3a32152b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:34.154453 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-205cf995-079b-4708-8277-0d16660121b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe9f02c14f5491aa6ef52ccf1a57586'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:34.176232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-205cf995-079b-4708-8277-0d16660121b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe9f02c14f5491aa6ef52ccf1a57586'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:34.230594 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-205cf995-079b-4708-8277-0d16660121b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe9f02c14f5491aa6ef52ccf1a57586'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:34.236249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9f350-5cdf-41d9-b2ea-994c3a32152b None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:34.252110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528a64e-8dcd-4c9a-b377-7e34610e4db2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:34.253117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528a64e-8dcd-4c9a-b377-7e34610e4db2 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:34.253612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528a64e-8dcd-4c9a-b377-7e34610e4db2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:34.254589 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528a64e-8dcd-4c9a-b377-7e34610e4db2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:34.255660 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1040/2090] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:33 2022] DELETE /identity/v3/users/9fe9f02c14f5491aa6ef52ccf1a57586 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:34.257998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cf995-079b-4708-8277-0d16660121b4 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:34.260501 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-205cf995-079b-4708-8277-0d16660121b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:34.264321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9528a64e-8dcd-4c9a-b377-7e34610e4db2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:34.301822 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528a64e-8dcd-4c9a-b377-7e34610e4db2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:34.304766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528a64e-8dcd-4c9a-b377-7e34610e4db2 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:34.328838 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1051/2091] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:34.330497 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528a64e-8dcd-4c9a-b377-7e34610e4db2 service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:34.336783 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9528a64e-8dcd-4c9a-b377-7e34610e4db2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:34.410642 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:34.436210 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cf995-079b-4708-8277-0d16660121b4 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:34.442720 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92116561-6761-4662-b794-62440ca573fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:34.443452 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92116561-6761-4662-b794-62440ca573fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:34.443804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92116561-6761-4662-b794-62440ca573fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:34.444751 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92116561-6761-4662-b794-62440ca573fc admin admin] PATH_INFO: `/v3/projects/98e30ade167c4f3da2cf944cc52f6bd8` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:34.446395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92116561-6761-4662-b794-62440ca573fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=98e30ade167c4f3da2cf944cc52f6bd8)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:34.448893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92116561-6761-4662-b794-62440ca573fc admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:34.451671 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528a64e-8dcd-4c9a-b377-7e34610e4db2 service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:34.459066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66890a3f-d88d-4579-85ad-646b52669403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:34.459811 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66890a3f-d88d-4579-85ad-646b52669403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:34.460096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66890a3f-d88d-4579-85ad-646b52669403 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:34.460377 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66890a3f-d88d-4579-85ad-646b52669403 admin admin] PATH_INFO: `/v3/projects/2da2e747a23c46b8a547c80ac6fdb6fa` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:34.461687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66890a3f-d88d-4579-85ad-646b52669403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da2e747a23c46b8a547c80ac6fdb6fa)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:34.464419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66890a3f-d88d-4579-85ad-646b52669403 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:34.499769 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:34.580938 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-92116561-6761-4662-b794-62440ca573fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98e30ade167c4f3da2cf944cc52f6bd8', 'request_id': 'req-92116561-6761-4662-b794-62440ca573fc'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:34.591295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-92116561-6761-4662-b794-62440ca573fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98e30ade167c4f3da2cf944cc52f6bd8', 'request_id': 'req-92116561-6761-4662-b794-62440ca573fc'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:34.606474 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-92116561-6761-4662-b794-62440ca573fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98e30ade167c4f3da2cf944cc52f6bd8', 'request_id': 'req-92116561-6761-4662-b794-62440ca573fc'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:34.620148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-66890a3f-d88d-4579-85ad-646b52669403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da2e747a23c46b8a547c80ac6fdb6fa', 'request_id': 'req-66890a3f-d88d-4579-85ad-646b52669403'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:34.737415 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-92116561-6761-4662-b794-62440ca573fc admin admin] The token cache is being invalidate because project 98e30ade167c4f3da2cf944cc52f6bd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:34.737415 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-92116561-6761-4662-b794-62440ca573fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:34.737415 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-92116561-6761-4662-b794-62440ca573fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:34.741776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1041/2092] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:34 2022] DELETE /identity/v3/projects/98e30ade167c4f3da2cf944cc52f6bd8 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:34.743172 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2afb4-aba2-46b2-892d-cd282cbc5d31 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:34.743487 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2afb4-aba2-46b2-892d-cd282cbc5d31 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:34.743763 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2afb4-aba2-46b2-892d-cd282cbc5d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:34.765222 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-1df2afb4-aba2-46b2-892d-cd282cbc5d31 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:34.766436 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-1df2afb4-aba2-46b2-892d-cd282cbc5d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:34.787122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-66890a3f-d88d-4579-85ad-646b52669403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da2e747a23c46b8a547c80ac6fdb6fa', 'request_id': 'req-66890a3f-d88d-4579-85ad-646b52669403'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:34.793842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-66890a3f-d88d-4579-85ad-646b52669403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da2e747a23c46b8a547c80ac6fdb6fa', 'request_id': 'req-66890a3f-d88d-4579-85ad-646b52669403'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:34.805151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-66890a3f-d88d-4579-85ad-646b52669403 admin admin] The token cache is being invalidate because project 2da2e747a23c46b8a547c80ac6fdb6fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:34.805450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-66890a3f-d88d-4579-85ad-646b52669403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:34.806269 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-66890a3f-d88d-4579-85ad-646b52669403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:34.808031 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1052/2093] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:34 2022] DELETE /identity/v3/projects/2da2e747a23c46b8a547c80ac6fdb6fa => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:34.812268 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66890a3f-d88d-4579-85ad-646b52669403 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:34.814631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-66890a3f-d88d-4579-85ad-646b52669403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:34.861725 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1042/2094] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:34.863639 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a982afd-14a5-4051-9a9e-65a3ba07d7e9 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:34.864414 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a982afd-14a5-4051-9a9e-65a3ba07d7e9 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:34.864707 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a982afd-14a5-4051-9a9e-65a3ba07d7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:34.894030 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-4a982afd-14a5-4051-9a9e-65a3ba07d7e9 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:34.895667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-4a982afd-14a5-4051-9a9e-65a3ba07d7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:34.905381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1043/2095] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:34.906416 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a982afd-14a5-4051-9a9e-65a3ba07d7e9 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:34.908484 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-4a982afd-14a5-4051-9a9e-65a3ba07d7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:34.924837 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66890a3f-d88d-4579-85ad-646b52669403 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:34.925784 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a982afd-14a5-4051-9a9e-65a3ba07d7e9 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:34.932420 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cf164-0d8c-4e5e-bef7-6bf940c2de43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:34.933123 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cf164-0d8c-4e5e-bef7-6bf940c2de43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:34.933405 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cf164-0d8c-4e5e-bef7-6bf940c2de43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:34.933684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cf164-0d8c-4e5e-bef7-6bf940c2de43 admin admin] PATH_INFO: `/v3/users/6bddbd1359aa49dfa6452a82ced13b92` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:34.934176 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef78c18-2d40-442e-a26c-61479f3558d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:34.935162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cf164-0d8c-4e5e-bef7-6bf940c2de43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bddbd1359aa49dfa6452a82ced13b92)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:34.935516 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef78c18-2d40-442e-a26c-61479f3558d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:34.936116 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef78c18-2d40-442e-a26c-61479f3558d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:34.936662 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef78c18-2d40-442e-a26c-61479f3558d2 admin admin] PATH_INFO: `/v3/users/d771a6fbee694246954e0ec988fa5304` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:34.937287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cf164-0d8c-4e5e-bef7-6bf940c2de43 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:34.939660 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef78c18-2d40-442e-a26c-61479f3558d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d771a6fbee694246954e0ec988fa5304)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:34.942141 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef78c18-2d40-442e-a26c-61479f3558d2 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:35.096606 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:35.172088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4ef78c18-2d40-442e-a26c-61479f3558d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd771a6fbee694246954e0ec988fa5304'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:35.172658 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4ef78c18-2d40-442e-a26c-61479f3558d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd771a6fbee694246954e0ec988fa5304'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:35.221818 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-771cf164-0d8c-4e5e-bef7-6bf940c2de43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bddbd1359aa49dfa6452a82ced13b92'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:35.222609 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-771cf164-0d8c-4e5e-bef7-6bf940c2de43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bddbd1359aa49dfa6452a82ced13b92'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:35.257451 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4ef78c18-2d40-442e-a26c-61479f3558d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd771a6fbee694246954e0ec988fa5304'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:35.294723 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4ef78c18-2d40-442e-a26c-61479f3558d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd771a6fbee694246954e0ec988fa5304'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:35.335671 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4ef78c18-2d40-442e-a26c-61479f3558d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd771a6fbee694246954e0ec988fa5304'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:35.336082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-771cf164-0d8c-4e5e-bef7-6bf940c2de43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bddbd1359aa49dfa6452a82ced13b92'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:35.353113 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-771cf164-0d8c-4e5e-bef7-6bf940c2de43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bddbd1359aa49dfa6452a82ced13b92'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:35.359578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1053/2096] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:34 2022] DELETE /identity/v3/users/d771a6fbee694246954e0ec988fa5304 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:35.364540 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef78c18-2d40-442e-a26c-61479f3558d2 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:35.368735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-4ef78c18-2d40-442e-a26c-61479f3558d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:35.387906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-771cf164-0d8c-4e5e-bef7-6bf940c2de43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bddbd1359aa49dfa6452a82ced13b92'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:35.435983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1044/2097] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:34 2022] DELETE /identity/v3/users/6bddbd1359aa49dfa6452a82ced13b92 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:35.441944 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996e574-1229-4fb4-ba8e-6d6f00839c4a None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:35.442572 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996e574-1229-4fb4-ba8e-6d6f00839c4a None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:35.445465 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996e574-1229-4fb4-ba8e-6d6f00839c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:35.508686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef78c18-2d40-442e-a26c-61479f3558d2 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:35.552996 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-b996e574-1229-4fb4-ba8e-6d6f00839c4a None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:35.560824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b996e574-1229-4fb4-ba8e-6d6f00839c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:35.583444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6461dbe-0c7f-436c-94a3-e9190bfd5648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:35.584221 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6461dbe-0c7f-436c-94a3-e9190bfd5648 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:35.584579 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6461dbe-0c7f-436c-94a3-e9190bfd5648 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:35.584929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6461dbe-0c7f-436c-94a3-e9190bfd5648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:35.587278 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e6461dbe-0c7f-436c-94a3-e9190bfd5648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:35.659740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:35.706174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6461dbe-0c7f-436c-94a3-e9190bfd5648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:35.706667 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6461dbe-0c7f-436c-94a3-e9190bfd5648 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:35.718830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1054/2098] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:35.728787 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923c80c-6901-4803-a4e8-bd53a699df5f None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:35.729191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923c80c-6901-4803-a4e8-bd53a699df5f None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:35.729191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923c80c-6901-4803-a4e8-bd53a699df5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:35.740755 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1045/2099] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:35.741530 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996e574-1229-4fb4-ba8e-6d6f00839c4a None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:35.752739 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-8923c80c-6901-4803-a4e8-bd53a699df5f None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:35.754010 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-8923c80c-6901-4803-a4e8-bd53a699df5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:35.766264 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1055/2100] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:35.772586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996e574-1229-4fb4-ba8e-6d6f00839c4a None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:35.780212 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923c80c-6901-4803-a4e8-bd53a699df5f None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:35.789076 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-8923c80c-6901-4803-a4e8-bd53a699df5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:35.794940 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c31dc1-ac21-4ba7-b95d-2b4877ebb15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:35.795981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c31dc1-ac21-4ba7-b95d-2b4877ebb15b admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:35.797537 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c31dc1-ac21-4ba7-b95d-2b4877ebb15b admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:35.797537 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c31dc1-ac21-4ba7-b95d-2b4877ebb15b admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:35.797537 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c31dc1-ac21-4ba7-b95d-2b4877ebb15b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:03:35.801673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c31dc1-ac21-4ba7-b95d-2b4877ebb15b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:35.801673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c31dc1-ac21-4ba7-b95d-2b4877ebb15b admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:35.814844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923c80c-6901-4803-a4e8-bd53a699df5f None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:35.824297 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1046/2101] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:03:35.831562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c31dc1-ac21-4ba7-b95d-2b4877ebb15b admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:35.838113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929ff9f-d848-4829-b914-e6c03aa42a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:35.839507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929ff9f-d848-4829-b914-e6c03aa42a73 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:35.840024 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929ff9f-d848-4829-b914-e6c03aa42a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:35.840514 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929ff9f-d848-4829-b914-e6c03aa42a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:35.851745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c31dc1-ac21-4ba7-b95d-2b4877ebb15b admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:35.859899 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e644c-2918-41c8-8305-b2e286f7fcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:35.861644 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929ff9f-d848-4829-b914-e6c03aa42a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:35.862515 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e644c-2918-41c8-8305-b2e286f7fcb3 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:35.863046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e644c-2918-41c8-8305-b2e286f7fcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:35.863718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e644c-2918-41c8-8305-b2e286f7fcb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:35.864515 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929ff9f-d848-4829-b914-e6c03aa42a73 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:35.864980 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e644c-2918-41c8-8305-b2e286f7fcb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:35.869130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e644c-2918-41c8-8305-b2e286f7fcb3 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:35.891152 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1056/2102] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:03:36.017714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1047/2103] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:35 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:36.024552 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929ff9f-d848-4829-b914-e6c03aa42a73 service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:36.035243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929ff9f-d848-4829-b914-e6c03aa42a73 service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:36.127352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7482f2-4a14-458a-9db4-547180771e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:36.133241 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7482f2-4a14-458a-9db4-547180771e99 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:36.133241 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7482f2-4a14-458a-9db4-547180771e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:36.133241 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7482f2-4a14-458a-9db4-547180771e99 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:36.135273 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7482f2-4a14-458a-9db4-547180771e99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:36.142026 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7482f2-4a14-458a-9db4-547180771e99 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:36.253708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1057/2104] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:36 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:36.259665 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e644c-2918-41c8-8305-b2e286f7fcb3 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:36.284857 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e644c-2918-41c8-8305-b2e286f7fcb3 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:36.291286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9584a-5389-408e-81ca-8699d3a93c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:36.291899 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9584a-5389-408e-81ca-8699d3a93c1e admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:36.292201 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9584a-5389-408e-81ca-8699d3a93c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:36.292479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9584a-5389-408e-81ca-8699d3a93c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:36.293266 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9584a-5389-408e-81ca-8699d3a93c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:36.295865 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9584a-5389-408e-81ca-8699d3a93c1e admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:36.311854 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1048/2105] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:36.317408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7482f2-4a14-458a-9db4-547180771e99 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:36.339120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7482f2-4a14-458a-9db4-547180771e99 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:36.344708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f2631-314f-4d1d-ae1c-77f133391534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:36.346315 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f2631-314f-4d1d-ae1c-77f133391534 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:36.346695 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f2631-314f-4d1d-ae1c-77f133391534 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:36.347070 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f2631-314f-4d1d-ae1c-77f133391534 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:36.347946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f2631-314f-4d1d-ae1c-77f133391534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:36.349711 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897f2631-314f-4d1d-ae1c-77f133391534 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:36.370118 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1058/2106] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:36.370222 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9584a-5389-408e-81ca-8699d3a93c1e admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:36.372575 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f2631-314f-4d1d-ae1c-77f133391534 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:36.374701 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-897f2631-314f-4d1d-ae1c-77f133391534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:36.386701 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9584a-5389-408e-81ca-8699d3a93c1e admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:36.397563 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7889b-284b-415c-a18c-574001e75dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:36.398369 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7889b-284b-415c-a18c-574001e75dff admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:36.398665 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7889b-284b-415c-a18c-574001e75dff admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:36.398952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7889b-284b-415c-a18c-574001e75dff admin admin] PATH_INFO: `/v3/projects/b73ced5043e64c2eba10899f9ca7edac/users/d5efcb797d0445dfb364957e3a3d8708/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:36.405418 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f2631-314f-4d1d-ae1c-77f133391534 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:36.417474 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a510bb-73f1-40ba-830e-3f9dff55ac63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:36.420411 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a510bb-73f1-40ba-830e-3f9dff55ac63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:36.420411 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a510bb-73f1-40ba-830e-3f9dff55ac63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:36.433036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a510bb-73f1-40ba-830e-3f9dff55ac63 admin admin] PATH_INFO: `/v3/projects/7c71d3e0346d4fbb9f647227d44fcd77` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:36.446556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a510bb-73f1-40ba-830e-3f9dff55ac63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c71d3e0346d4fbb9f647227d44fcd77)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:36.451873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a510bb-73f1-40ba-830e-3f9dff55ac63 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:36.472263 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7889b-284b-415c-a18c-574001e75dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b73ced5043e64c2eba10899f9ca7edac, user_id=d5efcb797d0445dfb364957e3a3d8708, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:36.475061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7889b-284b-415c-a18c-574001e75dff admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:36.592916 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1049/2107] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:36 2022] PUT /identity/v3/projects/b73ced5043e64c2eba10899f9ca7edac/users/d5efcb797d0445dfb364957e3a3d8708/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:36.596775 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0974e-eddb-47e7-85dc-f40a01910383 None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:36.597572 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0974e-eddb-47e7-85dc-f40a01910383 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:36.598301 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff0974e-eddb-47e7-85dc-f40a01910383 None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:36.603122 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1050/2108] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 28 04:03:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:03:36.617682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0974e-eddb-47e7-85dc-f40a01910383 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:36.625537 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-aff0974e-eddb-47e7-85dc-f40a01910383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:36.676745 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d3a510bb-73f1-40ba-830e-3f9dff55ac63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c71d3e0346d4fbb9f647227d44fcd77', 'request_id': 'req-d3a510bb-73f1-40ba-830e-3f9dff55ac63'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:36.759219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff0974e-eddb-47e7-85dc-f40a01910383 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:36.768008 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e43099-4e1a-4f12-91ab-1ddb6b2b5f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:36.769468 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e43099-4e1a-4f12-91ab-1ddb6b2b5f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:36.770122 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e43099-4e1a-4f12-91ab-1ddb6b2b5f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:36.770752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e43099-4e1a-4f12-91ab-1ddb6b2b5f42 admin admin] PATH_INFO: `/v3/projects/0d535eb814f54d09890866e32cfb2a18` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:36.773463 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e43099-4e1a-4f12-91ab-1ddb6b2b5f42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d535eb814f54d09890866e32cfb2a18)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:36.777806 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e43099-4e1a-4f12-91ab-1ddb6b2b5f42 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:36.833781 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d3a510bb-73f1-40ba-830e-3f9dff55ac63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c71d3e0346d4fbb9f647227d44fcd77', 'request_id': 'req-d3a510bb-73f1-40ba-830e-3f9dff55ac63'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:36.841368 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d3a510bb-73f1-40ba-830e-3f9dff55ac63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c71d3e0346d4fbb9f647227d44fcd77', 'request_id': 'req-d3a510bb-73f1-40ba-830e-3f9dff55ac63'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:36.856297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d3a510bb-73f1-40ba-830e-3f9dff55ac63 admin admin] The token cache is being invalidate because project 7c71d3e0346d4fbb9f647227d44fcd77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:36.856592 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d3a510bb-73f1-40ba-830e-3f9dff55ac63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:36.857306 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d3a510bb-73f1-40ba-830e-3f9dff55ac63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:36.859173 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1059/2109] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:36 2022] DELETE /identity/v3/projects/7c71d3e0346d4fbb9f647227d44fcd77 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:36.863896 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70699f-5508-4921-a2dc-3e64797d2c24 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:36.864160 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70699f-5508-4921-a2dc-3e64797d2c24 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:36.864450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70699f-5508-4921-a2dc-3e64797d2c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:36.899033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-2c70699f-5508-4921-a2dc-3e64797d2c24 None None] MFA Rules not processed for user `d5efcb797d0445dfb364957e3a3d8708`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:36.900372 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-2c70699f-5508-4921-a2dc-3e64797d2c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:36.964997 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-86e43099-4e1a-4f12-91ab-1ddb6b2b5f42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d535eb814f54d09890866e32cfb2a18', 'request_id': 'req-86e43099-4e1a-4f12-91ab-1ddb6b2b5f42'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:36.975807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-86e43099-4e1a-4f12-91ab-1ddb6b2b5f42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d535eb814f54d09890866e32cfb2a18', 'request_id': 'req-86e43099-4e1a-4f12-91ab-1ddb6b2b5f42'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:36.984089 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-86e43099-4e1a-4f12-91ab-1ddb6b2b5f42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d535eb814f54d09890866e32cfb2a18', 'request_id': 'req-86e43099-4e1a-4f12-91ab-1ddb6b2b5f42'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:36.990694 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:37.001567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1060/2110] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:37.003782 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d3805-f64f-4dd8-86df-4497ab402b6d None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:37.004073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d3805-f64f-4dd8-86df-4497ab402b6d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:37.004412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d3805-f64f-4dd8-86df-4497ab402b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:37.034506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-2b2d3805-f64f-4dd8-86df-4497ab402b6d None None] MFA Rules not processed for user `e91f2584622a48bba21e1bf31c1aef30`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:37.035844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-2b2d3805-f64f-4dd8-86df-4497ab402b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:37.084169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-86e43099-4e1a-4f12-91ab-1ddb6b2b5f42 admin admin] The token cache is being invalidate because project 0d535eb814f54d09890866e32cfb2a18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:37.084750 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-86e43099-4e1a-4f12-91ab-1ddb6b2b5f42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:37.085980 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-86e43099-4e1a-4f12-91ab-1ddb6b2b5f42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:37.089229 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1051/2111] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:36 2022] DELETE /identity/v3/projects/0d535eb814f54d09890866e32cfb2a18 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:37.090601 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e43099-4e1a-4f12-91ab-1ddb6b2b5f42 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:37.092478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-86e43099-4e1a-4f12-91ab-1ddb6b2b5f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:37.152087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1061/2112] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 28 04:03:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:37.154290 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49ca3c-1ef4-4fa1-98d2-a8006205d25d None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:37.155003 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49ca3c-1ef4-4fa1-98d2-a8006205d25d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:37.155540 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49ca3c-1ef4-4fa1-98d2-a8006205d25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:37.174310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:37.190054 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e43099-4e1a-4f12-91ab-1ddb6b2b5f42 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:37.192564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024f622-f2ce-4f97-960b-78d15bb7f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:37.193441 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024f622-f2ce-4f97-960b-78d15bb7f2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:37.193892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024f622-f2ce-4f97-960b-78d15bb7f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:37.194166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024f622-f2ce-4f97-960b-78d15bb7f2bb admin admin] PATH_INFO: `/v3/users/4f91caa3c691497d828f6a91c1a4c4ce` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:37.195628 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-fe49ca3c-1ef4-4fa1-98d2-a8006205d25d None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:37.196937 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024f622-f2ce-4f97-960b-78d15bb7f2bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f91caa3c691497d828f6a91c1a4c4ce)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:37.197780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-fe49ca3c-1ef4-4fa1-98d2-a8006205d25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:37.199173 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024f622-f2ce-4f97-960b-78d15bb7f2bb admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:37.210188 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1062/2113] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:37.211288 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49ca3c-1ef4-4fa1-98d2-a8006205d25d None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:37.219453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-fe49ca3c-1ef4-4fa1-98d2-a8006205d25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:37.237041 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49ca3c-1ef4-4fa1-98d2-a8006205d25d None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:37.242118 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd0c73-87e2-44ac-91d7-0eac1a870ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:37.243502 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd0c73-87e2-44ac-91d7-0eac1a870ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:37.243502 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd0c73-87e2-44ac-91d7-0eac1a870ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:37.243502 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd0c73-87e2-44ac-91d7-0eac1a870ccc admin admin] PATH_INFO: `/v3/projects/f968f420744a49f0a1ea91fdb2a0b741` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:37.244398 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd0c73-87e2-44ac-91d7-0eac1a870ccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f968f420744a49f0a1ea91fdb2a0b741)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:37.246374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd0c73-87e2-44ac-91d7-0eac1a870ccc admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:37.428010 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-8acd0c73-87e2-44ac-91d7-0eac1a870ccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f968f420744a49f0a1ea91fdb2a0b741', 'request_id': 'req-8acd0c73-87e2-44ac-91d7-0eac1a870ccc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:37.429916 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-9024f622-f2ce-4f97-960b-78d15bb7f2bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f91caa3c691497d828f6a91c1a4c4ce'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:37.430838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-9024f622-f2ce-4f97-960b-78d15bb7f2bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f91caa3c691497d828f6a91c1a4c4ce'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:37.495958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-8acd0c73-87e2-44ac-91d7-0eac1a870ccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f968f420744a49f0a1ea91fdb2a0b741', 'request_id': 'req-8acd0c73-87e2-44ac-91d7-0eac1a870ccc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:37.502746 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-8acd0c73-87e2-44ac-91d7-0eac1a870ccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f968f420744a49f0a1ea91fdb2a0b741', 'request_id': 'req-8acd0c73-87e2-44ac-91d7-0eac1a870ccc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:37.515408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-8acd0c73-87e2-44ac-91d7-0eac1a870ccc admin admin] The token cache is being invalidate because project f968f420744a49f0a1ea91fdb2a0b741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:37.515775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-8acd0c73-87e2-44ac-91d7-0eac1a870ccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:37.516536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-8acd0c73-87e2-44ac-91d7-0eac1a870ccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:37.519342 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1063/2114] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:37 2022] DELETE /identity/v3/projects/f968f420744a49f0a1ea91fdb2a0b741 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:37.520218 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd0c73-87e2-44ac-91d7-0eac1a870ccc admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:37.521693 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-8acd0c73-87e2-44ac-91d7-0eac1a870ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:37.574066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-9024f622-f2ce-4f97-960b-78d15bb7f2bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f91caa3c691497d828f6a91c1a4c4ce'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:37.593361 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-9024f622-f2ce-4f97-960b-78d15bb7f2bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f91caa3c691497d828f6a91c1a4c4ce'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:37.619517 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-9024f622-f2ce-4f97-960b-78d15bb7f2bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f91caa3c691497d828f6a91c1a4c4ce'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:37.628577 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd0c73-87e2-44ac-91d7-0eac1a870ccc admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:37.629595 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1052/2115] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:37 2022] DELETE /identity/v3/users/4f91caa3c691497d828f6a91c1a4c4ce => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:37.630693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024f622-f2ce-4f97-960b-78d15bb7f2bb admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:37.633457 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9024f622-f2ce-4f97-960b-78d15bb7f2bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:37.704530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d68fd8-d787-4616-b143-1b0e420146bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bfc1fe981424313aecce5af443c8a9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:37.706228 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d68fd8-d787-4616-b143-1b0e420146bf service glance] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:37.706899 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d68fd8-d787-4616-b143-1b0e420146bf service glance] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:37.707419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d68fd8-d787-4616-b143-1b0e420146bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:37.711495 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a7d68fd8-d787-4616-b143-1b0e420146bf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:37.739807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024f622-f2ce-4f97-960b-78d15bb7f2bb admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:37.746008 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac36bc-654d-4cec-8fa4-dfeb1f7c3912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:37.746776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac36bc-654d-4cec-8fa4-dfeb1f7c3912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:37.746959 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac36bc-654d-4cec-8fa4-dfeb1f7c3912 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:37.748180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac36bc-654d-4cec-8fa4-dfeb1f7c3912 admin admin] PATH_INFO: `/v3/users/1e96f1f23f134c02a0907a945a8e7d44` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:37.748982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac36bc-654d-4cec-8fa4-dfeb1f7c3912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e96f1f23f134c02a0907a945a8e7d44)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:37.752191 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac36bc-654d-4cec-8fa4-dfeb1f7c3912 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:37.814839 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d68fd8-d787-4616-b143-1b0e420146bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:37.816658 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d68fd8-d787-4616-b143-1b0e420146bf service glance] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:37.831261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1064/2116] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:37.833102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d68fd8-d787-4616-b143-1b0e420146bf service glance] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:37.834797 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a7d68fd8-d787-4616-b143-1b0e420146bf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:37.943213 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d68fd8-d787-4616-b143-1b0e420146bf service glance] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:37.951646 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-acac36bc-654d-4cec-8fa4-dfeb1f7c3912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e96f1f23f134c02a0907a945a8e7d44'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:37.951767 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e3f06e-5d4c-45ea-9338-c10a0d881f9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f2584622a48bba21e1bf31c1aef30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:37.952626 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-acac36bc-654d-4cec-8fa4-dfeb1f7c3912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e96f1f23f134c02a0907a945a8e7d44'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:37.952815 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3f06e-5d4c-45ea-9338-c10a0d881f9b service placement] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:37.953345 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3f06e-5d4c-45ea-9338-c10a0d881f9b service placement] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:37.953879 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3f06e-5d4c-45ea-9338-c10a0d881f9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:37.959305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f7e3f06e-5d4c-45ea-9338-c10a0d881f9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:37.973535 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3f06e-5d4c-45ea-9338-c10a0d881f9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:37.975460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e3f06e-5d4c-45ea-9338-c10a0d881f9b service placement] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:37.987219 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1065/2117] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:37.988614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a11e11-ed6a-44bf-a004-310032502710 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:37.988923 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a11e11-ed6a-44bf-a004-310032502710 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:37.989278 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a11e11-ed6a-44bf-a004-310032502710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:38.012557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-f7a11e11-ed6a-44bf-a004-310032502710 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:38.013892 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f7a11e11-ed6a-44bf-a004-310032502710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:38.025423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1066/2118] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:38.026921 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c0b16-1600-4716-854b-7e69f6dfc3ca None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:38.027309 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c0b16-1600-4716-854b-7e69f6dfc3ca None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:38.027708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c0b16-1600-4716-854b-7e69f6dfc3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:38.061941 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-984c0b16-1600-4716-854b-7e69f6dfc3ca None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:38.061941 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-984c0b16-1600-4716-854b-7e69f6dfc3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:38.073792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1067/2119] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:38.078321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c0b16-1600-4716-854b-7e69f6dfc3ca None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:38.087101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-acac36bc-654d-4cec-8fa4-dfeb1f7c3912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e96f1f23f134c02a0907a945a8e7d44'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:38.099445 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c0b16-1600-4716-854b-7e69f6dfc3ca None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:38.106742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc62a7-7cf2-400c-970e-a8c9e436091b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:38.107776 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc62a7-7cf2-400c-970e-a8c9e436091b admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:38.108230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc62a7-7cf2-400c-970e-a8c9e436091b admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:38.108881 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc62a7-7cf2-400c-970e-a8c9e436091b admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:38.109914 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc62a7-7cf2-400c-970e-a8c9e436091b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:03:38.110385 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc62a7-7cf2-400c-970e-a8c9e436091b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:38.112837 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc62a7-7cf2-400c-970e-a8c9e436091b admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:38.112992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-acac36bc-654d-4cec-8fa4-dfeb1f7c3912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e96f1f23f134c02a0907a945a8e7d44'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:38.147097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1068/2120] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:03:38.147097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc62a7-7cf2-400c-970e-a8c9e436091b admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:38.153523 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c1cc62a7-7cf2-400c-970e-a8c9e436091b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:38.157248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-acac36bc-654d-4cec-8fa4-dfeb1f7c3912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e96f1f23f134c02a0907a945a8e7d44'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:38.177799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1053/2121] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:37 2022] DELETE /identity/v3/users/1e96f1f23f134c02a0907a945a8e7d44 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:38.179892 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14886e-be00-4006-bcc5-c96b78a937c5 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:38.180760 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14886e-be00-4006-bcc5-c96b78a937c5 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:38.181112 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14886e-be00-4006-bcc5-c96b78a937c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:38.198532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc62a7-7cf2-400c-970e-a8c9e436091b admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:38.212936 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-4f14886e-be00-4006-bcc5-c96b78a937c5 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:38.214254 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-4f14886e-be00-4006-bcc5-c96b78a937c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:38.322998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafb997-62a2-41fd-bba7-04e2d52829ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:38.324506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafb997-62a2-41fd-bba7-04e2d52829ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:38.325030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafb997-62a2-41fd-bba7-04e2d52829ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:38.325384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafb997-62a2-41fd-bba7-04e2d52829ca admin admin] PATH_INFO: `/v3/projects/b698854e481144e482c549f8e02d4969` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:38.326832 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafb997-62a2-41fd-bba7-04e2d52829ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=b698854e481144e482c549f8e02d4969)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:38.329982 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafb997-62a2-41fd-bba7-04e2d52829ca admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:38.338330 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1054/2122] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:38.339508 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14886e-be00-4006-bcc5-c96b78a937c5 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:38.354258 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14886e-be00-4006-bcc5-c96b78a937c5 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:38.359588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aa1ad-6902-4c2b-8203-814f40863ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:38.360227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aa1ad-6902-4c2b-8203-814f40863ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:38.360511 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aa1ad-6902-4c2b-8203-814f40863ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:38.360942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aa1ad-6902-4c2b-8203-814f40863ed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:38.362345 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076aa1ad-6902-4c2b-8203-814f40863ed6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:38.364371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076aa1ad-6902-4c2b-8203-814f40863ed6 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:38.486534 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1055/2123] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:38 2022] POST /identity/v3/projects => generated 409 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:38.487457 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aa1ad-6902-4c2b-8203-814f40863ed6 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:38.518512 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6aafb997-62a2-41fd-bba7-04e2d52829ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b698854e481144e482c549f8e02d4969', 'request_id': 'req-6aafb997-62a2-41fd-bba7-04e2d52829ca'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:38.590753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aa1ad-6902-4c2b-8203-814f40863ed6 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:38.601713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b87e64-f3ee-48ad-a1c9-87e68e23136a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:38.602372 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b87e64-f3ee-48ad-a1c9-87e68e23136a admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:38.602716 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b87e64-f3ee-48ad-a1c9-87e68e23136a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:38.603008 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b87e64-f3ee-48ad-a1c9-87e68e23136a admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:38.604081 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b87e64-f3ee-48ad-a1c9-87e68e23136a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:03:38.604397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b87e64-f3ee-48ad-a1c9-87e68e23136a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:38.606173 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b87e64-f3ee-48ad-a1c9-87e68e23136a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:38.625582 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1056/2124] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:03:38.627135 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b87e64-f3ee-48ad-a1c9-87e68e23136a admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:38.642713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b87e64-f3ee-48ad-a1c9-87e68e23136a admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:38.648164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98916203-6223-4e87-a827-9e50087d326e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:38.648825 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98916203-6223-4e87-a827-9e50087d326e admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:38.655062 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98916203-6223-4e87-a827-9e50087d326e admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:38.655062 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98916203-6223-4e87-a827-9e50087d326e admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:38.655062 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98916203-6223-4e87-a827-9e50087d326e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:38.655062 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98916203-6223-4e87-a827-9e50087d326e admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:38.673337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6aafb997-62a2-41fd-bba7-04e2d52829ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b698854e481144e482c549f8e02d4969', 'request_id': 'req-6aafb997-62a2-41fd-bba7-04e2d52829ca'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:38.684187 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6aafb997-62a2-41fd-bba7-04e2d52829ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b698854e481144e482c549f8e02d4969', 'request_id': 'req-6aafb997-62a2-41fd-bba7-04e2d52829ca'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:38.708680 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6aafb997-62a2-41fd-bba7-04e2d52829ca admin admin] The token cache is being invalidate because project b698854e481144e482c549f8e02d4969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:38.708680 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6aafb997-62a2-41fd-bba7-04e2d52829ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:38.708680 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6aafb997-62a2-41fd-bba7-04e2d52829ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:38.714688 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1069/2125] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:38 2022] DELETE /identity/v3/projects/b698854e481144e482c549f8e02d4969 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:38.714688 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafb997-62a2-41fd-bba7-04e2d52829ca admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:38.714688 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-6aafb997-62a2-41fd-bba7-04e2d52829ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:38.729125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:38.769047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1057/2126] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:38 2022] POST /identity/v3/users => generated 305 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:38.770455 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60978b-b58b-4ec1-9ffd-dea7ea14840d None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:38.770747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60978b-b58b-4ec1-9ffd-dea7ea14840d None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:38.772135 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60978b-b58b-4ec1-9ffd-dea7ea14840d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:38.805054 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-3c60978b-b58b-4ec1-9ffd-dea7ea14840d None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:38.807753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-3c60978b-b58b-4ec1-9ffd-dea7ea14840d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:38.810234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafb997-62a2-41fd-bba7-04e2d52829ca admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:38.816098 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89df7bc-d6e5-4ee0-a20a-cd9d35dcbe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:38.816756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89df7bc-d6e5-4ee0-a20a-cd9d35dcbe70 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:38.817071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89df7bc-d6e5-4ee0-a20a-cd9d35dcbe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:38.817352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89df7bc-d6e5-4ee0-a20a-cd9d35dcbe70 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:38.818041 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89df7bc-d6e5-4ee0-a20a-cd9d35dcbe70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:38.820737 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89df7bc-d6e5-4ee0-a20a-cd9d35dcbe70 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:38.836378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1058/2127] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:38.837921 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60978b-b58b-4ec1-9ffd-dea7ea14840d None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:38.841085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-3c60978b-b58b-4ec1-9ffd-dea7ea14840d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:38.858712 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60978b-b58b-4ec1-9ffd-dea7ea14840d None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:38.864513 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17004c-e25e-40c2-a3a8-fc1fadfce09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:38.865243 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17004c-e25e-40c2-a3a8-fc1fadfce09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:38.865560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17004c-e25e-40c2-a3a8-fc1fadfce09b admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:38.865868 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17004c-e25e-40c2-a3a8-fc1fadfce09b admin admin] PATH_INFO: `/v3/projects/e01bbf9a029a48c8813b22e3bd596a6c` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:38.867125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17004c-e25e-40c2-a3a8-fc1fadfce09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e01bbf9a029a48c8813b22e3bd596a6c)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:38.869126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17004c-e25e-40c2-a3a8-fc1fadfce09b admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:38.937951 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1070/2128] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:38 2022] POST /identity/v3/projects => generated 373 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:38.937951 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89df7bc-d6e5-4ee0-a20a-cd9d35dcbe70 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:38.939774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c89df7bc-d6e5-4ee0-a20a-cd9d35dcbe70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:38.989734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-ff17004c-e25e-40c2-a3a8-fc1fadfce09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e01bbf9a029a48c8813b22e3bd596a6c', 'request_id': 'req-ff17004c-e25e-40c2-a3a8-fc1fadfce09b'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:38.997337 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-ff17004c-e25e-40c2-a3a8-fc1fadfce09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e01bbf9a029a48c8813b22e3bd596a6c', 'request_id': 'req-ff17004c-e25e-40c2-a3a8-fc1fadfce09b'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:39.004455 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-ff17004c-e25e-40c2-a3a8-fc1fadfce09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e01bbf9a029a48c8813b22e3bd596a6c', 'request_id': 'req-ff17004c-e25e-40c2-a3a8-fc1fadfce09b'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:39.010446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89df7bc-d6e5-4ee0-a20a-cd9d35dcbe70 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:39.086988 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a74d65-eeb4-4647-8f3b-5ab98bc5de4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:39.087744 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a74d65-eeb4-4647-8f3b-5ab98bc5de4b admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:39.087963 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a74d65-eeb4-4647-8f3b-5ab98bc5de4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:39.088218 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a74d65-eeb4-4647-8f3b-5ab98bc5de4b admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:39.088941 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a74d65-eeb4-4647-8f3b-5ab98bc5de4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:39.090597 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a74d65-eeb4-4647-8f3b-5ab98bc5de4b admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:39.106358 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1071/2129] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:39.106358 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89b0a0-7914-4578-ac65-65ef11bebfe3 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:39.106358 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89b0a0-7914-4578-ac65-65ef11bebfe3 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:39.106358 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89b0a0-7914-4578-ac65-65ef11bebfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:39.116160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-ff17004c-e25e-40c2-a3a8-fc1fadfce09b admin admin] The token cache is being invalidate because project e01bbf9a029a48c8813b22e3bd596a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:39.116457 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-ff17004c-e25e-40c2-a3a8-fc1fadfce09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:39.117856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-ff17004c-e25e-40c2-a3a8-fc1fadfce09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:39.123246 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1059/2130] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:38 2022] DELETE /identity/v3/projects/e01bbf9a029a48c8813b22e3bd596a6c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:39.123246 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17004c-e25e-40c2-a3a8-fc1fadfce09b admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:39.132415 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ff17004c-e25e-40c2-a3a8-fc1fadfce09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:39.147416 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17004c-e25e-40c2-a3a8-fc1fadfce09b admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:39.152942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1008b6-1ae1-40c9-9a77-8f546da694f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:39.153163 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-0e89b0a0-7914-4578-ac65-65ef11bebfe3 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:39.153588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1008b6-1ae1-40c9-9a77-8f546da694f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:39.153869 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1008b6-1ae1-40c9-9a77-8f546da694f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:39.154147 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1008b6-1ae1-40c9-9a77-8f546da694f8 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:39.154969 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-0e89b0a0-7914-4578-ac65-65ef11bebfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:39.155442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1008b6-1ae1-40c9-9a77-8f546da694f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:39.158183 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1008b6-1ae1-40c9-9a77-8f546da694f8 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:39.168417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1072/2131] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:39.173166 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89b0a0-7914-4578-ac65-65ef11bebfe3 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:39.173166 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-0e89b0a0-7914-4578-ac65-65ef11bebfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:39.186670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89b0a0-7914-4578-ac65-65ef11bebfe3 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:39.192659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d01117-4572-46e7-8b04-e03f44325e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:39.193306 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d01117-4572-46e7-8b04-e03f44325e78 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:39.193567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d01117-4572-46e7-8b04-e03f44325e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:39.193862 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d01117-4572-46e7-8b04-e03f44325e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:39.194576 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d01117-4572-46e7-8b04-e03f44325e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:39.197308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d01117-4572-46e7-8b04-e03f44325e78 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:39.209625 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1073/2132] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:39.210437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4f1bc-5014-4721-b447-bf4e69207276 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:39.210718 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4f1bc-5014-4721-b447-bf4e69207276 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:39.210993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4f1bc-5014-4721-b447-bf4e69207276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:39.233248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-d2a4f1bc-5014-4721-b447-bf4e69207276 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:39.234660 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d2a4f1bc-5014-4721-b447-bf4e69207276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:39.244773 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1074/2133] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:39.252742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4f1bc-5014-4721-b447-bf4e69207276 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:39.263483 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4f1bc-5014-4721-b447-bf4e69207276 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:39.270172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6c5d5-b3be-44a9-93a8-18dcfffc4cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:39.277128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6c5d5-b3be-44a9-93a8-18dcfffc4cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:39.277128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6c5d5-b3be-44a9-93a8-18dcfffc4cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:39.277128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6c5d5-b3be-44a9-93a8-18dcfffc4cb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:39.277128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e6c5d5-b3be-44a9-93a8-18dcfffc4cb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:03:39.277128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e6c5d5-b3be-44a9-93a8-18dcfffc4cb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:39.277128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e6c5d5-b3be-44a9-93a8-18dcfffc4cb7 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:39.286193 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1060/2134] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:39 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:39.286193 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1008b6-1ae1-40c9-9a77-8f546da694f8 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:39.291260 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1075/2135] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:03:39.296692 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31e39f-e31a-4a06-83d9-c8c8d1b53a51 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:39.297071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31e39f-e31a-4a06-83d9-c8c8d1b53a51 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:39.297424 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31e39f-e31a-4a06-83d9-c8c8d1b53a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:39.298098 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:39.310158 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1008b6-1ae1-40c9-9a77-8f546da694f8 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:39.316913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cede0-9935-4ed5-a419-9975deabd804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:39.316913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cede0-9935-4ed5-a419-9975deabd804 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:39.317365 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cede0-9935-4ed5-a419-9975deabd804 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:39.317879 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cede0-9935-4ed5-a419-9975deabd804 admin admin] PATH_INFO: `/v3/projects/60ece94aefb344fa80e9d29c19257e0b/users/47e1b4895f7345eea590ddf388de9f05/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:39.330356 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-af31e39f-e31a-4a06-83d9-c8c8d1b53a51 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:39.332551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-af31e39f-e31a-4a06-83d9-c8c8d1b53a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:39.343848 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cede0-9935-4ed5-a419-9975deabd804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ece94aefb344fa80e9d29c19257e0b, user_id=47e1b4895f7345eea590ddf388de9f05, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:39.345384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1076/2136] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:39.349278 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31e39f-e31a-4a06-83d9-c8c8d1b53a51 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:39.349441 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cede0-9935-4ed5-a419-9975deabd804 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:39.366740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31e39f-e31a-4a06-83d9-c8c8d1b53a51 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:39.378586 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115419c-5d46-49a9-abbb-1e192675b91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:39.379774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115419c-5d46-49a9-abbb-1e192675b91c admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:39.380317 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115419c-5d46-49a9-abbb-1e192675b91c admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:39.383572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115419c-5d46-49a9-abbb-1e192675b91c admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:39.383572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115419c-5d46-49a9-abbb-1e192675b91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:39.386266 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115419c-5d46-49a9-abbb-1e192675b91c admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:39.407851 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1077/2137] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:39.408832 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115419c-5d46-49a9-abbb-1e192675b91c admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:39.426310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115419c-5d46-49a9-abbb-1e192675b91c admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:39.431804 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdced1-1c3a-40d1-b238-a2f0c590b74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:39.432517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdced1-1c3a-40d1-b238-a2f0c590b74f admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:39.432791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdced1-1c3a-40d1-b238-a2f0c590b74f admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:39.433060 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdced1-1c3a-40d1-b238-a2f0c590b74f admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:39.433742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdced1-1c3a-40d1-b238-a2f0c590b74f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:39.435898 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdced1-1c3a-40d1-b238-a2f0c590b74f admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:39.449462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1061/2138] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:39 2022] PUT /identity/v3/projects/60ece94aefb344fa80e9d29c19257e0b/users/47e1b4895f7345eea590ddf388de9f05/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:39.450588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cede0-9935-4ed5-a419-9975deabd804 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:39.522950 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cede0-9935-4ed5-a419-9975deabd804 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:39.527626 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14970a6c-6e06-4231-b1e4-2c5c0ec4ead0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:39.528448 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14970a6c-6e06-4231-b1e4-2c5c0ec4ead0 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:39.528729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14970a6c-6e06-4231-b1e4-2c5c0ec4ead0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:39.529023 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14970a6c-6e06-4231-b1e4-2c5c0ec4ead0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:39.529815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14970a6c-6e06-4231-b1e4-2c5c0ec4ead0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:03:39.530162 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14970a6c-6e06-4231-b1e4-2c5c0ec4ead0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:39.531740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14970a6c-6e06-4231-b1e4-2c5c0ec4ead0 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:39.546117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1062/2139] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:03:39.547224 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14970a6c-6e06-4231-b1e4-2c5c0ec4ead0 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:39.562709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14970a6c-6e06-4231-b1e4-2c5c0ec4ead0 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:39.572022 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88bc54-6c99-489f-8b08-226256678df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:39.572672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88bc54-6c99-489f-8b08-226256678df4 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:39.572959 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88bc54-6c99-489f-8b08-226256678df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:39.573238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88bc54-6c99-489f-8b08-226256678df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:39.573949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88bc54-6c99-489f-8b08-226256678df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:39.575599 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88bc54-6c99-489f-8b08-226256678df4 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:39.586977 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1063/2140] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:39.588374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789456fa-ff7a-4b69-add2-018fb28e3c7b None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:39.588669 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789456fa-ff7a-4b69-add2-018fb28e3c7b None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:39.589022 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789456fa-ff7a-4b69-add2-018fb28e3c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:39.609028 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1078/2141] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:39 2022] POST /identity/v3/projects => generated 393 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:39.610564 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdced1-1c3a-40d1-b238-a2f0c590b74f admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:39.633431 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-789456fa-ff7a-4b69-add2-018fb28e3c7b None None] MFA Rules not processed for user `47e1b4895f7345eea590ddf388de9f05`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:39.635449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-789456fa-ff7a-4b69-add2-018fb28e3c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:39.703399 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdced1-1c3a-40d1-b238-a2f0c590b74f admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:39.709478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a553635-ce81-4da9-9171-ec7112cfa5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:39.710131 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a553635-ce81-4da9-9171-ec7112cfa5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:39.710413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a553635-ce81-4da9-9171-ec7112cfa5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:39.710690 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a553635-ce81-4da9-9171-ec7112cfa5c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:39.711401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a553635-ce81-4da9-9171-ec7112cfa5c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:39.713662 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a553635-ce81-4da9-9171-ec7112cfa5c6 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:39.724709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1064/2142] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:39 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:39.724709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789456fa-ff7a-4b69-add2-018fb28e3c7b None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:39.734165 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789456fa-ff7a-4b69-add2-018fb28e3c7b None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:39.739725 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4caac-61ff-46ca-89ee-c7a7ac35ad01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:39.740409 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4caac-61ff-46ca-89ee-c7a7ac35ad01 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:39.740692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4caac-61ff-46ca-89ee-c7a7ac35ad01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:39.740970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4caac-61ff-46ca-89ee-c7a7ac35ad01 admin admin] PATH_INFO: `/v3/projects/45d61d2f9f7444feaea967313b3b85f6/users/163c3658411b48a1b9eba2426c738808/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:39.760978 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4caac-61ff-46ca-89ee-c7a7ac35ad01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d61d2f9f7444feaea967313b3b85f6, user_id=163c3658411b48a1b9eba2426c738808, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:39.762405 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4caac-61ff-46ca-89ee-c7a7ac35ad01 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:39.828890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1079/2143] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:39 2022] POST /identity/v3/projects => generated 385 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:39.834975 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a553635-ce81-4da9-9171-ec7112cfa5c6 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:39.871890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1065/2144] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:39 2022] PUT /identity/v3/projects/45d61d2f9f7444feaea967313b3b85f6/users/163c3658411b48a1b9eba2426c738808/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:39.873158 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4caac-61ff-46ca-89ee-c7a7ac35ad01 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:39.939757 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a553635-ce81-4da9-9171-ec7112cfa5c6 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:39.975823 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4caac-61ff-46ca-89ee-c7a7ac35ad01 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:39.981346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e944e6-f77d-4691-b03f-ba67afce4acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:39.982130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e944e6-f77d-4691-b03f-ba67afce4acf admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:39.982436 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e944e6-f77d-4691-b03f-ba67afce4acf admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:39.982711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e944e6-f77d-4691-b03f-ba67afce4acf admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:39.983419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e944e6-f77d-4691-b03f-ba67afce4acf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:39.985404 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e944e6-f77d-4691-b03f-ba67afce4acf admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:40.024642 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48dc94-b42f-406e-b001-585d255fc6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:40.025380 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48dc94-b42f-406e-b001-585d255fc6ec admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:40.025661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48dc94-b42f-406e-b001-585d255fc6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:40.025934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48dc94-b42f-406e-b001-585d255fc6ec admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:40.026666 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48dc94-b42f-406e-b001-585d255fc6ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:40.028618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48dc94-b42f-406e-b001-585d255fc6ec admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:40.081425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1066/2145] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:39 2022] POST /identity/v3/projects => generated 409 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:40.082263 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e944e6-f77d-4691-b03f-ba67afce4acf admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:40.115859 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1080/2146] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:39 2022] POST /identity/v3/users => generated 297 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:40.115859 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e405a1e-f133-4edb-8d3e-e9150d87326d None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:40.115859 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e405a1e-f133-4edb-8d3e-e9150d87326d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:40.115859 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e405a1e-f133-4edb-8d3e-e9150d87326d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:40.149480 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-3e405a1e-f133-4edb-8d3e-e9150d87326d None None] MFA Rules not processed for user `163c3658411b48a1b9eba2426c738808`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:40.150755 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-3e405a1e-f133-4edb-8d3e-e9150d87326d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:40.160111 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e944e6-f77d-4691-b03f-ba67afce4acf admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:40.165261 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745336f-72bf-41e9-b8d8-81027a0dea7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:40.165927 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745336f-72bf-41e9-b8d8-81027a0dea7f admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:40.166215 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745336f-72bf-41e9-b8d8-81027a0dea7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:40.166495 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745336f-72bf-41e9-b8d8-81027a0dea7f admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:40.167179 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745336f-72bf-41e9-b8d8-81027a0dea7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:40.169293 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745336f-72bf-41e9-b8d8-81027a0dea7f admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:40.228637 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1081/2147] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:40.229498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e405a1e-f133-4edb-8d3e-e9150d87326d None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:40.243273 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e405a1e-f133-4edb-8d3e-e9150d87326d None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:40.256417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239e703-77fe-4a63-b6c7-b9d51bc3a9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:40.258115 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239e703-77fe-4a63-b6c7-b9d51bc3a9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:40.258115 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239e703-77fe-4a63-b6c7-b9d51bc3a9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:40.258115 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239e703-77fe-4a63-b6c7-b9d51bc3a9f9 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:40.260280 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239e703-77fe-4a63-b6c7-b9d51bc3a9f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:40.260813 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239e703-77fe-4a63-b6c7-b9d51bc3a9f9 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:40.307563 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1067/2148] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:40 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:40.308535 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745336f-72bf-41e9-b8d8-81027a0dea7f admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:40.329807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745336f-72bf-41e9-b8d8-81027a0dea7f admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:40.338078 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213e7d4-628b-4979-9058-b063d0fa4104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:40.339032 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213e7d4-628b-4979-9058-b063d0fa4104 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:40.339603 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213e7d4-628b-4979-9058-b063d0fa4104 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:40.340107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213e7d4-628b-4979-9058-b063d0fa4104 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:40.341408 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213e7d4-628b-4979-9058-b063d0fa4104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:40.344326 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9213e7d4-628b-4979-9058-b063d0fa4104 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:40.355628 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1068/2149] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:40.356454 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213e7d4-628b-4979-9058-b063d0fa4104 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:40.358157 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9213e7d4-628b-4979-9058-b063d0fa4104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:40.400784 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1082/2150] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:40 2022] POST /identity/v3/users => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:40.400784 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239e703-77fe-4a63-b6c7-b9d51bc3a9f9 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:40.409270 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239e703-77fe-4a63-b6c7-b9d51bc3a9f9 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:40.414931 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109034b-dca0-40f7-a6c3-7aad2ebbe766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:40.415614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109034b-dca0-40f7-a6c3-7aad2ebbe766 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:40.415911 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109034b-dca0-40f7-a6c3-7aad2ebbe766 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:40.416185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109034b-dca0-40f7-a6c3-7aad2ebbe766 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:40.416903 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109034b-dca0-40f7-a6c3-7aad2ebbe766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:40.418995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109034b-dca0-40f7-a6c3-7aad2ebbe766 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:40.429340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213e7d4-628b-4979-9058-b063d0fa4104 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:40.433868 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f12b4-d6bd-4684-b047-c360367a1a97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:40.437310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f12b4-d6bd-4684-b047-c360367a1a97 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:40.437310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f12b4-d6bd-4684-b047-c360367a1a97 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:40.437310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f12b4-d6bd-4684-b047-c360367a1a97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:40.443432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1083/2151] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:40.443432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109034b-dca0-40f7-a6c3-7aad2ebbe766 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:40.451631 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f12b4-d6bd-4684-b047-c360367a1a97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:40.453415 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f12b4-d6bd-4684-b047-c360367a1a97 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:40.464000 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109034b-dca0-40f7-a6c3-7aad2ebbe766 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:40.468095 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1069/2152] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:40.469169 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d6d47-e149-491d-8662-b1ffc6b5eb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:40.474590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d6d47-e149-491d-8662-b1ffc6b5eb18 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:40.474728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f12b4-d6bd-4684-b047-c360367a1a97 service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:40.474809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d6d47-e149-491d-8662-b1ffc6b5eb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:40.474809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d6d47-e149-491d-8662-b1ffc6b5eb18 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:40.474809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d6d47-e149-491d-8662-b1ffc6b5eb18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:40.474809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d6d47-e149-491d-8662-b1ffc6b5eb18 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:40.488620 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f12b4-d6bd-4684-b047-c360367a1a97 service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:40.494729 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1084/2153] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:40.494729 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d6d47-e149-491d-8662-b1ffc6b5eb18 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:40.497405 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900300bf-8eb4-427e-b775-9bd41d0591a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:40.498429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900300bf-8eb4-427e-b775-9bd41d0591a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:40.498968 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900300bf-8eb4-427e-b775-9bd41d0591a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:40.499566 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900300bf-8eb4-427e-b775-9bd41d0591a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:40.500905 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900300bf-8eb4-427e-b775-9bd41d0591a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:40.504288 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900300bf-8eb4-427e-b775-9bd41d0591a6 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:40.516064 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d6d47-e149-491d-8662-b1ffc6b5eb18 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:40.520824 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:40.521479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1070/2154] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:40.523153 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900300bf-8eb4-427e-b775-9bd41d0591a6 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:40.536642 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645467e-ecd7-419b-a8cc-13f649cb21de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:40.537389 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645467e-ecd7-419b-a8cc-13f649cb21de admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:40.537732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645467e-ecd7-419b-a8cc-13f649cb21de admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:40.538070 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645467e-ecd7-419b-a8cc-13f649cb21de admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:40.538847 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645467e-ecd7-419b-a8cc-13f649cb21de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:40.540443 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900300bf-8eb4-427e-b775-9bd41d0591a6 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:40.540820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645467e-ecd7-419b-a8cc-13f649cb21de admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:40.551809 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb09dcd-d7f2-4119-9716-f35d46e4b692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:40.553686 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb09dcd-d7f2-4119-9716-f35d46e4b692 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:40.554019 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb09dcd-d7f2-4119-9716-f35d46e4b692 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:40.555053 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb09dcd-d7f2-4119-9716-f35d46e4b692 admin admin] PATH_INFO: `/v3/projects/a595d454aad9412a80ea30eaba71eb53/users/707c80130c7243729f8bc6cddf2dfbf0/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:40.559849 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1085/2155] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:40.560909 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645467e-ecd7-419b-a8cc-13f649cb21de admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:40.575270 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb09dcd-d7f2-4119-9716-f35d46e4b692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a595d454aad9412a80ea30eaba71eb53, user_id=707c80130c7243729f8bc6cddf2dfbf0, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:40.578075 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb09dcd-d7f2-4119-9716-f35d46e4b692 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:40.578879 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645467e-ecd7-419b-a8cc-13f649cb21de admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:40.585694 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77948081-6c54-4821-9bb7-70aea01259e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:40.590492 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77948081-6c54-4821-9bb7-70aea01259e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:40.590492 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77948081-6c54-4821-9bb7-70aea01259e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:40.590492 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77948081-6c54-4821-9bb7-70aea01259e5 admin admin] PATH_INFO: `/v3/projects/0ad644362ff14458bad62a0e268a5c03/users/8374d2ba456a478fbc8cd7177f9d002b/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:40.603767 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77948081-6c54-4821-9bb7-70aea01259e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad644362ff14458bad62a0e268a5c03, user_id=8374d2ba456a478fbc8cd7177f9d002b, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:40.606473 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77948081-6c54-4821-9bb7-70aea01259e5 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:40.691616 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1071/2156] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:40 2022] PUT /identity/v3/projects/a595d454aad9412a80ea30eaba71eb53/users/707c80130c7243729f8bc6cddf2dfbf0/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:40.692637 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb09dcd-d7f2-4119-9716-f35d46e4b692 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:40.737557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1086/2157] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:40 2022] PUT /identity/v3/projects/0ad644362ff14458bad62a0e268a5c03/users/8374d2ba456a478fbc8cd7177f9d002b/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:40.740517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138cc7c-56a0-41d8-8b82-dfa3b8b48616 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:40.743136 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138cc7c-56a0-41d8-8b82-dfa3b8b48616 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:40.743648 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138cc7c-56a0-41d8-8b82-dfa3b8b48616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:40.769379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-a138cc7c-56a0-41d8-8b82-dfa3b8b48616 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:40.771610 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a138cc7c-56a0-41d8-8b82-dfa3b8b48616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:40.798117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb09dcd-d7f2-4119-9716-f35d46e4b692 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:40.834072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:40.854463 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1087/2158] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:40.855359 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138cc7c-56a0-41d8-8b82-dfa3b8b48616 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:40.866030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138cc7c-56a0-41d8-8b82-dfa3b8b48616 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:40.867020 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975c212-da94-4f36-ac85-c98497c30456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:40.867662 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975c212-da94-4f36-ac85-c98497c30456 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:40.877850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975c212-da94-4f36-ac85-c98497c30456 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:40.877850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975c212-da94-4f36-ac85-c98497c30456 admin admin] PATH_INFO: `/v3/projects/6a7f7be3b424499bac8e97625ad89105/users/12bf35bf6d1f43c19e9b94babf7d5347/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:40.878258 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01694f79-4088-4211-ad5a-b7a8f570ebcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:40.878258 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01694f79-4088-4211-ad5a-b7a8f570ebcd admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:40.878258 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01694f79-4088-4211-ad5a-b7a8f570ebcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:40.878258 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01694f79-4088-4211-ad5a-b7a8f570ebcd admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:40.878622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01694f79-4088-4211-ad5a-b7a8f570ebcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:40.878622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01694f79-4088-4211-ad5a-b7a8f570ebcd admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:40.886062 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975c212-da94-4f36-ac85-c98497c30456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7f7be3b424499bac8e97625ad89105, user_id=12bf35bf6d1f43c19e9b94babf7d5347, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:40.888794 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975c212-da94-4f36-ac85-c98497c30456 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:40.889302 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1088/2159] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:40.890249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01694f79-4088-4211-ad5a-b7a8f570ebcd admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:40.894455 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-01694f79-4088-4211-ad5a-b7a8f570ebcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:40.961127 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01694f79-4088-4211-ad5a-b7a8f570ebcd admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:40.964829 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffe5ba-530a-44a5-989f-73a330872924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:40.965464 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffe5ba-530a-44a5-989f-73a330872924 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:40.965740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffe5ba-530a-44a5-989f-73a330872924 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:40.966010 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffe5ba-530a-44a5-989f-73a330872924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:40.977027 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffe5ba-530a-44a5-989f-73a330872924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:40.978606 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffe5ba-530a-44a5-989f-73a330872924 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:40.989863 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1089/2160] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:40.990708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffe5ba-530a-44a5-989f-73a330872924 service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:41.000981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffe5ba-530a-44a5-989f-73a330872924 service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:41.008580 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9dc4d-92e5-4e4c-a333-e2dc5da9c7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:41.009217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9dc4d-92e5-4e4c-a333-e2dc5da9c7a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:41.009494 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9dc4d-92e5-4e4c-a333-e2dc5da9c7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:41.009774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9dc4d-92e5-4e4c-a333-e2dc5da9c7a1 admin admin] PATH_INFO: `/v3/projects/0ad644362ff14458bad62a0e268a5c03/users/8374d2ba456a478fbc8cd7177f9d002b/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:41.012160 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9dc4d-92e5-4e4c-a333-e2dc5da9c7a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad644362ff14458bad62a0e268a5c03, user_id=8374d2ba456a478fbc8cd7177f9d002b, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:41.016322 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9dc4d-92e5-4e4c-a333-e2dc5da9c7a1 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:41.037760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1090/2162] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:40 2022] PUT /identity/v3/projects/0ad644362ff14458bad62a0e268a5c03/users/8374d2ba456a478fbc8cd7177f9d002b/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:41.046812 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1072/2162] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:40 2022] PUT /identity/v3/projects/6a7f7be3b424499bac8e97625ad89105/users/12bf35bf6d1f43c19e9b94babf7d5347/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:41.049604 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388e488-c94b-4422-b215-281904e3d609 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:41.050026 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388e488-c94b-4422-b215-281904e3d609 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:41.050304 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388e488-c94b-4422-b215-281904e3d609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:41.057476 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7be34e-724a-4ebe-b206-10155a115b5f None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:41.057969 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7be34e-724a-4ebe-b206-10155a115b5f None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:41.065756 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7be34e-724a-4ebe-b206-10155a115b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:41.086652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-b388e488-c94b-4422-b215-281904e3d609 None None] MFA Rules not processed for user `12bf35bf6d1f43c19e9b94babf7d5347`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:41.087861 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b388e488-c94b-4422-b215-281904e3d609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:41.100826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-db7be34e-724a-4ebe-b206-10155a115b5f None None] MFA Rules not processed for user `8374d2ba456a478fbc8cd7177f9d002b`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:41.102177 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-db7be34e-724a-4ebe-b206-10155a115b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:41.207882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1073/2163] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:41 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:41.209598 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1091/2164] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:41.218901 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7be34e-724a-4ebe-b206-10155a115b5f None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:41.232428 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388e488-c94b-4422-b215-281904e3d609 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:41.239869 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:41.241622 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b388e488-c94b-4422-b215-281904e3d609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:41.340822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7be34e-724a-4ebe-b206-10155a115b5f None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:41.348515 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1c36b-1eb3-416c-8377-e7efd2061254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:41.354431 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1c36b-1eb3-416c-8377-e7efd2061254 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:41.354431 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1c36b-1eb3-416c-8377-e7efd2061254 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:41.354431 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1c36b-1eb3-416c-8377-e7efd2061254 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:41.354431 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1c36b-1eb3-416c-8377-e7efd2061254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:41.356302 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1c36b-1eb3-416c-8377-e7efd2061254 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:41.420213 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388e488-c94b-4422-b215-281904e3d609 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:41.425293 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc1833-6792-42e1-8e30-050240553b12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:41.425927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc1833-6792-42e1-8e30-050240553b12 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:41.426320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc1833-6792-42e1-8e30-050240553b12 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:41.426575 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc1833-6792-42e1-8e30-050240553b12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:41.457523 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc1833-6792-42e1-8e30-050240553b12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:41.459013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc1833-6792-42e1-8e30-050240553b12 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:41.471482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1092/2165] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:41 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:03:41.535133 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc1833-6792-42e1-8e30-050240553b12 service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:41.538438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1074/2166] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:41 2022] POST /identity/v3/projects => generated 385 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:41.556012 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc1833-6792-42e1-8e30-050240553b12 service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:41.591494 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:41.654178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca643c7f-7dba-45a9-926a-a7a34935049a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:41.655735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca643c7f-7dba-45a9-926a-a7a34935049a admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:41.656019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca643c7f-7dba-45a9-926a-a7a34935049a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:41.656437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca643c7f-7dba-45a9-926a-a7a34935049a admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:41.657372 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca643c7f-7dba-45a9-926a-a7a34935049a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:41.659977 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca643c7f-7dba-45a9-926a-a7a34935049a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:41.774360 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1093/2167] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:41 2022] POST /identity/v3/users => generated 299 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:41.778803 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1c36b-1eb3-416c-8377-e7efd2061254 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:41.791232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1c36b-1eb3-416c-8377-e7efd2061254 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:41.796804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584cb73-992e-4c5d-8a23-79a33dcd0353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:41.797879 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584cb73-992e-4c5d-8a23-79a33dcd0353 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:41.798790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584cb73-992e-4c5d-8a23-79a33dcd0353 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:41.801922 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584cb73-992e-4c5d-8a23-79a33dcd0353 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:41.802879 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584cb73-992e-4c5d-8a23-79a33dcd0353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:41.810490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584cb73-992e-4c5d-8a23-79a33dcd0353 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:41.831913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca643c7f-7dba-45a9-926a-a7a34935049a admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:41.832385 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1075/2168] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:41.849113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca643c7f-7dba-45a9-926a-a7a34935049a admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:41.857615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e17ce-7ff2-4a01-9152-dbcb1c843872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:41.857615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e17ce-7ff2-4a01-9152-dbcb1c843872 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:41.857615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e17ce-7ff2-4a01-9152-dbcb1c843872 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:41.857993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e17ce-7ff2-4a01-9152-dbcb1c843872 admin admin] PATH_INFO: `/v3/projects/6764533b83c34c93b018dad0688cad44/users/86eea3d4f9244454a06927da0c97d3ab/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:41.877963 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e17ce-7ff2-4a01-9152-dbcb1c843872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6764533b83c34c93b018dad0688cad44, user_id=86eea3d4f9244454a06927da0c97d3ab, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:41.881032 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e17ce-7ff2-4a01-9152-dbcb1c843872 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:42.044877 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1094/2169] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:41 2022] PUT /identity/v3/projects/6764533b83c34c93b018dad0688cad44/users/86eea3d4f9244454a06927da0c97d3ab/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:42.051680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584cb73-992e-4c5d-8a23-79a33dcd0353 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:42.069722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584cb73-992e-4c5d-8a23-79a33dcd0353 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:42.153401 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c913e-9061-4b31-addc-0587d78c3504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:42.154082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c913e-9061-4b31-addc-0587d78c3504 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:42.154369 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c913e-9061-4b31-addc-0587d78c3504 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:42.154648 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c913e-9061-4b31-addc-0587d78c3504 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:42.155942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c913e-9061-4b31-addc-0587d78c3504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:42.157766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c913e-9061-4b31-addc-0587d78c3504 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:42.180820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e17ce-7ff2-4a01-9152-dbcb1c843872 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:42.181652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1076/2170] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:42.191350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c913e-9061-4b31-addc-0587d78c3504 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:42.217394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c913e-9061-4b31-addc-0587d78c3504 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:42.227647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7626bc-a252-44e3-ac68-b60d3bc6017b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:42.228800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7626bc-a252-44e3-ac68-b60d3bc6017b admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:42.229301 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7626bc-a252-44e3-ac68-b60d3bc6017b admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:42.229786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7626bc-a252-44e3-ac68-b60d3bc6017b admin admin] PATH_INFO: `/v3/projects/6764533b83c34c93b018dad0688cad44/users/86eea3d4f9244454a06927da0c97d3ab/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:42.241525 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7626bc-a252-44e3-ac68-b60d3bc6017b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6764533b83c34c93b018dad0688cad44, user_id=86eea3d4f9244454a06927da0c97d3ab, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:42.241525 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7626bc-a252-44e3-ac68-b60d3bc6017b admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:42.255452 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1077/2171] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:42 2022] PUT /identity/v3/projects/6764533b83c34c93b018dad0688cad44/users/86eea3d4f9244454a06927da0c97d3ab/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:42.266430 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:42.269681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077995df-d40c-4438-8b2f-3bf570c4ad37 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:42.270444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077995df-d40c-4438-8b2f-3bf570c4ad37 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:42.270861 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077995df-d40c-4438-8b2f-3bf570c4ad37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:42.294355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e17ce-7ff2-4a01-9152-dbcb1c843872 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:42.317708 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-077995df-d40c-4438-8b2f-3bf570c4ad37 None None] MFA Rules not processed for user `86eea3d4f9244454a06927da0c97d3ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:42.320129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-077995df-d40c-4438-8b2f-3bf570c4ad37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:42.363802 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:42.372309 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc62c6-96ab-4da9-824b-0e82106f3e27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:42.373046 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc62c6-96ab-4da9-824b-0e82106f3e27 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:42.373326 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc62c6-96ab-4da9-824b-0e82106f3e27 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:42.373599 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc62c6-96ab-4da9-824b-0e82106f3e27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:42.452801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1078/2172] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:42.510736 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc62c6-96ab-4da9-824b-0e82106f3e27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:42.510861 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:42.512654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc62c6-96ab-4da9-824b-0e82106f3e27 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:42.532198 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1095/2173] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:42 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:42.549968 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077995df-d40c-4438-8b2f-3bf570c4ad37 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:42.566993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077995df-d40c-4438-8b2f-3bf570c4ad37 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:42.571255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199702d-6025-45f8-b462-5bb3a6291e9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:42.572048 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199702d-6025-45f8-b462-5bb3a6291e9d service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:42.572333 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199702d-6025-45f8-b462-5bb3a6291e9d service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:42.572611 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199702d-6025-45f8-b462-5bb3a6291e9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:42.579784 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c3765-bb5e-4064-8aba-696b47010b9e None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:42.580339 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c3765-bb5e-4064-8aba-696b47010b9e None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:42.580669 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c3765-bb5e-4064-8aba-696b47010b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:42.583382 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199702d-6025-45f8-b462-5bb3a6291e9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:42.584984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199702d-6025-45f8-b462-5bb3a6291e9d service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:42.597634 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1079/2174] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:03:42.617042 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-9e7c3765-bb5e-4064-8aba-696b47010b9e None None] MFA Rules not processed for user `163c3658411b48a1b9eba2426c738808`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:42.619112 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9e7c3765-bb5e-4064-8aba-696b47010b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:42.630806 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199702d-6025-45f8-b462-5bb3a6291e9d service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:42.712047 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1096/2175] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:42.724035 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199702d-6025-45f8-b462-5bb3a6291e9d service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:42.730813 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c8361-74dc-4c98-9185-d36cdd4f1f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:42.732491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c8361-74dc-4c98-9185-d36cdd4f1f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:42.732491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c8361-74dc-4c98-9185-d36cdd4f1f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:42.732939 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c8361-74dc-4c98-9185-d36cdd4f1f6c admin admin] PATH_INFO: `/v3/users/12bf35bf6d1f43c19e9b94babf7d5347` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:42.734676 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c8361-74dc-4c98-9185-d36cdd4f1f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=12bf35bf6d1f43c19e9b94babf7d5347)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:42.738200 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c8361-74dc-4c98-9185-d36cdd4f1f6c admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:42.984280 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-da1c8361-74dc-4c98-9185-d36cdd4f1f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12bf35bf6d1f43c19e9b94babf7d5347'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:42.984952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-da1c8361-74dc-4c98-9185-d36cdd4f1f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12bf35bf6d1f43c19e9b94babf7d5347'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:43.078309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-da1c8361-74dc-4c98-9185-d36cdd4f1f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12bf35bf6d1f43c19e9b94babf7d5347'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:43.086490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-da1c8361-74dc-4c98-9185-d36cdd4f1f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12bf35bf6d1f43c19e9b94babf7d5347'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:43.104830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-da1c8361-74dc-4c98-9185-d36cdd4f1f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12bf35bf6d1f43c19e9b94babf7d5347'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:43.116450 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1080/2176] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:42 2022] DELETE /identity/v3/users/12bf35bf6d1f43c19e9b94babf7d5347 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:43.130205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5287d8-f00f-4a9e-a7e1-f9d74a19c1a7 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:43.130205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5287d8-f00f-4a9e-a7e1-f9d74a19c1a7 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:43.130205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5287d8-f00f-4a9e-a7e1-f9d74a19c1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:43.178303 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-bd5287d8-f00f-4a9e-a7e1-f9d74a19c1a7 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:43.184351 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-bd5287d8-f00f-4a9e-a7e1-f9d74a19c1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:43.277202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1097/2177] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:43.285380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c8361-74dc-4c98-9185-d36cdd4f1f6c admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:43.286922 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-da1c8361-74dc-4c98-9185-d36cdd4f1f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:43.366119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c8361-74dc-4c98-9185-d36cdd4f1f6c admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:43.370888 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032a84e-a250-46e5-a24e-240614eebec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:43.371752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032a84e-a250-46e5-a24e-240614eebec7 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:43.372034 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032a84e-a250-46e5-a24e-240614eebec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:43.372338 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032a84e-a250-46e5-a24e-240614eebec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:43.383812 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032a84e-a250-46e5-a24e-240614eebec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:43.384942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032a84e-a250-46e5-a24e-240614eebec7 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:43.406415 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1081/2178] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:43.587540 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:43.947617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5287d8-f00f-4a9e-a7e1-f9d74a19c1a7 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:43.949120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-bd5287d8-f00f-4a9e-a7e1-f9d74a19c1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:43.969357 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5287d8-f00f-4a9e-a7e1-f9d74a19c1a7 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:43.986487 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f610c3b-76cf-413d-bd77-a78181436955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:43.987255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f610c3b-76cf-413d-bd77-a78181436955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:43.987607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f610c3b-76cf-413d-bd77-a78181436955 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:43.987859 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f610c3b-76cf-413d-bd77-a78181436955 admin admin] PATH_INFO: `/v3/projects/6a7f7be3b424499bac8e97625ad89105` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:43.989355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f610c3b-76cf-413d-bd77-a78181436955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a7f7be3b424499bac8e97625ad89105)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:43.991856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f610c3b-76cf-413d-bd77-a78181436955 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:44.099596 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:44.134750 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1f610c3b-76cf-413d-bd77-a78181436955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a7f7be3b424499bac8e97625ad89105', 'request_id': 'req-1f610c3b-76cf-413d-bd77-a78181436955'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:44.207821 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:44.271773 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1f610c3b-76cf-413d-bd77-a78181436955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a7f7be3b424499bac8e97625ad89105', 'request_id': 'req-1f610c3b-76cf-413d-bd77-a78181436955'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:44.287942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1f610c3b-76cf-413d-bd77-a78181436955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a7f7be3b424499bac8e97625ad89105', 'request_id': 'req-1f610c3b-76cf-413d-bd77-a78181436955'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:44.306248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1f610c3b-76cf-413d-bd77-a78181436955 admin admin] The token cache is being invalidate because project 6a7f7be3b424499bac8e97625ad89105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:44.306964 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1f610c3b-76cf-413d-bd77-a78181436955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:44.308325 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1f610c3b-76cf-413d-bd77-a78181436955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:44.311345 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1098/2179] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:43 2022] DELETE /identity/v3/projects/6a7f7be3b424499bac8e97625ad89105 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:44.317502 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032a84e-a250-46e5-a24e-240614eebec7 service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:44.330188 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032a84e-a250-46e5-a24e-240614eebec7 service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:44.431899 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ee659-84ed-4634-a395-4523bf1f313b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:44.433419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ee659-84ed-4634-a395-4523bf1f313b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:44.433929 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ee659-84ed-4634-a395-4523bf1f313b admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:44.434426 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ee659-84ed-4634-a395-4523bf1f313b admin admin] PATH_INFO: `/v3/users/86eea3d4f9244454a06927da0c97d3ab` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:44.437901 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ee659-84ed-4634-a395-4523bf1f313b admin admin] RBAC: Authorizing `identity:delete_user(user_id=86eea3d4f9244454a06927da0c97d3ab)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:44.442630 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ee659-84ed-4634-a395-4523bf1f313b admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:44.715096 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-fc3ee659-84ed-4634-a395-4523bf1f313b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86eea3d4f9244454a06927da0c97d3ab'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:44.716326 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-fc3ee659-84ed-4634-a395-4523bf1f313b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86eea3d4f9244454a06927da0c97d3ab'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:44.816440 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-fc3ee659-84ed-4634-a395-4523bf1f313b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86eea3d4f9244454a06927da0c97d3ab'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:44.826829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-fc3ee659-84ed-4634-a395-4523bf1f313b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86eea3d4f9244454a06927da0c97d3ab'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:44.849184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-fc3ee659-84ed-4634-a395-4523bf1f313b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86eea3d4f9244454a06927da0c97d3ab'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:44.858454 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1082/2180] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:44 2022] DELETE /identity/v3/users/86eea3d4f9244454a06927da0c97d3ab => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:45.421048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f610c3b-76cf-413d-bd77-a78181436955 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:45.424573 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-1f610c3b-76cf-413d-bd77-a78181436955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:45.451306 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f610c3b-76cf-413d-bd77-a78181436955 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:45.595853 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40a940-0c82-49fc-b0a8-ec7e5eae83e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:45.596927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40a940-0c82-49fc-b0a8-ec7e5eae83e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:45.597370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40a940-0c82-49fc-b0a8-ec7e5eae83e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:45.597803 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40a940-0c82-49fc-b0a8-ec7e5eae83e0 admin admin] PATH_INFO: `/v3/projects/6764533b83c34c93b018dad0688cad44` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:45.600030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40a940-0c82-49fc-b0a8-ec7e5eae83e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6764533b83c34c93b018dad0688cad44)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:45.602303 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40a940-0c82-49fc-b0a8-ec7e5eae83e0 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:45.741871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:45.850148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-cc40a940-0c82-49fc-b0a8-ec7e5eae83e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6764533b83c34c93b018dad0688cad44', 'request_id': 'req-cc40a940-0c82-49fc-b0a8-ec7e5eae83e0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:45.961490 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-cc40a940-0c82-49fc-b0a8-ec7e5eae83e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6764533b83c34c93b018dad0688cad44', 'request_id': 'req-cc40a940-0c82-49fc-b0a8-ec7e5eae83e0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:45.982738 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-cc40a940-0c82-49fc-b0a8-ec7e5eae83e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6764533b83c34c93b018dad0688cad44', 'request_id': 'req-cc40a940-0c82-49fc-b0a8-ec7e5eae83e0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:46.005610 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-cc40a940-0c82-49fc-b0a8-ec7e5eae83e0 admin admin] The token cache is being invalidate because project 6764533b83c34c93b018dad0688cad44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:46.006183 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-cc40a940-0c82-49fc-b0a8-ec7e5eae83e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:46.007416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-cc40a940-0c82-49fc-b0a8-ec7e5eae83e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:46.009795 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1099/2181] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:45 2022] DELETE /identity/v3/projects/6764533b83c34c93b018dad0688cad44 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:46.018078 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c524f1-6992-499b-9f18-c297a1c0b0a1 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:46.018353 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c524f1-6992-499b-9f18-c297a1c0b0a1 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:46.018641 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c524f1-6992-499b-9f18-c297a1c0b0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:46.050413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-b7c524f1-6992-499b-9f18-c297a1c0b0a1 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:46.052032 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b7c524f1-6992-499b-9f18-c297a1c0b0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:46.163653 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1083/2182] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:46.171693 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f10a8-3ca9-4007-9ef8-180608c84368 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:46.172266 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f10a8-3ca9-4007-9ef8-180608c84368 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:46.172873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f10a8-3ca9-4007-9ef8-180608c84368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:46.210208 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-201f10a8-3ca9-4007-9ef8-180608c84368 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:46.212048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-201f10a8-3ca9-4007-9ef8-180608c84368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:46.229191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1100/2183] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:46.232647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c524f1-6992-499b-9f18-c297a1c0b0a1 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:46.247308 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c524f1-6992-499b-9f18-c297a1c0b0a1 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:46.257951 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:46.283122 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1c509-2e7a-4c67-850e-620f8f334fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:46.284776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1c509-2e7a-4c67-850e-620f8f334fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:46.285410 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1c509-2e7a-4c67-850e-620f8f334fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:46.285862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1c509-2e7a-4c67-850e-620f8f334fc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:46.286767 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1c509-2e7a-4c67-850e-620f8f334fc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:03:46.287231 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1c509-2e7a-4c67-850e-620f8f334fc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:46.289806 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1c509-2e7a-4c67-850e-620f8f334fc4 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:46.311928 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1084/2184] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:03:46.316726 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f10a8-3ca9-4007-9ef8-180608c84368 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:46.327529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f10a8-3ca9-4007-9ef8-180608c84368 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:46.334129 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974b256-8abc-4af7-86d0-ab271a85e45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:46.334778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974b256-8abc-4af7-86d0-ab271a85e45d admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:46.335272 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974b256-8abc-4af7-86d0-ab271a85e45d admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:46.335765 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974b256-8abc-4af7-86d0-ab271a85e45d admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:46.336651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974b256-8abc-4af7-86d0-ab271a85e45d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:46.339013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974b256-8abc-4af7-86d0-ab271a85e45d admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:46.451171 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1c509-2e7a-4c67-850e-620f8f334fc4 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:46.461745 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1101/2185] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:46 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:46.465853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1c509-2e7a-4c67-850e-620f8f334fc4 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:46.590342 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060b303-21e2-4534-b729-c9564ea64347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:46.591285 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060b303-21e2-4534-b729-c9564ea64347 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:46.592189 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060b303-21e2-4534-b729-c9564ea64347 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:46.592553 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060b303-21e2-4534-b729-c9564ea64347 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:46.593367 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060b303-21e2-4534-b729-c9564ea64347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:46.596219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060b303-21e2-4534-b729-c9564ea64347 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:46.778156 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1085/2186] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:46 2022] POST /identity/v3/users => generated 294 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:46.783380 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974b256-8abc-4af7-86d0-ab271a85e45d admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:46.825531 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974b256-8abc-4af7-86d0-ab271a85e45d admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:46.841146 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa55cf-d148-4b90-8d93-0c1baaeba552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:46.843227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa55cf-d148-4b90-8d93-0c1baaeba552 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:46.843882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa55cf-d148-4b90-8d93-0c1baaeba552 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:46.844363 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa55cf-d148-4b90-8d93-0c1baaeba552 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:46.846414 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa55cf-d148-4b90-8d93-0c1baaeba552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:46.849724 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa55cf-d148-4b90-8d93-0c1baaeba552 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:46.871188 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1102/2187] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:46.875408 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060b303-21e2-4534-b729-c9564ea64347 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:46.887305 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060b303-21e2-4534-b729-c9564ea64347 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:46.892829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a7b69-311e-49f1-96cf-d60b3deb6123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:46.893490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a7b69-311e-49f1-96cf-d60b3deb6123 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:46.893779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a7b69-311e-49f1-96cf-d60b3deb6123 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:46.894093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a7b69-311e-49f1-96cf-d60b3deb6123 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:46.894826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a7b69-311e-49f1-96cf-d60b3deb6123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:46.896548 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a7b69-311e-49f1-96cf-d60b3deb6123 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:46.919064 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1086/2188] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:46.924623 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa55cf-d148-4b90-8d93-0c1baaeba552 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:46.934901 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa55cf-d148-4b90-8d93-0c1baaeba552 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:46.940664 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46389c82-b0a9-4b50-bb7d-884e517ed221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:46.941352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46389c82-b0a9-4b50-bb7d-884e517ed221 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:46.941632 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46389c82-b0a9-4b50-bb7d-884e517ed221 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:46.941912 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46389c82-b0a9-4b50-bb7d-884e517ed221 admin admin] PATH_INFO: `/v3/projects/c9d14bc39b104b2d957135cc9dd9ce4e/users/ed93d2a53f804301aa39403f6ea2b44e/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:46.966431 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46389c82-b0a9-4b50-bb7d-884e517ed221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d14bc39b104b2d957135cc9dd9ce4e, user_id=ed93d2a53f804301aa39403f6ea2b44e, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:46.971551 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46389c82-b0a9-4b50-bb7d-884e517ed221 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:47.149003 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1103/2189] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:46 2022] PUT /identity/v3/projects/c9d14bc39b104b2d957135cc9dd9ce4e/users/ed93d2a53f804301aa39403f6ea2b44e/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:47.159988 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48d076-f3cf-4192-8ef7-1df95a7c4e00 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:47.160689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48d076-f3cf-4192-8ef7-1df95a7c4e00 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:47.161129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48d076-f3cf-4192-8ef7-1df95a7c4e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:47.254955 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-1a48d076-f3cf-4192-8ef7-1df95a7c4e00 None None] MFA Rules not processed for user `ed93d2a53f804301aa39403f6ea2b44e`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:47.259798 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-1a48d076-f3cf-4192-8ef7-1df95a7c4e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:47.476196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1087/2190] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:47.476938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46389c82-b0a9-4b50-bb7d-884e517ed221 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:47.587479 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46389c82-b0a9-4b50-bb7d-884e517ed221 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:47.592513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9d53a-173f-4f83-8328-b027366199ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:47.593164 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9d53a-173f-4f83-8328-b027366199ef admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:47.593449 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9d53a-173f-4f83-8328-b027366199ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:47.593723 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9d53a-173f-4f83-8328-b027366199ef admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:47.594406 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9d53a-173f-4f83-8328-b027366199ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:47.597436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9d53a-173f-4f83-8328-b027366199ef admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:47.718698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1104/2191] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:47 2022] POST /identity/v3/projects => generated 385 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:47.724983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48d076-f3cf-4192-8ef7-1df95a7c4e00 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:47.738431 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48d076-f3cf-4192-8ef7-1df95a7c4e00 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:47.821439 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ccc8f-d18a-4384-b5f2-b0c560de3076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:47.822332 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ccc8f-d18a-4384-b5f2-b0c560de3076 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:47.822439 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ccc8f-d18a-4384-b5f2-b0c560de3076 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:47.823439 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ccc8f-d18a-4384-b5f2-b0c560de3076 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:47.823550 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ccc8f-d18a-4384-b5f2-b0c560de3076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:47.825649 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ccc8f-d18a-4384-b5f2-b0c560de3076 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:47.876499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:47.936917 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:47.942751 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1088/2192] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:47 2022] POST /identity/v3/users => generated 299 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:03:47.946611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9d53a-173f-4f83-8328-b027366199ef admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:47.959749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9d53a-173f-4f83-8328-b027366199ef admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:47.968315 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2f70f-4ecd-4995-be5c-8a91ed0d4471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:47.970995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2f70f-4ecd-4995-be5c-8a91ed0d4471 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:47.970995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2f70f-4ecd-4995-be5c-8a91ed0d4471 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:47.970995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2f70f-4ecd-4995-be5c-8a91ed0d4471 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:47.970995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2f70f-4ecd-4995-be5c-8a91ed0d4471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:47.973248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2f70f-4ecd-4995-be5c-8a91ed0d4471 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:47.991006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1105/2193] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:47.995834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ccc8f-d18a-4384-b5f2-b0c560de3076 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:48.013468 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ccc8f-d18a-4384-b5f2-b0c560de3076 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:48.023518 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e96880-d153-4d66-baa8-53fab7e667f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:48.026938 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e96880-d153-4d66-baa8-53fab7e667f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:48.026938 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e96880-d153-4d66-baa8-53fab7e667f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:48.026938 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e96880-d153-4d66-baa8-53fab7e667f5 admin admin] PATH_INFO: `/v3/projects/8368144de6ae45199999b324f5476a61/users/bfd9dcb7be0741449d7763bfde3fa970/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:48.058399 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e96880-d153-4d66-baa8-53fab7e667f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8368144de6ae45199999b324f5476a61, user_id=bfd9dcb7be0741449d7763bfde3fa970, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:48.061317 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e96880-d153-4d66-baa8-53fab7e667f5 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:48.244472 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1089/2194] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:47 2022] PUT /identity/v3/projects/8368144de6ae45199999b324f5476a61/users/bfd9dcb7be0741449d7763bfde3fa970/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:48.249899 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2f70f-4ecd-4995-be5c-8a91ed0d4471 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:48.290556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2f70f-4ecd-4995-be5c-8a91ed0d4471 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:48.423376 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662548f-1042-44fa-a88f-55af62bf6533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:48.427187 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662548f-1042-44fa-a88f-55af62bf6533 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:48.428020 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662548f-1042-44fa-a88f-55af62bf6533 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:48.428664 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662548f-1042-44fa-a88f-55af62bf6533 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:48.430153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662548f-1042-44fa-a88f-55af62bf6533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:48.433365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f662548f-1042-44fa-a88f-55af62bf6533 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:48.456365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1106/2195] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:48.463665 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e96880-d153-4d66-baa8-53fab7e667f5 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:48.488708 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e96880-d153-4d66-baa8-53fab7e667f5 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:48.500425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741436d-cfca-4f9d-a41e-9fbb57f8aeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:48.503633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741436d-cfca-4f9d-a41e-9fbb57f8aeb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:48.505632 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741436d-cfca-4f9d-a41e-9fbb57f8aeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:48.505632 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741436d-cfca-4f9d-a41e-9fbb57f8aeb6 admin admin] PATH_INFO: `/v3/projects/8368144de6ae45199999b324f5476a61/users/bfd9dcb7be0741449d7763bfde3fa970/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:48.510025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741436d-cfca-4f9d-a41e-9fbb57f8aeb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8368144de6ae45199999b324f5476a61, user_id=bfd9dcb7be0741449d7763bfde3fa970, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:48.516026 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741436d-cfca-4f9d-a41e-9fbb57f8aeb6 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:48.569920 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1090/2196] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:48 2022] PUT /identity/v3/projects/8368144de6ae45199999b324f5476a61/users/bfd9dcb7be0741449d7763bfde3fa970/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:48.571556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec347ec-1ecc-428c-85b3-ea7ed6213253 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:48.572511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec347ec-1ecc-428c-85b3-ea7ed6213253 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:48.573449 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec347ec-1ecc-428c-85b3-ea7ed6213253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:48.620057 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-fec347ec-1ecc-428c-85b3-ea7ed6213253 None None] MFA Rules not processed for user `bfd9dcb7be0741449d7763bfde3fa970`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:48.621635 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-fec347ec-1ecc-428c-85b3-ea7ed6213253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:48.721037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dc509-9bb2-4a9e-9152-df6cc3b60dc7 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:48.721511 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dc509-9bb2-4a9e-9152-df6cc3b60dc7 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:48.721993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dc509-9bb2-4a9e-9152-df6cc3b60dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:48.732399 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1107/2197] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:48.746672 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec347ec-1ecc-428c-85b3-ea7ed6213253 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:48.749158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-fec347ec-1ecc-428c-85b3-ea7ed6213253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:48.800656 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-743dc509-9bb2-4a9e-9152-df6cc3b60dc7 None None] MFA Rules not processed for user `707c80130c7243729f8bc6cddf2dfbf0`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:48.803110 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-743dc509-9bb2-4a9e-9152-df6cc3b60dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:48.866024 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec347ec-1ecc-428c-85b3-ea7ed6213253 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:48.873640 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62080dae-d7e2-45cf-b9b8-477fcaa07607 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:48.874818 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62080dae-d7e2-45cf-b9b8-477fcaa07607 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:48.875301 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62080dae-d7e2-45cf-b9b8-477fcaa07607 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:48.875902 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62080dae-d7e2-45cf-b9b8-477fcaa07607 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:48.907182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:48.917862 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62080dae-d7e2-45cf-b9b8-477fcaa07607 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:48.920985 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62080dae-d7e2-45cf-b9b8-477fcaa07607 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:48.928139 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1091/2198] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:48.942465 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400be0b5-8fbc-427c-aac0-618db15803c4 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:48.943171 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400be0b5-8fbc-427c-aac0-618db15803c4 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:48.943743 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400be0b5-8fbc-427c-aac0-618db15803c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:48.961738 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1108/2199] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:03:48.984375 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-400be0b5-8fbc-427c-aac0-618db15803c4 None None] MFA Rules not processed for user `707c80130c7243729f8bc6cddf2dfbf0`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:48.987177 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-400be0b5-8fbc-427c-aac0-618db15803c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:49.004803 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1092/2200] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:49.026273 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62080dae-d7e2-45cf-b9b8-477fcaa07607 service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:49.029474 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-62080dae-d7e2-45cf-b9b8-477fcaa07607 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:49.177873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62080dae-d7e2-45cf-b9b8-477fcaa07607 service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:49.184633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a1b09-6f6d-4095-94e3-18f9f85b3248 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:49.185488 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a1b09-6f6d-4095-94e3-18f9f85b3248 service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:49.185864 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a1b09-6f6d-4095-94e3-18f9f85b3248 service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:49.186243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a1b09-6f6d-4095-94e3-18f9f85b3248 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:49.202764 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a1b09-6f6d-4095-94e3-18f9f85b3248 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:49.205368 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a1b09-6f6d-4095-94e3-18f9f85b3248 service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:49.219817 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1109/2201] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:49.324834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:50.124578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:50.715760 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400be0b5-8fbc-427c-aac0-618db15803c4 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:50.790175 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400be0b5-8fbc-427c-aac0-618db15803c4 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:50.795206 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d56ea-183d-41f6-b158-b74685d65deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:50.798903 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d56ea-183d-41f6-b158-b74685d65deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:50.798903 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d56ea-183d-41f6-b158-b74685d65deb admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:50.799113 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d56ea-183d-41f6-b158-b74685d65deb admin admin] PATH_INFO: `/v3/users/ed93d2a53f804301aa39403f6ea2b44e` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:50.800648 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d56ea-183d-41f6-b158-b74685d65deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed93d2a53f804301aa39403f6ea2b44e)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:50.804701 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d56ea-183d-41f6-b158-b74685d65deb admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:50.823809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a1b09-6f6d-4095-94e3-18f9f85b3248 service nova] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:50.825783 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ef7a1b09-6f6d-4095-94e3-18f9f85b3248 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:50.842286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a1b09-6f6d-4095-94e3-18f9f85b3248 service nova] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:50.854737 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14069b-010b-449d-b8ea-aeac973e5180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:50.855964 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14069b-010b-449d-b8ea-aeac973e5180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:50.856466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14069b-010b-449d-b8ea-aeac973e5180 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:50.856997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14069b-010b-449d-b8ea-aeac973e5180 admin admin] PATH_INFO: `/v3/users/47e1b4895f7345eea590ddf388de9f05` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:50.859185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14069b-010b-449d-b8ea-aeac973e5180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e1b4895f7345eea590ddf388de9f05)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:50.863084 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14069b-010b-449d-b8ea-aeac973e5180 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:51.080655 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-d98d56ea-183d-41f6-b158-b74685d65deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed93d2a53f804301aa39403f6ea2b44e'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:51.081490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-d98d56ea-183d-41f6-b158-b74685d65deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed93d2a53f804301aa39403f6ea2b44e'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:51.148488 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ca14069b-010b-449d-b8ea-aeac973e5180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e1b4895f7345eea590ddf388de9f05'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:51.149449 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ca14069b-010b-449d-b8ea-aeac973e5180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e1b4895f7345eea590ddf388de9f05'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:51.166606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-d98d56ea-183d-41f6-b158-b74685d65deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed93d2a53f804301aa39403f6ea2b44e'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:51.180242 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-d98d56ea-183d-41f6-b158-b74685d65deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed93d2a53f804301aa39403f6ea2b44e'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:51.194616 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-d98d56ea-183d-41f6-b158-b74685d65deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed93d2a53f804301aa39403f6ea2b44e'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:51.210588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1093/2202] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:50 2022] DELETE /identity/v3/users/ed93d2a53f804301aa39403f6ea2b44e => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:51.215064 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce744ebc-776f-43f4-b31c-62996d3f3ad0 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:51.215417 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce744ebc-776f-43f4-b31c-62996d3f3ad0 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:51.218569 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce744ebc-776f-43f4-b31c-62996d3f3ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:51.238700 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ca14069b-010b-449d-b8ea-aeac973e5180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e1b4895f7345eea590ddf388de9f05'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:51.270203 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-ce744ebc-776f-43f4-b31c-62996d3f3ad0 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:51.270428 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ca14069b-010b-449d-b8ea-aeac973e5180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e1b4895f7345eea590ddf388de9f05'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:51.272827 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ce744ebc-776f-43f4-b31c-62996d3f3ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:51.289208 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ca14069b-010b-449d-b8ea-aeac973e5180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e1b4895f7345eea590ddf388de9f05'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:51.307574 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1110/2203] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:50 2022] DELETE /identity/v3/users/47e1b4895f7345eea590ddf388de9f05 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:51.309420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd449175-0b2a-49f6-8b4a-2650e9b581e4 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:51.309903 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd449175-0b2a-49f6-8b4a-2650e9b581e4 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:51.310343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd449175-0b2a-49f6-8b4a-2650e9b581e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:51.348181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:51.360957 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-dd449175-0b2a-49f6-8b4a-2650e9b581e4 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:51.364605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-dd449175-0b2a-49f6-8b4a-2650e9b581e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:51.414336 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1094/2204] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:51.426597 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce744ebc-776f-43f4-b31c-62996d3f3ad0 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:51.428108 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ce744ebc-776f-43f4-b31c-62996d3f3ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:51.463365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1111/2205] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:51.473998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd449175-0b2a-49f6-8b4a-2650e9b581e4 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:51.482213 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-dd449175-0b2a-49f6-8b4a-2650e9b581e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:51.559166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce744ebc-776f-43f4-b31c-62996d3f3ad0 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:51.625667 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd449175-0b2a-49f6-8b4a-2650e9b581e4 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:51.635458 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41b139-83dc-4b8c-9b5f-c9fd84c41ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:51.636863 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41b139-83dc-4b8c-9b5f-c9fd84c41ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:51.637476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41b139-83dc-4b8c-9b5f-c9fd84c41ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:51.638185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41b139-83dc-4b8c-9b5f-c9fd84c41ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:51.643340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345de724-488f-4312-968e-495a4a8bbedc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:51.644296 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345de724-488f-4312-968e-495a4a8bbedc service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:51.644736 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345de724-488f-4312-968e-495a4a8bbedc service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:51.645171 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345de724-488f-4312-968e-495a4a8bbedc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:51.662017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:51.669538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345de724-488f-4312-968e-495a4a8bbedc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:51.671259 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345de724-488f-4312-968e-495a4a8bbedc service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:51.671991 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41b139-83dc-4b8c-9b5f-c9fd84c41ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:51.674230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41b139-83dc-4b8c-9b5f-c9fd84c41ab9 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:51.693860 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1095/2206] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:51.697540 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1112/2207] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:03:52.164854 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:52.319860 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345de724-488f-4312-968e-495a4a8bbedc service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:52.321041 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-345de724-488f-4312-968e-495a4a8bbedc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:52.342894 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345de724-488f-4312-968e-495a4a8bbedc service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:52.349706 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dcdb8-2d70-4400-9f9a-9b96a5eee7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:52.350737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dcdb8-2d70-4400-9f9a-9b96a5eee7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:52.351096 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dcdb8-2d70-4400-9f9a-9b96a5eee7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:52.351535 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dcdb8-2d70-4400-9f9a-9b96a5eee7a1 admin admin] PATH_INFO: `/v3/projects/c9d14bc39b104b2d957135cc9dd9ce4e` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:52.353288 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345dcdb8-2d70-4400-9f9a-9b96a5eee7a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d14bc39b104b2d957135cc9dd9ce4e)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:52.355657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345dcdb8-2d70-4400-9f9a-9b96a5eee7a1 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:52.368463 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:52.417489 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41b139-83dc-4b8c-9b5f-c9fd84c41ab9 service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:52.420999 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-dc41b139-83dc-4b8c-9b5f-c9fd84c41ab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:52.447768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41b139-83dc-4b8c-9b5f-c9fd84c41ab9 service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:52.465851 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0dbae-4ca7-4229-ba93-d01ded2fbafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:52.466952 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0dbae-4ca7-4229-ba93-d01ded2fbafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:52.467235 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0dbae-4ca7-4229-ba93-d01ded2fbafa admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:52.467833 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0dbae-4ca7-4229-ba93-d01ded2fbafa admin admin] PATH_INFO: `/v3/projects/60ece94aefb344fa80e9d29c19257e0b` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:52.473052 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0dbae-4ca7-4229-ba93-d01ded2fbafa admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ece94aefb344fa80e9d29c19257e0b)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:52.473052 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0dbae-4ca7-4229-ba93-d01ded2fbafa admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:52.495698 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:52.514626 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-345dcdb8-2d70-4400-9f9a-9b96a5eee7a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d14bc39b104b2d957135cc9dd9ce4e', 'request_id': 'req-345dcdb8-2d70-4400-9f9a-9b96a5eee7a1'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:52.521981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-345dcdb8-2d70-4400-9f9a-9b96a5eee7a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d14bc39b104b2d957135cc9dd9ce4e', 'request_id': 'req-345dcdb8-2d70-4400-9f9a-9b96a5eee7a1'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:52.529049 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-345dcdb8-2d70-4400-9f9a-9b96a5eee7a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d14bc39b104b2d957135cc9dd9ce4e', 'request_id': 'req-345dcdb8-2d70-4400-9f9a-9b96a5eee7a1'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:52.611223 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ced0dbae-4ca7-4229-ba93-d01ded2fbafa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ece94aefb344fa80e9d29c19257e0b', 'request_id': 'req-ced0dbae-4ca7-4229-ba93-d01ded2fbafa'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:52.632808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-345dcdb8-2d70-4400-9f9a-9b96a5eee7a1 admin admin] The token cache is being invalidate because project c9d14bc39b104b2d957135cc9dd9ce4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:52.633329 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-345dcdb8-2d70-4400-9f9a-9b96a5eee7a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:52.634396 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-345dcdb8-2d70-4400-9f9a-9b96a5eee7a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:52.637196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1096/2208] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:52 2022] DELETE /identity/v3/projects/c9d14bc39b104b2d957135cc9dd9ce4e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:52.641611 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dcdb8-2d70-4400-9f9a-9b96a5eee7a1 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:52.649181 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-345dcdb8-2d70-4400-9f9a-9b96a5eee7a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:52.696148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ced0dbae-4ca7-4229-ba93-d01ded2fbafa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ece94aefb344fa80e9d29c19257e0b', 'request_id': 'req-ced0dbae-4ca7-4229-ba93-d01ded2fbafa'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:52.708043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ced0dbae-4ca7-4229-ba93-d01ded2fbafa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ece94aefb344fa80e9d29c19257e0b', 'request_id': 'req-ced0dbae-4ca7-4229-ba93-d01ded2fbafa'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:52.729568 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ced0dbae-4ca7-4229-ba93-d01ded2fbafa admin admin] The token cache is being invalidate because project 60ece94aefb344fa80e9d29c19257e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:52.729958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ced0dbae-4ca7-4229-ba93-d01ded2fbafa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:52.731130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ced0dbae-4ca7-4229-ba93-d01ded2fbafa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:52.734191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1113/2209] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:52 2022] DELETE /identity/v3/projects/60ece94aefb344fa80e9d29c19257e0b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:52.741154 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0dbae-4ca7-4229-ba93-d01ded2fbafa admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:52.743311 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ced0dbae-4ca7-4229-ba93-d01ded2fbafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:52.752518 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dcdb8-2d70-4400-9f9a-9b96a5eee7a1 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:52.866830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dfd70-9941-4329-8694-15c8a8efd124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:52.866830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dfd70-9941-4329-8694-15c8a8efd124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:52.866830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dfd70-9941-4329-8694-15c8a8efd124 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:52.866830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dfd70-9941-4329-8694-15c8a8efd124 admin admin] PATH_INFO: `/v3/users/bfd9dcb7be0741449d7763bfde3fa970` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:52.867309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9dfd70-9941-4329-8694-15c8a8efd124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd9dcb7be0741449d7763bfde3fa970)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:52.867309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9dfd70-9941-4329-8694-15c8a8efd124 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:52.886853 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:52.891175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0dbae-4ca7-4229-ba93-d01ded2fbafa admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:52.900614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240933fe-439b-4600-8b88-bc4c4c74dcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:52.900614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240933fe-439b-4600-8b88-bc4c4c74dcd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:52.900614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240933fe-439b-4600-8b88-bc4c4c74dcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:52.900614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240933fe-439b-4600-8b88-bc4c4c74dcd0 admin admin] PATH_INFO: `/v3/users/8374d2ba456a478fbc8cd7177f9d002b` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:52.901297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240933fe-439b-4600-8b88-bc4c4c74dcd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8374d2ba456a478fbc8cd7177f9d002b)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:52.902409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240933fe-439b-4600-8b88-bc4c4c74dcd0 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:52.925824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:53.083238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-9e9dfd70-9941-4329-8694-15c8a8efd124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd9dcb7be0741449d7763bfde3fa970'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:53.084113 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-9e9dfd70-9941-4329-8694-15c8a8efd124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd9dcb7be0741449d7763bfde3fa970'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:53.114115 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-240933fe-439b-4600-8b88-bc4c4c74dcd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8374d2ba456a478fbc8cd7177f9d002b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:53.115019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-240933fe-439b-4600-8b88-bc4c4c74dcd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8374d2ba456a478fbc8cd7177f9d002b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:53.160171 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-9e9dfd70-9941-4329-8694-15c8a8efd124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd9dcb7be0741449d7763bfde3fa970'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:53.170207 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-9e9dfd70-9941-4329-8694-15c8a8efd124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd9dcb7be0741449d7763bfde3fa970'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:53.184519 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-9e9dfd70-9941-4329-8694-15c8a8efd124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd9dcb7be0741449d7763bfde3fa970'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:53.191885 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1097/2210] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:52 2022] DELETE /identity/v3/users/bfd9dcb7be0741449d7763bfde3fa970 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:53.247970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-240933fe-439b-4600-8b88-bc4c4c74dcd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8374d2ba456a478fbc8cd7177f9d002b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:53.263463 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-240933fe-439b-4600-8b88-bc4c4c74dcd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8374d2ba456a478fbc8cd7177f9d002b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:53.272858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-240933fe-439b-4600-8b88-bc4c4c74dcd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8374d2ba456a478fbc8cd7177f9d002b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:53.287146 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1114/2211] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:03:52 2022] DELETE /identity/v3/users/8374d2ba456a478fbc8cd7177f9d002b => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:53.350867 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:53.442129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:53.695630 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:53.702722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dfd70-9941-4329-8694-15c8a8efd124 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:53.705335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9e9dfd70-9941-4329-8694-15c8a8efd124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:53.783091 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:53.793011 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dfd70-9941-4329-8694-15c8a8efd124 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:53.812066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240933fe-439b-4600-8b88-bc4c4c74dcd0 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:53.813519 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-240933fe-439b-4600-8b88-bc4c4c74dcd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:53.861185 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5b87b-b795-4e86-a1b0-83eb2528c0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:53.861906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b87b-b795-4e86-a1b0-83eb2528c0dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:53.862254 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b87b-b795-4e86-a1b0-83eb2528c0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:53.862530 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b87b-b795-4e86-a1b0-83eb2528c0dc admin admin] PATH_INFO: `/v3/projects/8368144de6ae45199999b324f5476a61` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:53.863960 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5b87b-b795-4e86-a1b0-83eb2528c0dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8368144de6ae45199999b324f5476a61)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:53.866108 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5b87b-b795-4e86-a1b0-83eb2528c0dc admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:53.908922 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240933fe-439b-4600-8b88-bc4c4c74dcd0 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:53.913887 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad84d0-5855-42b2-92bc-0e15e6225ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:53.914557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad84d0-5855-42b2-92bc-0e15e6225ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:53.914840 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad84d0-5855-42b2-92bc-0e15e6225ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:53.915273 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad84d0-5855-42b2-92bc-0e15e6225ba0 admin admin] PATH_INFO: `/v3/projects/0ad644362ff14458bad62a0e268a5c03` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:53.916526 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad84d0-5855-42b2-92bc-0e15e6225ba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ad644362ff14458bad62a0e268a5c03)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:53.918462 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad84d0-5855-42b2-92bc-0e15e6225ba0 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:53.964271 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:53.970614 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-96f5b87b-b795-4e86-a1b0-83eb2528c0dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8368144de6ae45199999b324f5476a61', 'request_id': 'req-96f5b87b-b795-4e86-a1b0-83eb2528c0dc'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:53.978189 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-96f5b87b-b795-4e86-a1b0-83eb2528c0dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8368144de6ae45199999b324f5476a61', 'request_id': 'req-96f5b87b-b795-4e86-a1b0-83eb2528c0dc'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:53.983946 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-96f5b87b-b795-4e86-a1b0-83eb2528c0dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8368144de6ae45199999b324f5476a61', 'request_id': 'req-96f5b87b-b795-4e86-a1b0-83eb2528c0dc'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:54.018570 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d7ad84d0-5855-42b2-92bc-0e15e6225ba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ad644362ff14458bad62a0e268a5c03', 'request_id': 'req-d7ad84d0-5855-42b2-92bc-0e15e6225ba0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:54.066968 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-96f5b87b-b795-4e86-a1b0-83eb2528c0dc admin admin] The token cache is being invalidate because project 8368144de6ae45199999b324f5476a61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:54.067478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-96f5b87b-b795-4e86-a1b0-83eb2528c0dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:54.068251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-96f5b87b-b795-4e86-a1b0-83eb2528c0dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:54.070350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1098/2212] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:53 2022] DELETE /identity/v3/projects/8368144de6ae45199999b324f5476a61 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:54.076891 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b0dd4-b0ae-438e-8c1a-7fa09cbf579b None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:54.077395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b0dd4-b0ae-438e-8c1a-7fa09cbf579b None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:54.077921 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b0dd4-b0ae-438e-8c1a-7fa09cbf579b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:54.100863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-307b0dd4-b0ae-438e-8c1a-7fa09cbf579b None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:54.103999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-307b0dd4-b0ae-438e-8c1a-7fa09cbf579b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:54.124222 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d7ad84d0-5855-42b2-92bc-0e15e6225ba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ad644362ff14458bad62a0e268a5c03', 'request_id': 'req-d7ad84d0-5855-42b2-92bc-0e15e6225ba0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:54.130911 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d7ad84d0-5855-42b2-92bc-0e15e6225ba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ad644362ff14458bad62a0e268a5c03', 'request_id': 'req-d7ad84d0-5855-42b2-92bc-0e15e6225ba0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:54.136742 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:54.144158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d7ad84d0-5855-42b2-92bc-0e15e6225ba0 admin admin] The token cache is being invalidate because project 0ad644362ff14458bad62a0e268a5c03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:03:54.144158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d7ad84d0-5855-42b2-92bc-0e15e6225ba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:54.144972 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d7ad84d0-5855-42b2-92bc-0e15e6225ba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:03:54.148108 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1115/2213] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:03:53 2022] DELETE /identity/v3/projects/0ad644362ff14458bad62a0e268a5c03 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:54.153884 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90d4c9-ceb4-402a-a777-c3b674270d61 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:54.154312 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90d4c9-ceb4-402a-a777-c3b674270d61 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:54.154593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90d4c9-ceb4-402a-a777-c3b674270d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:54.174406 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1099/2214] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:54.179884 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-0f90d4c9-ceb4-402a-a777-c3b674270d61 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:54.179884 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-0f90d4c9-ceb4-402a-a777-c3b674270d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:54.182314 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8672d0a-5039-44a6-b26d-2dc41e54cb52 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:54.182632 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8672d0a-5039-44a6-b26d-2dc41e54cb52 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:54.183050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8672d0a-5039-44a6-b26d-2dc41e54cb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:54.186866 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1116/2215] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:54.195181 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cd587-39fe-43d8-8df1-87e8e8e13973 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:54.195509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cd587-39fe-43d8-8df1-87e8e8e13973 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:54.195790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cd587-39fe-43d8-8df1-87e8e8e13973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:54.203850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-e8672d0a-5039-44a6-b26d-2dc41e54cb52 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:54.205623 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e8672d0a-5039-44a6-b26d-2dc41e54cb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:54.215083 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1100/2216] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:54.216734 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-767cd587-39fe-43d8-8df1-87e8e8e13973 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:54.217966 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-767cd587-39fe-43d8-8df1-87e8e8e13973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:54.219498 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8672d0a-5039-44a6-b26d-2dc41e54cb52 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:54.227210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1117/2217] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:54.230294 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8672d0a-5039-44a6-b26d-2dc41e54cb52 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:54.231269 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cd587-39fe-43d8-8df1-87e8e8e13973 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:54.236433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7eb63-707a-479c-bbd1-02ccc1e899c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:54.237194 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7eb63-707a-479c-bbd1-02ccc1e899c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:54.238205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7eb63-707a-479c-bbd1-02ccc1e899c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:54.238205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7eb63-707a-479c-bbd1-02ccc1e899c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:54.238743 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7eb63-707a-479c-bbd1-02ccc1e899c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:03:54.239165 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7eb63-707a-479c-bbd1-02ccc1e899c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:54.240940 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7eb63-707a-479c-bbd1-02ccc1e899c3 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:54.241921 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cd587-39fe-43d8-8df1-87e8e8e13973 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:54.246824 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686dd71-c66a-4a78-ad4b-9fa7d20aa2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:54.249543 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686dd71-c66a-4a78-ad4b-9fa7d20aa2cb admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:54.249543 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686dd71-c66a-4a78-ad4b-9fa7d20aa2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:54.249543 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686dd71-c66a-4a78-ad4b-9fa7d20aa2cb admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:54.249543 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686dd71-c66a-4a78-ad4b-9fa7d20aa2cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:03:54.249543 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686dd71-c66a-4a78-ad4b-9fa7d20aa2cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:54.250785 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686dd71-c66a-4a78-ad4b-9fa7d20aa2cb admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:54.255053 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1101/2218] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 04:03:54.267436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1118/2219] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 04:03:54.268228 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7eb63-707a-479c-bbd1-02ccc1e899c3 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:54.274490 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686dd71-c66a-4a78-ad4b-9fa7d20aa2cb admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:54.287146 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686dd71-c66a-4a78-ad4b-9fa7d20aa2cb admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:54.287416 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7eb63-707a-479c-bbd1-02ccc1e899c3 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:54.292277 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b694162-a23b-4ac7-a8d8-75263929a903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:54.292805 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2568a9-c088-43a7-a49b-c306a91cd7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:54.292918 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b694162-a23b-4ac7-a8d8-75263929a903 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:54.293184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b694162-a23b-4ac7-a8d8-75263929a903 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:54.293462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b694162-a23b-4ac7-a8d8-75263929a903 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:54.293809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2568a9-c088-43a7-a49b-c306a91cd7fa admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:54.294142 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b694162-a23b-4ac7-a8d8-75263929a903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:54.294313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2568a9-c088-43a7-a49b-c306a91cd7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:54.294745 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2568a9-c088-43a7-a49b-c306a91cd7fa admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:54.295860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2568a9-c088-43a7-a49b-c306a91cd7fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:54.297103 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b694162-a23b-4ac7-a8d8-75263929a903 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:54.301746 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2568a9-c088-43a7-a49b-c306a91cd7fa admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:54.307669 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:54.393487 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1102/2220] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:54 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:54.397931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b694162-a23b-4ac7-a8d8-75263929a903 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:54.429521 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1119/2221] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:54 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:03:54.431103 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2568a9-c088-43a7-a49b-c306a91cd7fa admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:54.470744 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:54.476704 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b694162-a23b-4ac7-a8d8-75263929a903 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:54.496911 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:54.520417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2568a9-c088-43a7-a49b-c306a91cd7fa admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:54.525693 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d10c0-03a5-46e5-aea7-01c02461ce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:54.526336 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d10c0-03a5-46e5-aea7-01c02461ce1a admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:54.526621 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d10c0-03a5-46e5-aea7-01c02461ce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:54.526912 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d10c0-03a5-46e5-aea7-01c02461ce1a admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:54.527776 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d10c0-03a5-46e5-aea7-01c02461ce1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:54.530063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d10c0-03a5-46e5-aea7-01c02461ce1a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:54.546218 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e00f8a-8664-4368-b1ac-c71fb3820a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:54.546860 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e00f8a-8664-4368-b1ac-c71fb3820a04 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:54.547152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e00f8a-8664-4368-b1ac-c71fb3820a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:54.547501 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e00f8a-8664-4368-b1ac-c71fb3820a04 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:54.549022 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e00f8a-8664-4368-b1ac-c71fb3820a04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:54.551179 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e00f8a-8664-4368-b1ac-c71fb3820a04 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:54.667147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1120/2222] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:54 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:54.671252 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d10c0-03a5-46e5-aea7-01c02461ce1a admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:54.682682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d10c0-03a5-46e5-aea7-01c02461ce1a admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:54.687541 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881bf2d-1f99-4482-9e06-25c75459cee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:54.688236 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881bf2d-1f99-4482-9e06-25c75459cee3 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:54.688514 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881bf2d-1f99-4482-9e06-25c75459cee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:54.689874 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881bf2d-1f99-4482-9e06-25c75459cee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:54.690723 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881bf2d-1f99-4482-9e06-25c75459cee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:54.692478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881bf2d-1f99-4482-9e06-25c75459cee3 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:54.699675 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:54.706265 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1121/2223] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:54.710389 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881bf2d-1f99-4482-9e06-25c75459cee3 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:54.713127 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1103/2224] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:54 2022] POST /identity/v3/users => generated 288 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:03:54.714406 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e00f8a-8664-4368-b1ac-c71fb3820a04 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:54.724011 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881bf2d-1f99-4482-9e06-25c75459cee3 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:54.724288 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e00f8a-8664-4368-b1ac-c71fb3820a04 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:54.728803 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38848c5-8307-4ccb-9948-e3c9430af657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:54.729166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52496ed1-4f9c-4d98-a727-60d9c87e577b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:54.729422 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38848c5-8307-4ccb-9948-e3c9430af657 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:54.729703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38848c5-8307-4ccb-9948-e3c9430af657 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:54.729803 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52496ed1-4f9c-4d98-a727-60d9c87e577b admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:54.729985 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38848c5-8307-4ccb-9948-e3c9430af657 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:54.730086 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52496ed1-4f9c-4d98-a727-60d9c87e577b admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:54.730325 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52496ed1-4f9c-4d98-a727-60d9c87e577b admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:54.730694 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38848c5-8307-4ccb-9948-e3c9430af657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:54.731053 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52496ed1-4f9c-4d98-a727-60d9c87e577b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:54.732344 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38848c5-8307-4ccb-9948-e3c9430af657 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:54.732810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52496ed1-4f9c-4d98-a727-60d9c87e577b admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:54.743591 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1104/2225] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:54.746797 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1122/2226] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:54.747966 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38848c5-8307-4ccb-9948-e3c9430af657 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:54.748092 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52496ed1-4f9c-4d98-a727-60d9c87e577b admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:54.763468 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52496ed1-4f9c-4d98-a727-60d9c87e577b admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:54.763737 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38848c5-8307-4ccb-9948-e3c9430af657 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:54.768984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b37899-9ca0-411b-b33f-39b2d702480a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:54.769612 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b37899-9ca0-411b-b33f-39b2d702480a admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:54.769894 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b37899-9ca0-411b-b33f-39b2d702480a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:54.770012 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60425a-adb5-4827-86bb-76339ee3c287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:54.770171 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b37899-9ca0-411b-b33f-39b2d702480a admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:54.770685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60425a-adb5-4827-86bb-76339ee3c287 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:54.770872 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b37899-9ca0-411b-b33f-39b2d702480a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:54.771015 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60425a-adb5-4827-86bb-76339ee3c287 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:54.771224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60425a-adb5-4827-86bb-76339ee3c287 admin admin] PATH_INFO: `/v3/projects/c9a39cb0de484493b97b9bb320f6a804/users/f7e1a2aea8c44771aab6517c31e7596e/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:54.772642 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b37899-9ca0-411b-b33f-39b2d702480a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:54.784202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1105/2227] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:03:54.788369 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b37899-9ca0-411b-b33f-39b2d702480a admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:54.796987 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60425a-adb5-4827-86bb-76339ee3c287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9a39cb0de484493b97b9bb320f6a804, user_id=f7e1a2aea8c44771aab6517c31e7596e, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:54.799842 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b37899-9ca0-411b-b33f-39b2d702480a admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:54.800617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60425a-adb5-4827-86bb-76339ee3c287 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:54.804552 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ee413-9734-43e2-8362-ea35633aee65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:54.805365 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ee413-9734-43e2-8362-ea35633aee65 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:54.805809 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ee413-9734-43e2-8362-ea35633aee65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:54.806192 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ee413-9734-43e2-8362-ea35633aee65 admin admin] PATH_INFO: `/v3/projects/8fd3558ef2994940a26351bca3c44dcc/users/cf05c64465cc4c9aa6d39b761eb506f4/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:54.823711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ee413-9734-43e2-8362-ea35633aee65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd3558ef2994940a26351bca3c44dcc, user_id=cf05c64465cc4c9aa6d39b761eb506f4, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:54.826428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ee413-9734-43e2-8362-ea35633aee65 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:54.915851 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1123/2228] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:54 2022] PUT /identity/v3/projects/c9a39cb0de484493b97b9bb320f6a804/users/f7e1a2aea8c44771aab6517c31e7596e/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:54.918806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:54.926464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1106/2229] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:54 2022] PUT /identity/v3/projects/8fd3558ef2994940a26351bca3c44dcc/users/cf05c64465cc4c9aa6d39b761eb506f4/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:54.927614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a1061-5410-4400-b6b7-130418e7ada5 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:54.927924 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a1061-5410-4400-b6b7-130418e7ada5 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:54.928215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a1061-5410-4400-b6b7-130418e7ada5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:54.940203 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93f386-308b-424c-98f2-ee6d235d244d None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:54.940203 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93f386-308b-424c-98f2-ee6d235d244d None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:54.940203 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93f386-308b-424c-98f2-ee6d235d244d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:54.966721 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-3c5a1061-5410-4400-b6b7-130418e7ada5 None None] MFA Rules not processed for user `f7e1a2aea8c44771aab6517c31e7596e`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:54.968011 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-3c5a1061-5410-4400-b6b7-130418e7ada5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:54.973332 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-8e93f386-308b-424c-98f2-ee6d235d244d None None] MFA Rules not processed for user `cf05c64465cc4c9aa6d39b761eb506f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:54.974632 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-8e93f386-308b-424c-98f2-ee6d235d244d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:55.041448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1124/2230] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:55.046120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a1061-5410-4400-b6b7-130418e7ada5 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:55.058444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1107/2231] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:55.061505 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:55.075498 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93f386-308b-424c-98f2-ee6d235d244d None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:55.075498 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-8e93f386-308b-424c-98f2-ee6d235d244d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:55.113370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:55.123801 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a1061-5410-4400-b6b7-130418e7ada5 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:55.129192 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019ea56-02e1-47ac-916f-ddfdab7c3d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:55.129823 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019ea56-02e1-47ac-916f-ddfdab7c3d52 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:55.130141 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019ea56-02e1-47ac-916f-ddfdab7c3d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:55.130414 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019ea56-02e1-47ac-916f-ddfdab7c3d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:55.131089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019ea56-02e1-47ac-916f-ddfdab7c3d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:55.133305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019ea56-02e1-47ac-916f-ddfdab7c3d52 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:55.134202 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93f386-308b-424c-98f2-ee6d235d244d None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:55.137771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff02c9f-c07b-420f-abcc-4fb5914bbbcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:55.138388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff02c9f-c07b-420f-abcc-4fb5914bbbcf service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:55.138669 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff02c9f-c07b-420f-abcc-4fb5914bbbcf service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:55.138942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff02c9f-c07b-420f-abcc-4fb5914bbbcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:55.149448 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff02c9f-c07b-420f-abcc-4fb5914bbbcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:55.156714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff02c9f-c07b-420f-abcc-4fb5914bbbcf service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:55.161773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1108/2232] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:03:55.244714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:55.249872 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1125/2233] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:03:55 2022] POST /identity/v3/projects => generated 383 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:03:55.251016 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff02c9f-c07b-420f-abcc-4fb5914bbbcf service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:55.265861 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff02c9f-c07b-420f-abcc-4fb5914bbbcf service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:55.302002 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:55.338490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da653f11-bfc1-4cc8-9250-1327a4dde079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:55.339120 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da653f11-bfc1-4cc8-9250-1327a4dde079 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:55.339443 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da653f11-bfc1-4cc8-9250-1327a4dde079 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:55.339718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da653f11-bfc1-4cc8-9250-1327a4dde079 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:55.340391 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da653f11-bfc1-4cc8-9250-1327a4dde079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:55.342316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da653f11-bfc1-4cc8-9250-1327a4dde079 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:55.421619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1109/2234] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:03:55 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:03:55.426247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019ea56-02e1-47ac-916f-ddfdab7c3d52 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:55.446748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019ea56-02e1-47ac-916f-ddfdab7c3d52 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:55.446748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e73b0-f8da-401f-b380-b8cf7e43a7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:55.446748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e73b0-f8da-401f-b380-b8cf7e43a7ea admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:55.446748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e73b0-f8da-401f-b380-b8cf7e43a7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:55.447167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e73b0-f8da-401f-b380-b8cf7e43a7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:55.447399 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e73b0-f8da-401f-b380-b8cf7e43a7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:55.449021 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e73b0-f8da-401f-b380-b8cf7e43a7ea admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:55.460415 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1126/2235] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:55.466194 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da653f11-bfc1-4cc8-9250-1327a4dde079 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:55.477514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da653f11-bfc1-4cc8-9250-1327a4dde079 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:55.482668 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731730e5-a387-47ff-8bc8-067df0c888cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:55.483420 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731730e5-a387-47ff-8bc8-067df0c888cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:55.483693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731730e5-a387-47ff-8bc8-067df0c888cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:55.483994 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731730e5-a387-47ff-8bc8-067df0c888cd admin admin] PATH_INFO: `/v3/projects/50d01cd0a3b14622b78e5e81be34e4ee/users/7080f460bdd74d8ab108edfd37cd72b1/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:55.502561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731730e5-a387-47ff-8bc8-067df0c888cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d01cd0a3b14622b78e5e81be34e4ee, user_id=7080f460bdd74d8ab108edfd37cd72b1, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:55.505343 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731730e5-a387-47ff-8bc8-067df0c888cd admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:55.557048 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:55.662037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1110/2236] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:55 2022] PUT /identity/v3/projects/50d01cd0a3b14622b78e5e81be34e4ee/users/7080f460bdd74d8ab108edfd37cd72b1/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:03:55.666278 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e73b0-f8da-401f-b380-b8cf7e43a7ea admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:55.677819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e73b0-f8da-401f-b380-b8cf7e43a7ea admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:55.762766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb265b-aef9-4a73-a15c-4c9663804024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:55.763513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb265b-aef9-4a73-a15c-4c9663804024 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:55.763776 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb265b-aef9-4a73-a15c-4c9663804024 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:55.764036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb265b-aef9-4a73-a15c-4c9663804024 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:55.764711 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb265b-aef9-4a73-a15c-4c9663804024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:55.766428 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb265b-aef9-4a73-a15c-4c9663804024 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:55.778962 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1127/2237] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:03:55.783512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731730e5-a387-47ff-8bc8-067df0c888cd admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:55.803577 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731730e5-a387-47ff-8bc8-067df0c888cd admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:55.817849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad48a4-4193-4535-ac06-1e646627eaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:55.819021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad48a4-4193-4535-ac06-1e646627eaa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:55.819740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad48a4-4193-4535-ac06-1e646627eaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:55.820218 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad48a4-4193-4535-ac06-1e646627eaa7 admin admin] PATH_INFO: `/v3/projects/50d01cd0a3b14622b78e5e81be34e4ee/users/7080f460bdd74d8ab108edfd37cd72b1/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:55.824126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad48a4-4193-4535-ac06-1e646627eaa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d01cd0a3b14622b78e5e81be34e4ee, user_id=7080f460bdd74d8ab108edfd37cd72b1, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:55.828191 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad48a4-4193-4535-ac06-1e646627eaa7 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:55.868150 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1111/2238] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:03:55 2022] PUT /identity/v3/projects/50d01cd0a3b14622b78e5e81be34e4ee/users/7080f460bdd74d8ab108edfd37cd72b1/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:03:55.930172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:55.952305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a856fe3-7c27-4ce5-97af-3f2d0ed2dcba None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:55.952863 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a856fe3-7c27-4ce5-97af-3f2d0ed2dcba None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:55.953317 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a856fe3-7c27-4ce5-97af-3f2d0ed2dcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:55.999424 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-8a856fe3-7c27-4ce5-97af-3f2d0ed2dcba None None] MFA Rules not processed for user `7080f460bdd74d8ab108edfd37cd72b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:56.000955 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-8a856fe3-7c27-4ce5-97af-3f2d0ed2dcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:56.131387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1128/2239] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:03:56.142467 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad48a4-4193-4535-ac06-1e646627eaa7 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:03:56.145847 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-abad48a4-4193-4535-ac06-1e646627eaa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:56.173905 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:56.229134 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad48a4-4193-4535-ac06-1e646627eaa7 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:03:56.232770 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7be264-df53-4f2f-9ce6-b915ac9864f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:03:56.233393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7be264-df53-4f2f-9ce6-b915ac9864f9 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:56.233674 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7be264-df53-4f2f-9ce6-b915ac9864f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:56.233946 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7be264-df53-4f2f-9ce6-b915ac9864f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:56.299661 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7be264-df53-4f2f-9ce6-b915ac9864f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:03:56.301423 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7be264-df53-4f2f-9ce6-b915ac9864f9 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:03:56.312054 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1112/2240] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:03:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:03:56.612941 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:56.735638 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cc25a-dd3b-407f-8428-b8e2584288af None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:03:56.735919 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cc25a-dd3b-407f-8428-b8e2584288af None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:03:56.736194 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cc25a-dd3b-407f-8428-b8e2584288af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:03:56.758878 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-5a5cc25a-dd3b-407f-8428-b8e2584288af None None] MFA Rules not processed for user `707c80130c7243729f8bc6cddf2dfbf0`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:03:56.761810 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-5a5cc25a-dd3b-407f-8428-b8e2584288af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:03:56.841079 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1129/2241] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:03:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:03:56.958786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:57.895688 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:58.819301 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:00.005234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:00.494151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:00.708891 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:00.952735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7be264-df53-4f2f-9ce6-b915ac9864f9 service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:01.158775 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7be264-df53-4f2f-9ce6-b915ac9864f9 service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:01.168052 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55881e-5673-49c8-b3dd-53e14e13c61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:01.170268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55881e-5673-49c8-b3dd-53e14e13c61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:01.171048 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55881e-5673-49c8-b3dd-53e14e13c61e admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:01.171569 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55881e-5673-49c8-b3dd-53e14e13c61e admin admin] PATH_INFO: `/v3/users/cf05c64465cc4c9aa6d39b761eb506f4` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:01.174865 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55881e-5673-49c8-b3dd-53e14e13c61e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf05c64465cc4c9aa6d39b761eb506f4)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:01.177408 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55881e-5673-49c8-b3dd-53e14e13c61e admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:01.498384 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0e55881e-5673-49c8-b3dd-53e14e13c61e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf05c64465cc4c9aa6d39b761eb506f4'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:01.508312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0e55881e-5673-49c8-b3dd-53e14e13c61e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf05c64465cc4c9aa6d39b761eb506f4'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:01.598693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0e55881e-5673-49c8-b3dd-53e14e13c61e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf05c64465cc4c9aa6d39b761eb506f4'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:01.612907 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0e55881e-5673-49c8-b3dd-53e14e13c61e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf05c64465cc4c9aa6d39b761eb506f4'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:01.655662 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0e55881e-5673-49c8-b3dd-53e14e13c61e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf05c64465cc4c9aa6d39b761eb506f4'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:01.662624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1113/2242] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:04:00 2022] DELETE /identity/v3/users/cf05c64465cc4c9aa6d39b761eb506f4 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:04:01.674106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d725c0-6b09-479c-8acc-4a7a292099b6 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:01.674666 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d725c0-6b09-479c-8acc-4a7a292099b6 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:01.674666 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d725c0-6b09-479c-8acc-4a7a292099b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:01.699010 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-46d725c0-6b09-479c-8acc-4a7a292099b6 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:01.700378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-46d725c0-6b09-479c-8acc-4a7a292099b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:01.772527 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1130/2243] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:01.780893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55881e-5673-49c8-b3dd-53e14e13c61e admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:01.783037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0e55881e-5673-49c8-b3dd-53e14e13c61e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:01.896094 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55881e-5673-49c8-b3dd-53e14e13c61e admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:01.901917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7a872-dc35-4bfd-a6b0-25ba505fc657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:01.903265 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7a872-dc35-4bfd-a6b0-25ba505fc657 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:01.903623 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7a872-dc35-4bfd-a6b0-25ba505fc657 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:01.903966 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7a872-dc35-4bfd-a6b0-25ba505fc657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:01.919374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7a872-dc35-4bfd-a6b0-25ba505fc657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:01.920932 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7a872-dc35-4bfd-a6b0-25ba505fc657 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:01.934589 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1114/2244] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:04:02.030738 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:02.408680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:02.916686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d725c0-6b09-479c-8acc-4a7a292099b6 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:02.921059 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-46d725c0-6b09-479c-8acc-4a7a292099b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:02.958281 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d725c0-6b09-479c-8acc-4a7a292099b6 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:02.965907 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941604c7-7362-499a-98e0-5ecee3106619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:02.967056 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941604c7-7362-499a-98e0-5ecee3106619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:02.967807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941604c7-7362-499a-98e0-5ecee3106619 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:02.968240 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941604c7-7362-499a-98e0-5ecee3106619 admin admin] PATH_INFO: `/v3/projects/8fd3558ef2994940a26351bca3c44dcc` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:02.972112 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941604c7-7362-499a-98e0-5ecee3106619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd3558ef2994940a26351bca3c44dcc)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:02.974625 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941604c7-7362-499a-98e0-5ecee3106619 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:03.205355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-941604c7-7362-499a-98e0-5ecee3106619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd3558ef2994940a26351bca3c44dcc', 'request_id': 'req-941604c7-7362-499a-98e0-5ecee3106619'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:03.333611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-941604c7-7362-499a-98e0-5ecee3106619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd3558ef2994940a26351bca3c44dcc', 'request_id': 'req-941604c7-7362-499a-98e0-5ecee3106619'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:03.347774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-941604c7-7362-499a-98e0-5ecee3106619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd3558ef2994940a26351bca3c44dcc', 'request_id': 'req-941604c7-7362-499a-98e0-5ecee3106619'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:03.395094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-941604c7-7362-499a-98e0-5ecee3106619 admin admin] The token cache is being invalidate because project 8fd3558ef2994940a26351bca3c44dcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:04:03.395802 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-941604c7-7362-499a-98e0-5ecee3106619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:03.398062 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-941604c7-7362-499a-98e0-5ecee3106619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:03.402093 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1131/2245] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:04:02 2022] DELETE /identity/v3/projects/8fd3558ef2994940a26351bca3c44dcc => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:04:03.411112 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5934c-be7f-4244-9616-63c9d1a16009 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:03.412048 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5934c-be7f-4244-9616-63c9d1a16009 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:03.412048 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5934c-be7f-4244-9616-63c9d1a16009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:03.491351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-beb5934c-be7f-4244-9616-63c9d1a16009 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:03.494671 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-beb5934c-be7f-4244-9616-63c9d1a16009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:03.609004 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1115/2246] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:03.618505 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19758f-3d2d-40b8-8959-77b79d49542b None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:03.620215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19758f-3d2d-40b8-8959-77b79d49542b None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:03.621380 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19758f-3d2d-40b8-8959-77b79d49542b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:03.665545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-fe19758f-3d2d-40b8-8959-77b79d49542b None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:03.666807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-fe19758f-3d2d-40b8-8959-77b79d49542b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:03.679123 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1132/2247] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:03.684604 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5934c-be7f-4244-9616-63c9d1a16009 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:03.697641 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5934c-be7f-4244-9616-63c9d1a16009 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:03.702707 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42caaf9f-e9d3-49ee-b399-b7d620953565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:03.703355 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42caaf9f-e9d3-49ee-b399-b7d620953565 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:03.703642 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42caaf9f-e9d3-49ee-b399-b7d620953565 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:03.703921 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42caaf9f-e9d3-49ee-b399-b7d620953565 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:03.705435 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42caaf9f-e9d3-49ee-b399-b7d620953565 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:04:03.705743 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42caaf9f-e9d3-49ee-b399-b7d620953565 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:03.707383 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42caaf9f-e9d3-49ee-b399-b7d620953565 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:03.727264 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1116/2248] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 04:04:03.731638 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19758f-3d2d-40b8-8959-77b79d49542b None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:03.742131 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19758f-3d2d-40b8-8959-77b79d49542b None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:03.750352 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a89da4-58de-40b1-be96-81f284e18353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:03.751028 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a89da4-58de-40b1-be96-81f284e18353 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:03.752073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a89da4-58de-40b1-be96-81f284e18353 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:03.752931 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a89da4-58de-40b1-be96-81f284e18353 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:03.753690 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a89da4-58de-40b1-be96-81f284e18353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:03.755949 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a89da4-58de-40b1-be96-81f284e18353 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:03.805029 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:03.875369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1133/2249] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:04:03 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:04:03.879972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42caaf9f-e9d3-49ee-b399-b7d620953565 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:03.892880 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42caaf9f-e9d3-49ee-b399-b7d620953565 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:04.025550 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a89da4-58de-40b1-be96-81f284e18353 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:04.027666 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-11a89da4-58de-40b1-be96-81f284e18353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:04.095443 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bc421-098c-4a64-8d9b-a4fc0283ecdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:04.095946 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bc421-098c-4a64-8d9b-a4fc0283ecdd admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:04.101258 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bc421-098c-4a64-8d9b-a4fc0283ecdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:04.101258 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bc421-098c-4a64-8d9b-a4fc0283ecdd admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:04.101258 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bc421-098c-4a64-8d9b-a4fc0283ecdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:04.101258 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bc421-098c-4a64-8d9b-a4fc0283ecdd admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:04.179289 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a89da4-58de-40b1-be96-81f284e18353 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:04.192892 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba645191-27f5-46b0-a8bf-09347c240190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:04.199129 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba645191-27f5-46b0-a8bf-09347c240190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:04.199129 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba645191-27f5-46b0-a8bf-09347c240190 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:04.199129 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba645191-27f5-46b0-a8bf-09347c240190 admin admin] PATH_INFO: `/v3/users/d5efcb797d0445dfb364957e3a3d8708` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:04.200540 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba645191-27f5-46b0-a8bf-09347c240190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5efcb797d0445dfb364957e3a3d8708)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:04.202560 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba645191-27f5-46b0-a8bf-09347c240190 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:04.232050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1117/2250] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:04:03 2022] POST /identity/v3/users => generated 287 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:04:04.233592 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bc421-098c-4a64-8d9b-a4fc0283ecdd admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:04.243851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b13bc421-098c-4a64-8d9b-a4fc0283ecdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:04.342500 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bc421-098c-4a64-8d9b-a4fc0283ecdd admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:04.361278 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6da8e-5bc3-47ec-9fe8-d7175b516aa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:04.362890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6da8e-5bc3-47ec-9fe8-d7175b516aa7 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:04.363276 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6da8e-5bc3-47ec-9fe8-d7175b516aa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:04.365428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6da8e-5bc3-47ec-9fe8-d7175b516aa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:04.369753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-7fd6da8e-5bc3-47ec-9fe8-d7175b516aa7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:04.472141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6da8e-5bc3-47ec-9fe8-d7175b516aa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:04.474169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd6da8e-5bc3-47ec-9fe8-d7175b516aa7 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:04.486761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1118/2251] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:04:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:04:04.487697 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6da8e-5bc3-47ec-9fe8-d7175b516aa7 service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:04.518742 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6da8e-5bc3-47ec-9fe8-d7175b516aa7 service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:04.525858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ba645191-27f5-46b0-a8bf-09347c240190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5efcb797d0445dfb364957e3a3d8708'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:04.526927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ba645191-27f5-46b0-a8bf-09347c240190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5efcb797d0445dfb364957e3a3d8708'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:04.539897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4384e4-5cc2-48c6-ab5a-eaa74ee20445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:04.540470 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4384e4-5cc2-48c6-ab5a-eaa74ee20445 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:04.540762 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4384e4-5cc2-48c6-ab5a-eaa74ee20445 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:04.541031 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4384e4-5cc2-48c6-ab5a-eaa74ee20445 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:04.541742 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4384e4-5cc2-48c6-ab5a-eaa74ee20445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:04.544495 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4384e4-5cc2-48c6-ab5a-eaa74ee20445 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:04.573777 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1119/2252] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:04:04.573777 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4384e4-5cc2-48c6-ab5a-eaa74ee20445 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:04.593351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4384e4-5cc2-48c6-ab5a-eaa74ee20445 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:04.603358 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab4b57-7cea-4476-baf5-28b94a0027d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:04.604752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab4b57-7cea-4476-baf5-28b94a0027d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:04.605522 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab4b57-7cea-4476-baf5-28b94a0027d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:04.606110 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab4b57-7cea-4476-baf5-28b94a0027d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:04.608056 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab4b57-7cea-4476-baf5-28b94a0027d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:04.613675 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab4b57-7cea-4476-baf5-28b94a0027d6 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:04.648618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1120/2253] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:04:04.654167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab4b57-7cea-4476-baf5-28b94a0027d6 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:04.698512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab4b57-7cea-4476-baf5-28b94a0027d6 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:04.727672 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ba645191-27f5-46b0-a8bf-09347c240190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5efcb797d0445dfb364957e3a3d8708'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:04.728267 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0024a-ce46-42fb-a517-d5b51a36005c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:04.729687 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0024a-ce46-42fb-a517-d5b51a36005c admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:04.730718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0024a-ce46-42fb-a517-d5b51a36005c admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:04.731894 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0024a-ce46-42fb-a517-d5b51a36005c admin admin] PATH_INFO: `/v3/projects/47eceea474774665a1c4429466dadfd8/users/135e59d1a0134ef1887224bb86701071/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:04.747707 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ba645191-27f5-46b0-a8bf-09347c240190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5efcb797d0445dfb364957e3a3d8708'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:04.783293 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0024a-ce46-42fb-a517-d5b51a36005c admin admin] RBAC: Authorizing `identity:create_grant(project_id=47eceea474774665a1c4429466dadfd8, user_id=135e59d1a0134ef1887224bb86701071, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:04.786576 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0024a-ce46-42fb-a517-d5b51a36005c admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:04.799269 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ba645191-27f5-46b0-a8bf-09347c240190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5efcb797d0445dfb364957e3a3d8708'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:04.808071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1134/2254] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:04:04 2022] DELETE /identity/v3/users/d5efcb797d0445dfb364957e3a3d8708 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:04:04.812535 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9beedc7-b787-4f88-9e75-c2f0aa5ebf5a None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:04.813098 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9beedc7-b787-4f88-9e75-c2f0aa5ebf5a None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:04.814082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9beedc7-b787-4f88-9e75-c2f0aa5ebf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:04.848516 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-d9beedc7-b787-4f88-9e75-c2f0aa5ebf5a None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:04.850387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d9beedc7-b787-4f88-9e75-c2f0aa5ebf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:04.952106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1135/2255] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:04.986031 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9beedc7-b787-4f88-9e75-c2f0aa5ebf5a None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:04.989153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d9beedc7-b787-4f88-9e75-c2f0aa5ebf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:05.003931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1121/2256] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:04:04 2022] PUT /identity/v3/projects/47eceea474774665a1c4429466dadfd8/users/135e59d1a0134ef1887224bb86701071/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:04:05.010481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0faba-c300-4e96-be3f-b3f92946e485 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:05.010770 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0faba-c300-4e96-be3f-b3f92946e485 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:05.011055 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0faba-c300-4e96-be3f-b3f92946e485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:05.088941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-bba0faba-c300-4e96-be3f-b3f92946e485 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:05.089681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-bba0faba-c300-4e96-be3f-b3f92946e485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:05.132843 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9beedc7-b787-4f88-9e75-c2f0aa5ebf5a None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:05.240351 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e75a8c-cf1a-45c4-b637-e12b7afc418e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:05.241007 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e75a8c-cf1a-45c4-b637-e12b7afc418e service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:05.241288 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e75a8c-cf1a-45c4-b637-e12b7afc418e service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:05.241560 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e75a8c-cf1a-45c4-b637-e12b7afc418e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:05.317541 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1122/2257] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:05.404371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0faba-c300-4e96-be3f-b3f92946e485 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:05.415122 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-bba0faba-c300-4e96-be3f-b3f92946e485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:05.457767 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0faba-c300-4e96-be3f-b3f92946e485 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:05.471196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16023630-70f3-4111-879a-85927abbdf6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:05.472306 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16023630-70f3-4111-879a-85927abbdf6e service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:05.472884 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16023630-70f3-4111-879a-85927abbdf6e service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:05.473198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16023630-70f3-4111-879a-85927abbdf6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:05.477067 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e75a8c-cf1a-45c4-b637-e12b7afc418e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:05.478765 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e75a8c-cf1a-45c4-b637-e12b7afc418e service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:05.498870 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:05.499836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1136/2258] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:04:05.506255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16023630-70f3-4111-879a-85927abbdf6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:05.508011 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16023630-70f3-4111-879a-85927abbdf6e service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:05.572986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1123/2259] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:04:05.748186 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:06.481581 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e75a8c-cf1a-45c4-b637-e12b7afc418e service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:06.483420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b1e75a8c-cf1a-45c4-b637-e12b7afc418e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:06.503086 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e75a8c-cf1a-45c4-b637-e12b7afc418e service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:06.504198 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9a518-18a1-421c-8671-3f3579446309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:06.505307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9a518-18a1-421c-8671-3f3579446309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:06.505744 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9a518-18a1-421c-8671-3f3579446309 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:06.506161 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9a518-18a1-421c-8671-3f3579446309 admin admin] PATH_INFO: `/v3/projects/b73ced5043e64c2eba10899f9ca7edac` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:06.507854 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9a518-18a1-421c-8671-3f3579446309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b73ced5043e64c2eba10899f9ca7edac)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:06.509956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9a518-18a1-421c-8671-3f3579446309 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:06.686955 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4ae9a518-18a1-421c-8671-3f3579446309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b73ced5043e64c2eba10899f9ca7edac', 'request_id': 'req-4ae9a518-18a1-421c-8671-3f3579446309'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:06.836238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4ae9a518-18a1-421c-8671-3f3579446309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b73ced5043e64c2eba10899f9ca7edac', 'request_id': 'req-4ae9a518-18a1-421c-8671-3f3579446309'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:06.847498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4ae9a518-18a1-421c-8671-3f3579446309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b73ced5043e64c2eba10899f9ca7edac', 'request_id': 'req-4ae9a518-18a1-421c-8671-3f3579446309'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:06.860469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4ae9a518-18a1-421c-8671-3f3579446309 admin admin] The token cache is being invalidate because project b73ced5043e64c2eba10899f9ca7edac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:04:06.860999 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4ae9a518-18a1-421c-8671-3f3579446309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:06.862408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4ae9a518-18a1-421c-8671-3f3579446309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:06.869023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1137/2260] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:04:06 2022] DELETE /identity/v3/projects/b73ced5043e64c2eba10899f9ca7edac => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:04:06.874283 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f057cfe-f386-4a29-add6-fe9cca84b76f None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:06.874815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f057cfe-f386-4a29-add6-fe9cca84b76f None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:06.874923 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f057cfe-f386-4a29-add6-fe9cca84b76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:06.897786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-9f057cfe-f386-4a29-add6-fe9cca84b76f None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:06.898937 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9f057cfe-f386-4a29-add6-fe9cca84b76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:06.977185 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1124/2261] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:06.978626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7ac32-4ba0-4697-9af5-d26eb9ad665c None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:06.978626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7ac32-4ba0-4697-9af5-d26eb9ad665c None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:06.978824 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7ac32-4ba0-4697-9af5-d26eb9ad665c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:07.024648 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-84a7ac32-4ba0-4697-9af5-d26eb9ad665c None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:07.028194 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-84a7ac32-4ba0-4697-9af5-d26eb9ad665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:07.050993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f057cfe-f386-4a29-add6-fe9cca84b76f None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:07.051990 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1138/2262] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:07.064986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f057cfe-f386-4a29-add6-fe9cca84b76f None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:07.073473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30456daa-ac3d-4ea2-a9de-6ff197bf7a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:07.073473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30456daa-ac3d-4ea2-a9de-6ff197bf7a9a admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:07.073837 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30456daa-ac3d-4ea2-a9de-6ff197bf7a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:07.074325 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30456daa-ac3d-4ea2-a9de-6ff197bf7a9a admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:07.076360 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30456daa-ac3d-4ea2-a9de-6ff197bf7a9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:04:07.077078 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30456daa-ac3d-4ea2-a9de-6ff197bf7a9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:07.081741 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30456daa-ac3d-4ea2-a9de-6ff197bf7a9a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:07.095356 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1125/2263] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 04:04:07.103471 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7ac32-4ba0-4697-9af5-d26eb9ad665c None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:07.110699 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7ac32-4ba0-4697-9af5-d26eb9ad665c None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:07.115774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3561eb-ed6c-424f-a1d8-b6f181c3c555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:07.116959 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3561eb-ed6c-424f-a1d8-b6f181c3c555 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:07.117338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3561eb-ed6c-424f-a1d8-b6f181c3c555 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:07.117762 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3561eb-ed6c-424f-a1d8-b6f181c3c555 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:07.118596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3561eb-ed6c-424f-a1d8-b6f181c3c555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:07.120929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3561eb-ed6c-424f-a1d8-b6f181c3c555 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:07.364058 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1139/2264] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:04:07 2022] POST /identity/v3/projects => generated 385 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:04:07.368586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30456daa-ac3d-4ea2-a9de-6ff197bf7a9a admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:07.386946 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30456daa-ac3d-4ea2-a9de-6ff197bf7a9a admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:07.426114 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:07.509641 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24256c-3ac8-47f2-9187-50f9c1d68ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:07.510517 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24256c-3ac8-47f2-9187-50f9c1d68ebf admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:07.511015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24256c-3ac8-47f2-9187-50f9c1d68ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:07.511740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24256c-3ac8-47f2-9187-50f9c1d68ebf admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:07.512832 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24256c-3ac8-47f2-9187-50f9c1d68ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:07.516484 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24256c-3ac8-47f2-9187-50f9c1d68ebf admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:07.622548 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1126/2265] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:04:07 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:04:07.627264 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3561eb-ed6c-424f-a1d8-b6f181c3c555 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:07.639550 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3561eb-ed6c-424f-a1d8-b6f181c3c555 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:07.645548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0903b-3cb0-49ab-8b37-af2ede0baff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:07.646206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0903b-3cb0-49ab-8b37-af2ede0baff5 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:07.646484 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0903b-3cb0-49ab-8b37-af2ede0baff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:07.646755 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0903b-3cb0-49ab-8b37-af2ede0baff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:07.647537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0903b-3cb0-49ab-8b37-af2ede0baff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:07.649189 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0903b-3cb0-49ab-8b37-af2ede0baff5 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:07.660498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1140/2266] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:04:07.664873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24256c-3ac8-47f2-9187-50f9c1d68ebf admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:07.675665 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24256c-3ac8-47f2-9187-50f9c1d68ebf admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:07.680243 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a23747-7272-4824-852a-381dfc768d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:07.680865 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a23747-7272-4824-852a-381dfc768d30 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:07.681147 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a23747-7272-4824-852a-381dfc768d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:07.681422 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a23747-7272-4824-852a-381dfc768d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:07.682125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a23747-7272-4824-852a-381dfc768d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:07.683990 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a23747-7272-4824-852a-381dfc768d30 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:07.694855 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1127/2267] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:04:07.699197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0903b-3cb0-49ab-8b37-af2ede0baff5 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:07.709927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0903b-3cb0-49ab-8b37-af2ede0baff5 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:07.714839 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653c06c-2a5a-409f-998f-33a62a0ade05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:07.715981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653c06c-2a5a-409f-998f-33a62a0ade05 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:07.715981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653c06c-2a5a-409f-998f-33a62a0ade05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:07.716125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653c06c-2a5a-409f-998f-33a62a0ade05 admin admin] PATH_INFO: `/v3/projects/f1328643d49046db89a4efa1bf477bbc/users/114bcf2b59274aeab5f5deee67527cc0/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:07.732635 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653c06c-2a5a-409f-998f-33a62a0ade05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1328643d49046db89a4efa1bf477bbc, user_id=114bcf2b59274aeab5f5deee67527cc0, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:07.735395 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653c06c-2a5a-409f-998f-33a62a0ade05 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:07.835466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1141/2268] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:04:07 2022] PUT /identity/v3/projects/f1328643d49046db89a4efa1bf477bbc/users/114bcf2b59274aeab5f5deee67527cc0/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:04:07.840647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacedd1-36b3-4c2f-821c-3deb6e58a5a8 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:07.841205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacedd1-36b3-4c2f-821c-3deb6e58a5a8 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:07.841754 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacedd1-36b3-4c2f-821c-3deb6e58a5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:07.866221 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-ccacedd1-36b3-4c2f-821c-3deb6e58a5a8 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:07.867677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ccacedd1-36b3-4c2f-821c-3deb6e58a5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:07.892522 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=85,keystone:INSERT=8,keystone:DELETE=7 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:07.948015 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0867bc-2546-43ec-9544-707a3fcf6a7d None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:07.948617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0867bc-2546-43ec-9544-707a3fcf6a7d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:07.953736 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0867bc-2546-43ec-9544-707a3fcf6a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:07.953872 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1128/2269] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:04:07.966304 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccacedd1-36b3-4c2f-821c-3deb6e58a5a8 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:07.968076 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ccacedd1-36b3-4c2f-821c-3deb6e58a5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:07.987663 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-8d0867bc-2546-43ec-9544-707a3fcf6a7d None None] MFA Rules not processed for user `135e59d1a0134ef1887224bb86701071`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:07.989027 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-8d0867bc-2546-43ec-9544-707a3fcf6a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:08.037003 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccacedd1-36b3-4c2f-821c-3deb6e58a5a8 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:08.041727 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135d8ad-c9ca-4265-8d67-0b1d8b0bbb04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:08.042428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135d8ad-c9ca-4265-8d67-0b1d8b0bbb04 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:08.042854 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135d8ad-c9ca-4265-8d67-0b1d8b0bbb04 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:08.043313 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135d8ad-c9ca-4265-8d67-0b1d8b0bbb04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:08.055431 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135d8ad-c9ca-4265-8d67-0b1d8b0bbb04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:08.056895 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135d8ad-c9ca-4265-8d67-0b1d8b0bbb04 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:08.067183 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1142/2270] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:04:08.069346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1129/2271] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:04:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:04:08.078006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0867bc-2546-43ec-9544-707a3fcf6a7d None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:08.080137 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-8d0867bc-2546-43ec-9544-707a3fcf6a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:08.141060 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0867bc-2546-43ec-9544-707a3fcf6a7d None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:08.146042 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a773e29-f088-4447-a51d-f8803ef41ae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:08.147002 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a773e29-f088-4447-a51d-f8803ef41ae6 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:08.147002 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a773e29-f088-4447-a51d-f8803ef41ae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:08.147248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a773e29-f088-4447-a51d-f8803ef41ae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:08.156562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a773e29-f088-4447-a51d-f8803ef41ae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:08.158620 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a773e29-f088-4447-a51d-f8803ef41ae6 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:08.169506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1143/2272] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:04:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:04:09.502374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:10.151667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135d8ad-c9ca-4265-8d67-0b1d8b0bbb04 service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:10.155066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-6135d8ad-c9ca-4265-8d67-0b1d8b0bbb04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:10.171489 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135d8ad-c9ca-4265-8d67-0b1d8b0bbb04 service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:10.179766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2193c-9fa3-4c3a-b275-72a8ecae3b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:10.180588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2193c-9fa3-4c3a-b275-72a8ecae3b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:10.180878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2193c-9fa3-4c3a-b275-72a8ecae3b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:10.181161 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2193c-9fa3-4c3a-b275-72a8ecae3b33 admin admin] PATH_INFO: `/v3/users/989e7599b8534f2eadc51f9ac3604ad0` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:10.182761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2193c-9fa3-4c3a-b275-72a8ecae3b33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=989e7599b8534f2eadc51f9ac3604ad0)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:10.185132 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2193c-9fa3-4c3a-b275-72a8ecae3b33 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:10.279701 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4360-e257-4de9-98ba-3672d7159c0e None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:10.279997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4360-e257-4de9-98ba-3672d7159c0e None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:10.280281 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4360-e257-4de9-98ba-3672d7159c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:10.300167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-6c4d4360-e257-4de9-98ba-3672d7159c0e None None] MFA Rules not processed for user `135e59d1a0134ef1887224bb86701071`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:10.301390 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-6c4d4360-e257-4de9-98ba-3672d7159c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:10.310612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1144/2273] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:04:10.450809 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-46f2193c-9fa3-4c3a-b275-72a8ecae3b33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989e7599b8534f2eadc51f9ac3604ad0'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:10.452231 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-46f2193c-9fa3-4c3a-b275-72a8ecae3b33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989e7599b8534f2eadc51f9ac3604ad0'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:10.569829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-46f2193c-9fa3-4c3a-b275-72a8ecae3b33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989e7599b8534f2eadc51f9ac3604ad0'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:10.580725 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-46f2193c-9fa3-4c3a-b275-72a8ecae3b33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989e7599b8534f2eadc51f9ac3604ad0'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:10.611025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-46f2193c-9fa3-4c3a-b275-72a8ecae3b33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989e7599b8534f2eadc51f9ac3604ad0'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:10.625478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86b670-382f-4332-8f72-db9eae370982 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:10.627106 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86b670-382f-4332-8f72-db9eae370982 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:10.627729 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86b670-382f-4332-8f72-db9eae370982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:10.631221 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1130/2274] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:04:10 2022] DELETE /identity/v3/users/989e7599b8534f2eadc51f9ac3604ad0 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:04:10.652253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-cd86b670-382f-4332-8f72-db9eae370982 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:10.654034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-cd86b670-382f-4332-8f72-db9eae370982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:10.744538 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1145/2275] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:10.770356 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2193c-9fa3-4c3a-b275-72a8ecae3b33 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:10.772454 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-46f2193c-9fa3-4c3a-b275-72a8ecae3b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:10.910645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2193c-9fa3-4c3a-b275-72a8ecae3b33 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:10.915980 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5c513-4c10-4f19-9840-ced013de3221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:10.916864 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5c513-4c10-4f19-9840-ced013de3221 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:10.919724 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5c513-4c10-4f19-9840-ced013de3221 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:10.919724 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5c513-4c10-4f19-9840-ced013de3221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:10.930700 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5c513-4c10-4f19-9840-ced013de3221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:10.932960 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5c513-4c10-4f19-9840-ced013de3221 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:10.948416 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1131/2276] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:04:11.540532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86b670-382f-4332-8f72-db9eae370982 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:11.542009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-cd86b670-382f-4332-8f72-db9eae370982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:11.563011 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86b670-382f-4332-8f72-db9eae370982 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:11.585819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2440162-6e91-43e9-a5a7-026ae54eec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:11.587673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440162-6e91-43e9-a5a7-026ae54eec4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:11.588253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440162-6e91-43e9-a5a7-026ae54eec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:11.588534 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440162-6e91-43e9-a5a7-026ae54eec4a admin admin] PATH_INFO: `/v3/users/f7e1a2aea8c44771aab6517c31e7596e` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:11.591483 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2440162-6e91-43e9-a5a7-026ae54eec4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e1a2aea8c44771aab6517c31e7596e)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:11.596523 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2440162-6e91-43e9-a5a7-026ae54eec4a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:11.953835 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-e2440162-6e91-43e9-a5a7-026ae54eec4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e1a2aea8c44771aab6517c31e7596e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:11.956284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-e2440162-6e91-43e9-a5a7-026ae54eec4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e1a2aea8c44771aab6517c31e7596e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:12.042314 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-e2440162-6e91-43e9-a5a7-026ae54eec4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e1a2aea8c44771aab6517c31e7596e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:12.070241 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-e2440162-6e91-43e9-a5a7-026ae54eec4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e1a2aea8c44771aab6517c31e7596e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:12.086681 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-e2440162-6e91-43e9-a5a7-026ae54eec4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e1a2aea8c44771aab6517c31e7596e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:12.104948 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1146/2277] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:04:11 2022] DELETE /identity/v3/users/f7e1a2aea8c44771aab6517c31e7596e => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:04:12.110670 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50a684-5e75-4e66-b42f-4134f2273813 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:12.111239 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50a684-5e75-4e66-b42f-4134f2273813 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:12.111694 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50a684-5e75-4e66-b42f-4134f2273813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:12.157708 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-6c50a684-5e75-4e66-b42f-4134f2273813 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:12.163345 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2440162-6e91-43e9-a5a7-026ae54eec4a admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:12.165127 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e2440162-6e91-43e9-a5a7-026ae54eec4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:12.166171 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-6c50a684-5e75-4e66-b42f-4134f2273813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:12.323487 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1132/2278] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:12.332718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50a684-5e75-4e66-b42f-4134f2273813 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:12.334308 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-6c50a684-5e75-4e66-b42f-4134f2273813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:12.350421 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2440162-6e91-43e9-a5a7-026ae54eec4a admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:12.356879 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194de5e6-8740-4e07-af0b-b8d551f30596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:12.357646 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194de5e6-8740-4e07-af0b-b8d551f30596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:12.358047 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194de5e6-8740-4e07-af0b-b8d551f30596 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:12.358407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194de5e6-8740-4e07-af0b-b8d551f30596 admin admin] PATH_INFO: `/v3/projects/fefdefb2c1bb43c2a9d202d402f2c390` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:12.359862 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194de5e6-8740-4e07-af0b-b8d551f30596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fefdefb2c1bb43c2a9d202d402f2c390)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:12.362569 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194de5e6-8740-4e07-af0b-b8d551f30596 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:12.381416 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:12.450633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50a684-5e75-4e66-b42f-4134f2273813 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:12.455797 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a3d21-b085-4267-b091-7fff09b9589c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:12.456698 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a3d21-b085-4267-b091-7fff09b9589c service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:12.457091 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a3d21-b085-4267-b091-7fff09b9589c service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:12.457377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a3d21-b085-4267-b091-7fff09b9589c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:12.468455 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a3d21-b085-4267-b091-7fff09b9589c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:12.470089 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a3d21-b085-4267-b091-7fff09b9589c service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:12.481405 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1133/2279] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:04:12.547298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-194de5e6-8740-4e07-af0b-b8d551f30596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fefdefb2c1bb43c2a9d202d402f2c390', 'request_id': 'req-194de5e6-8740-4e07-af0b-b8d551f30596'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:12.611700 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-194de5e6-8740-4e07-af0b-b8d551f30596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fefdefb2c1bb43c2a9d202d402f2c390', 'request_id': 'req-194de5e6-8740-4e07-af0b-b8d551f30596'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:12.624848 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-194de5e6-8740-4e07-af0b-b8d551f30596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fefdefb2c1bb43c2a9d202d402f2c390', 'request_id': 'req-194de5e6-8740-4e07-af0b-b8d551f30596'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:12.648279 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-194de5e6-8740-4e07-af0b-b8d551f30596 admin admin] The token cache is being invalidate because project fefdefb2c1bb43c2a9d202d402f2c390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:04:12.648776 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-194de5e6-8740-4e07-af0b-b8d551f30596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:12.649645 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-194de5e6-8740-4e07-af0b-b8d551f30596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:12.651977 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1147/2280] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:04:12 2022] DELETE /identity/v3/projects/fefdefb2c1bb43c2a9d202d402f2c390 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:04:12.656545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:12.656902 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f965156-950f-4a75-b99a-c252b16befb8 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:12.657239 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f965156-950f-4a75-b99a-c252b16befb8 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:12.657761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f965156-950f-4a75-b99a-c252b16befb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:12.683266 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-8f965156-950f-4a75-b99a-c252b16befb8 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:12.684542 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-8f965156-950f-4a75-b99a-c252b16befb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:12.770469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1134/2281] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:12.784114 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afc342-e2f9-48fd-bbfc-afa6b80b9dc9 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:12.786323 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afc342-e2f9-48fd-bbfc-afa6b80b9dc9 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:12.786725 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afc342-e2f9-48fd-bbfc-afa6b80b9dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:12.818454 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-e4afc342-e2f9-48fd-bbfc-afa6b80b9dc9 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:12.820543 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e4afc342-e2f9-48fd-bbfc-afa6b80b9dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:12.833949 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1148/2282] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:12.838613 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f965156-950f-4a75-b99a-c252b16befb8 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:12.849990 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f965156-950f-4a75-b99a-c252b16befb8 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:12.863987 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a497191-0857-4189-8860-98675bd9b33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:12.869056 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a497191-0857-4189-8860-98675bd9b33f admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:12.869530 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a497191-0857-4189-8860-98675bd9b33f admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:12.869820 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a497191-0857-4189-8860-98675bd9b33f admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:12.870577 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a497191-0857-4189-8860-98675bd9b33f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:04:12.870962 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a497191-0857-4189-8860-98675bd9b33f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:12.874297 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a497191-0857-4189-8860-98675bd9b33f admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:12.911090 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1135/2283] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:04:12.920210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afc342-e2f9-48fd-bbfc-afa6b80b9dc9 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:12.934276 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afc342-e2f9-48fd-bbfc-afa6b80b9dc9 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:12.941653 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5e31a-fdd5-4e21-b622-bb029c726adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:12.942869 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5e31a-fdd5-4e21-b622-bb029c726adc admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:12.942869 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5e31a-fdd5-4e21-b622-bb029c726adc admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:12.942869 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5e31a-fdd5-4e21-b622-bb029c726adc admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:12.945226 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5e31a-fdd5-4e21-b622-bb029c726adc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:12.945636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5e31a-fdd5-4e21-b622-bb029c726adc admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:13.099385 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1149/2284] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:04:12 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:04:13.101027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a497191-0857-4189-8860-98675bd9b33f admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:13.115296 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a497191-0857-4189-8860-98675bd9b33f admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:13.224188 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5e31a-fdd5-4e21-b622-bb029c726adc admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:13.228584 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-aea5e31a-fdd5-4e21-b622-bb029c726adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:13.261345 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f872c-0c80-4eb2-a28d-d85083dae94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:13.266124 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f872c-0c80-4eb2-a28d-d85083dae94a admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:13.268437 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f872c-0c80-4eb2-a28d-d85083dae94a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:13.269851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f872c-0c80-4eb2-a28d-d85083dae94a admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:13.272903 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f872c-0c80-4eb2-a28d-d85083dae94a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:13.278175 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f872c-0c80-4eb2-a28d-d85083dae94a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:13.368084 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5e31a-fdd5-4e21-b622-bb029c726adc admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:13.373880 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4e101-26eb-4e5f-a59f-d26e3fef0274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:13.374674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4e101-26eb-4e5f-a59f-d26e3fef0274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:13.375024 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4e101-26eb-4e5f-a59f-d26e3fef0274 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:13.375778 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4e101-26eb-4e5f-a59f-d26e3fef0274 admin admin] PATH_INFO: `/v3/projects/c9a39cb0de484493b97b9bb320f6a804` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:13.378757 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4e101-26eb-4e5f-a59f-d26e3fef0274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9a39cb0de484493b97b9bb320f6a804)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:13.381567 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4e101-26eb-4e5f-a59f-d26e3fef0274 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:13.398033 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1136/2285] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:04:13 2022] POST /identity/v3/users => generated 292 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:04:13.401558 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f872c-0c80-4eb2-a28d-d85083dae94a admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:13.442182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f872c-0c80-4eb2-a28d-d85083dae94a admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:13.453240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb32ea7-cf26-49fb-b9dc-bc3939cad9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:13.458851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb32ea7-cf26-49fb-b9dc-bc3939cad9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:13.459248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb32ea7-cf26-49fb-b9dc-bc3939cad9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:13.459981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb32ea7-cf26-49fb-b9dc-bc3939cad9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:13.461465 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb32ea7-cf26-49fb-b9dc-bc3939cad9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:13.469634 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb32ea7-cf26-49fb-b9dc-bc3939cad9a3 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:13.513595 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1137/2286] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:04:13.514792 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb32ea7-cf26-49fb-b9dc-bc3939cad9a3 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:13.529072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb32ea7-cf26-49fb-b9dc-bc3939cad9a3 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:13.535514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7d2cf-144b-4abb-b8fc-c019d3180593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:13.536454 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7d2cf-144b-4abb-b8fc-c019d3180593 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:13.537138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7d2cf-144b-4abb-b8fc-c019d3180593 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:13.537766 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7d2cf-144b-4abb-b8fc-c019d3180593 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:13.538795 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7d2cf-144b-4abb-b8fc-c019d3180593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:13.540661 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7d2cf-144b-4abb-b8fc-c019d3180593 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:13.557488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1138/2287] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:04:13.559042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7d2cf-144b-4abb-b8fc-c019d3180593 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:13.573872 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7d2cf-144b-4abb-b8fc-c019d3180593 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:13.581191 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105d834-f207-48d6-b043-3903c3693ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:13.581955 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105d834-f207-48d6-b043-3903c3693ec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:13.582244 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105d834-f207-48d6-b043-3903c3693ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:13.582524 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105d834-f207-48d6-b043-3903c3693ec6 admin admin] PATH_INFO: `/v3/projects/fde782ca362f48389124c4b39dac53ee/users/99264a023d9946e28b470d6c692e62ea/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:13.615371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105d834-f207-48d6-b043-3903c3693ec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde782ca362f48389124c4b39dac53ee, user_id=99264a023d9946e28b470d6c692e62ea, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:13.618941 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105d834-f207-48d6-b043-3903c3693ec6 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:13.631700 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d8d4e101-26eb-4e5f-a59f-d26e3fef0274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9a39cb0de484493b97b9bb320f6a804', 'request_id': 'req-d8d4e101-26eb-4e5f-a59f-d26e3fef0274'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:13.756543 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1139/2288] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:04:13 2022] PUT /identity/v3/projects/fde782ca362f48389124c4b39dac53ee/users/99264a023d9946e28b470d6c692e62ea/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:04:13.761984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131e59e-b6f8-4512-ae49-f32973cb47ec None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:13.762417 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131e59e-b6f8-4512-ae49-f32973cb47ec None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:13.762705 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131e59e-b6f8-4512-ae49-f32973cb47ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:13.800441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d8d4e101-26eb-4e5f-a59f-d26e3fef0274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9a39cb0de484493b97b9bb320f6a804', 'request_id': 'req-d8d4e101-26eb-4e5f-a59f-d26e3fef0274'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:13.804136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-8131e59e-b6f8-4512-ae49-f32973cb47ec None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:13.809401 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-8131e59e-b6f8-4512-ae49-f32973cb47ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:13.815529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d8d4e101-26eb-4e5f-a59f-d26e3fef0274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9a39cb0de484493b97b9bb320f6a804', 'request_id': 'req-d8d4e101-26eb-4e5f-a59f-d26e3fef0274'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:13.845388 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d8d4e101-26eb-4e5f-a59f-d26e3fef0274 admin admin] The token cache is being invalidate because project c9a39cb0de484493b97b9bb320f6a804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:04:13.845810 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d8d4e101-26eb-4e5f-a59f-d26e3fef0274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:13.847856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-d8d4e101-26eb-4e5f-a59f-d26e3fef0274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:13.849918 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1150/2289] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:04:13 2022] DELETE /identity/v3/projects/c9a39cb0de484493b97b9bb320f6a804 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:04:13.855206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4e101-26eb-4e5f-a59f-d26e3fef0274 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:13.865046 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d8d4e101-26eb-4e5f-a59f-d26e3fef0274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:13.903979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1140/2290] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:04:13.916192 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131e59e-b6f8-4512-ae49-f32973cb47ec None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:13.918396 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-8131e59e-b6f8-4512-ae49-f32973cb47ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:14.002647 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4e101-26eb-4e5f-a59f-d26e3fef0274 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:14.004928 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131e59e-b6f8-4512-ae49-f32973cb47ec None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:14.009995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1394d8f-b33b-45d8-9ac1-956d350e0bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:14.014820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1394d8f-b33b-45d8-9ac1-956d350e0bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:14.014820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1394d8f-b33b-45d8-9ac1-956d350e0bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:14.014820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1394d8f-b33b-45d8-9ac1-956d350e0bdd admin admin] PATH_INFO: `/v3/users/7080f460bdd74d8ab108edfd37cd72b1` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:14.014820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1394d8f-b33b-45d8-9ac1-956d350e0bdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7080f460bdd74d8ab108edfd37cd72b1)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:14.015779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1394d8f-b33b-45d8-9ac1-956d350e0bdd admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:14.030323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f68994-f7b7-4fc1-b0f2-fc73396e8826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:14.032206 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f68994-f7b7-4fc1-b0f2-fc73396e8826 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:14.033031 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f68994-f7b7-4fc1-b0f2-fc73396e8826 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:14.033282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f68994-f7b7-4fc1-b0f2-fc73396e8826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:14.052211 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f68994-f7b7-4fc1-b0f2-fc73396e8826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:14.058750 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f68994-f7b7-4fc1-b0f2-fc73396e8826 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:14.078426 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1141/2291] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:04:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:04:14.170086 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:14.323376 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b1394d8f-b33b-45d8-9ac1-956d350e0bdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7080f460bdd74d8ab108edfd37cd72b1'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:14.326153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b1394d8f-b33b-45d8-9ac1-956d350e0bdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7080f460bdd74d8ab108edfd37cd72b1'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:14.416094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b1394d8f-b33b-45d8-9ac1-956d350e0bdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7080f460bdd74d8ab108edfd37cd72b1'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:14.448238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b1394d8f-b33b-45d8-9ac1-956d350e0bdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7080f460bdd74d8ab108edfd37cd72b1'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:14.479706 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b1394d8f-b33b-45d8-9ac1-956d350e0bdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7080f460bdd74d8ab108edfd37cd72b1'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:14.494561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1151/2292] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:04:13 2022] DELETE /identity/v3/users/7080f460bdd74d8ab108edfd37cd72b1 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:04:15.253217 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d7e8f-67c1-4a25-a029-98dc6c972197 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:15.253752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d7e8f-67c1-4a25-a029-98dc6c972197 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:15.253752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d7e8f-67c1-4a25-a029-98dc6c972197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:15.278630 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-2d5d7e8f-67c1-4a25-a029-98dc6c972197 None None] MFA Rules not processed for user `420e2a81b66a470e8db624efd61fd1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:15.280378 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-2d5d7e8f-67c1-4a25-a029-98dc6c972197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:15.314143 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:15.442232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1142/2293] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 28 04:04:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:04:15.516197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1394d8f-b33b-45d8-9ac1-956d350e0bdd admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:15.535030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b1394d8f-b33b-45d8-9ac1-956d350e0bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:15.638039 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1394d8f-b33b-45d8-9ac1-956d350e0bdd admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:15.638039 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e3377-4308-44c7-893f-fecef64a2d3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382ff6087bf4486d8651162880825eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:15.638039 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e3377-4308-44c7-893f-fecef64a2d3f service swift] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:15.638039 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e3377-4308-44c7-893f-fecef64a2d3f service swift] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:15.638367 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e3377-4308-44c7-893f-fecef64a2d3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:15.644282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e3377-4308-44c7-893f-fecef64a2d3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:15.646248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e3377-4308-44c7-893f-fecef64a2d3f service swift] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:15.680420 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d7e8f-67c1-4a25-a029-98dc6c972197 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:15.682238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-2d5d7e8f-67c1-4a25-a029-98dc6c972197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:15.684749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1152/2294] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 28 04:04:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 04:04:15.841138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d7e8f-67c1-4a25-a029-98dc6c972197 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:15.854904 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aed2a5-a99d-4c79-94ab-e4d1dc97ec5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:15.855355 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aed2a5-a99d-4c79-94ab-e4d1dc97ec5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:15.856086 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aed2a5-a99d-4c79-94ab-e4d1dc97ec5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:15.856489 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aed2a5-a99d-4c79-94ab-e4d1dc97ec5f admin admin] PATH_INFO: `/v3/projects/50d01cd0a3b14622b78e5e81be34e4ee` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:15.857924 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aed2a5-a99d-4c79-94ab-e4d1dc97ec5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=50d01cd0a3b14622b78e5e81be34e4ee)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:15.860125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aed2a5-a99d-4c79-94ab-e4d1dc97ec5f admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:15.962758 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:16.042037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b0aed2a5-a99d-4c79-94ab-e4d1dc97ec5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50d01cd0a3b14622b78e5e81be34e4ee', 'request_id': 'req-b0aed2a5-a99d-4c79-94ab-e4d1dc97ec5f'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:16.060731 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b0aed2a5-a99d-4c79-94ab-e4d1dc97ec5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50d01cd0a3b14622b78e5e81be34e4ee', 'request_id': 'req-b0aed2a5-a99d-4c79-94ab-e4d1dc97ec5f'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:16.070309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b0aed2a5-a99d-4c79-94ab-e4d1dc97ec5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50d01cd0a3b14622b78e5e81be34e4ee', 'request_id': 'req-b0aed2a5-a99d-4c79-94ab-e4d1dc97ec5f'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:16.171307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b0aed2a5-a99d-4c79-94ab-e4d1dc97ec5f admin admin] The token cache is being invalidate because project 50d01cd0a3b14622b78e5e81be34e4ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:04:16.171767 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b0aed2a5-a99d-4c79-94ab-e4d1dc97ec5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:16.172857 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b0aed2a5-a99d-4c79-94ab-e4d1dc97ec5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:16.180634 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1143/2295] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:04:15 2022] DELETE /identity/v3/projects/50d01cd0a3b14622b78e5e81be34e4ee => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:04:16.182208 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0fe92-b3ea-4e6f-9627-776aae4eeff3 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:16.182505 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0fe92-b3ea-4e6f-9627-776aae4eeff3 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:16.182788 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0fe92-b3ea-4e6f-9627-776aae4eeff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:16.247262 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-67e0fe92-b3ea-4e6f-9627-776aae4eeff3 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:16.251813 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-67e0fe92-b3ea-4e6f-9627-776aae4eeff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:16.396752 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1153/2296] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:16.405784 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb365a81-29e7-4e1b-9ec6-7482a4fe54bd None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:16.406358 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb365a81-29e7-4e1b-9ec6-7482a4fe54bd None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:16.406560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb365a81-29e7-4e1b-9ec6-7482a4fe54bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:16.469263 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-cb365a81-29e7-4e1b-9ec6-7482a4fe54bd None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:16.477242 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-cb365a81-29e7-4e1b-9ec6-7482a4fe54bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:16.498721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1144/2297] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:16.503739 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0fe92-b3ea-4e6f-9627-776aae4eeff3 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:16.514281 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0fe92-b3ea-4e6f-9627-776aae4eeff3 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:16.536566 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14251148-d4dd-4509-8aac-57184ef1d9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:16.537237 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14251148-d4dd-4509-8aac-57184ef1d9fa admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:16.537493 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14251148-d4dd-4509-8aac-57184ef1d9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:16.537770 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14251148-d4dd-4509-8aac-57184ef1d9fa admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:16.538553 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14251148-d4dd-4509-8aac-57184ef1d9fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:04:16.539063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14251148-d4dd-4509-8aac-57184ef1d9fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:16.540924 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14251148-d4dd-4509-8aac-57184ef1d9fa admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:16.573706 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1154/2298] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:04:16.578010 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb365a81-29e7-4e1b-9ec6-7482a4fe54bd None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:16.596979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb365a81-29e7-4e1b-9ec6-7482a4fe54bd None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:16.617006 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360bd6f-9467-446d-84ba-8c38884a6865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:16.617652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360bd6f-9467-446d-84ba-8c38884a6865 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:16.617934 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360bd6f-9467-446d-84ba-8c38884a6865 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:16.618222 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360bd6f-9467-446d-84ba-8c38884a6865 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:16.618916 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360bd6f-9467-446d-84ba-8c38884a6865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:16.621457 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360bd6f-9467-446d-84ba-8c38884a6865 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:16.826349 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1145/2299] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:04:16 2022] POST /identity/v3/projects => generated 381 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:04:16.827799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14251148-d4dd-4509-8aac-57184ef1d9fa admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:16.845444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14251148-d4dd-4509-8aac-57184ef1d9fa admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:17.046311 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e69744-8366-46ca-90d0-3c79526043c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:17.048419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e69744-8366-46ca-90d0-3c79526043c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:17.049129 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e69744-8366-46ca-90d0-3c79526043c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:17.049550 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e69744-8366-46ca-90d0-3c79526043c8 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:17.050261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e69744-8366-46ca-90d0-3c79526043c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:17.055338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e69744-8366-46ca-90d0-3c79526043c8 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:17.320805 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1155/2300] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:04:16 2022] POST /identity/v3/users => generated 291 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:04:17.321351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360bd6f-9467-446d-84ba-8c38884a6865 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:17.349600 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360bd6f-9467-446d-84ba-8c38884a6865 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:17.364483 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80732c95-7f8b-4bd1-b277-4510634e5aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:17.364749 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80732c95-7f8b-4bd1-b277-4510634e5aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:17.365137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80732c95-7f8b-4bd1-b277-4510634e5aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:17.365515 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80732c95-7f8b-4bd1-b277-4510634e5aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:17.366391 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80732c95-7f8b-4bd1-b277-4510634e5aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:17.368683 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80732c95-7f8b-4bd1-b277-4510634e5aa2 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:17.399252 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1146/2301] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:04:17.402973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e69744-8366-46ca-90d0-3c79526043c8 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:17.439877 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e69744-8366-46ca-90d0-3c79526043c8 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:17.479027 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e92242-9b50-44e1-aa35-c68745088fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:17.479027 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e92242-9b50-44e1-aa35-c68745088fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:17.479027 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e92242-9b50-44e1-aa35-c68745088fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:17.479027 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e92242-9b50-44e1-aa35-c68745088fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:17.479627 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e92242-9b50-44e1-aa35-c68745088fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:17.479627 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e92242-9b50-44e1-aa35-c68745088fc5 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:17.487631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1156/2302] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:04:17.488945 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80732c95-7f8b-4bd1-b277-4510634e5aa2 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:17.506232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80732c95-7f8b-4bd1-b277-4510634e5aa2 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:17.635407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c2274-d1af-4bfd-9124-ebb7131570c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:17.635407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c2274-d1af-4bfd-9124-ebb7131570c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:17.635407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c2274-d1af-4bfd-9124-ebb7131570c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:17.635407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c2274-d1af-4bfd-9124-ebb7131570c1 admin admin] PATH_INFO: `/v3/projects/ff4d1c44d59b4583a59c9781749b34ef/users/c94de65c25534cb5a4a51127cac7ee62/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:17.636264 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c2274-d1af-4bfd-9124-ebb7131570c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4d1c44d59b4583a59c9781749b34ef, user_id=c94de65c25534cb5a4a51127cac7ee62, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:17.636264 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c2274-d1af-4bfd-9124-ebb7131570c1 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:18.154551 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1147/2303] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:04:17 2022] PUT /identity/v3/projects/ff4d1c44d59b4583a59c9781749b34ef/users/c94de65c25534cb5a4a51127cac7ee62/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:04:18.174865 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3d897-5ace-48dd-b866-a5de91f255b1 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:18.175436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3d897-5ace-48dd-b866-a5de91f255b1 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:18.175713 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3d897-5ace-48dd-b866-a5de91f255b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:18.223509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-84b3d897-5ace-48dd-b866-a5de91f255b1 None None] MFA Rules not processed for user `c94de65c25534cb5a4a51127cac7ee62`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:18.224780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-84b3d897-5ace-48dd-b866-a5de91f255b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:18.362617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1157/2304] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:18.380287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c2274-d1af-4bfd-9124-ebb7131570c1 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:18.382461 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-728c2274-d1af-4bfd-9124-ebb7131570c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:18.567841 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c2274-d1af-4bfd-9124-ebb7131570c1 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:18.587737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f126191-6865-4b5f-be76-68c639146782 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:18.588470 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f126191-6865-4b5f-be76-68c639146782 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:18.591207 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f126191-6865-4b5f-be76-68c639146782 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:18.591207 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f126191-6865-4b5f-be76-68c639146782 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:18.628964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f126191-6865-4b5f-be76-68c639146782 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:18.630436 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f126191-6865-4b5f-be76-68c639146782 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:18.671158 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1148/2305] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:04:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:04:18.967167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf53fd-bed3-42b8-a641-5fa1a7ac7279 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:18.967499 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf53fd-bed3-42b8-a641-5fa1a7ac7279 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:18.967779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf53fd-bed3-42b8-a641-5fa1a7ac7279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:19.090870 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-9daf53fd-bed3-42b8-a641-5fa1a7ac7279 None None] MFA Rules not processed for user `99264a023d9946e28b470d6c692e62ea`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:19.097171 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9daf53fd-bed3-42b8-a641-5fa1a7ac7279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:19.136200 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:19.236344 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1158/2306] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:19.249713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f126191-6865-4b5f-be76-68c639146782 service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:19.250517 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0f126191-6865-4b5f-be76-68c639146782 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:19.277408 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f126191-6865-4b5f-be76-68c639146782 service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:19.290503 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85c268-8894-4f0f-8deb-18e864430bd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:19.291353 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85c268-8894-4f0f-8deb-18e864430bd1 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:19.291829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85c268-8894-4f0f-8deb-18e864430bd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:19.291952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85c268-8894-4f0f-8deb-18e864430bd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:19.314134 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85c268-8894-4f0f-8deb-18e864430bd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:19.317098 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85c268-8894-4f0f-8deb-18e864430bd1 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:19.344336 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1149/2307] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:04:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:04:19.450081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:20.428693 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:20.966410 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:21.802346 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc3d77-a77b-489f-adb1-68189d79a2c6 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:21.802966 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc3d77-a77b-489f-adb1-68189d79a2c6 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:21.803102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc3d77-a77b-489f-adb1-68189d79a2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:21.832447 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-95dc3d77-a77b-489f-adb1-68189d79a2c6 None None] MFA Rules not processed for user `99264a023d9946e28b470d6c692e62ea`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:21.834127 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-95dc3d77-a77b-489f-adb1-68189d79a2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:21.848745 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1159/2308] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:22.013369 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b5f46-4dee-40f3-9c03-a368b828e654 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:22.023574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b5f46-4dee-40f3-9c03-a368b828e654 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:22.023574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b5f46-4dee-40f3-9c03-a368b828e654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:22.122051 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-e30b5f46-4dee-40f3-9c03-a368b828e654 None None] MFA Rules not processed for user `114bcf2b59274aeab5f5deee67527cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:22.125437 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e30b5f46-4dee-40f3-9c03-a368b828e654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:22.333212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1150/2309] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:22.333624 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc3d77-a77b-489f-adb1-68189d79a2c6 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:22.333624 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-95dc3d77-a77b-489f-adb1-68189d79a2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:22.463397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc3d77-a77b-489f-adb1-68189d79a2c6 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:22.469744 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603c16e-30a9-44e5-81c7-6b03d97e644a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:22.470417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603c16e-30a9-44e5-81c7-6b03d97e644a admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:22.470692 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603c16e-30a9-44e5-81c7-6b03d97e644a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:22.471194 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603c16e-30a9-44e5-81c7-6b03d97e644a admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:22.472070 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603c16e-30a9-44e5-81c7-6b03d97e644a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:22.474283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603c16e-30a9-44e5-81c7-6b03d97e644a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:22.617502 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b5f46-4dee-40f3-9c03-a368b828e654 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:22.654942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b5f46-4dee-40f3-9c03-a368b828e654 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:22.664405 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56810609-5848-4d95-887b-d70910bb14b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:22.665765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56810609-5848-4d95-887b-d70910bb14b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:22.666278 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56810609-5848-4d95-887b-d70910bb14b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:22.667310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56810609-5848-4d95-887b-d70910bb14b0 admin admin] PATH_INFO: `/v3/users/c94de65c25534cb5a4a51127cac7ee62` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:22.670412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56810609-5848-4d95-887b-d70910bb14b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c94de65c25534cb5a4a51127cac7ee62)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:22.674586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56810609-5848-4d95-887b-d70910bb14b0 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:23.080978 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1160/2310] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:04:22 2022] POST /identity/v3/projects => generated 383 bytes in 774 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:04:23.085029 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603c16e-30a9-44e5-81c7-6b03d97e644a admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:23.250835 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603c16e-30a9-44e5-81c7-6b03d97e644a admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:23.258460 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171f10a-4f97-464f-9ee5-aa3df7070ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:23.259135 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171f10a-4f97-464f-9ee5-aa3df7070ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:23.259472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171f10a-4f97-464f-9ee5-aa3df7070ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:23.259735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171f10a-4f97-464f-9ee5-aa3df7070ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:23.260569 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171f10a-4f97-464f-9ee5-aa3df7070ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:23.265142 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171f10a-4f97-464f-9ee5-aa3df7070ca9 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:23.296152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-56810609-5848-4d95-887b-d70910bb14b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c94de65c25534cb5a4a51127cac7ee62'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:23.298581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-56810609-5848-4d95-887b-d70910bb14b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c94de65c25534cb5a4a51127cac7ee62'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:23.400975 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1161/2311] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:04:23 2022] POST /identity/v3/users => generated 298 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:04:23.403994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171f10a-4f97-464f-9ee5-aa3df7070ca9 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:23.414126 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f171f10a-4f97-464f-9ee5-aa3df7070ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:23.436045 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-56810609-5848-4d95-887b-d70910bb14b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c94de65c25534cb5a4a51127cac7ee62'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:23.460478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171f10a-4f97-464f-9ee5-aa3df7070ca9 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:23.475199 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-56810609-5848-4d95-887b-d70910bb14b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c94de65c25534cb5a4a51127cac7ee62'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:23.504753 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78396d17-daba-4edf-bcc4-29b5832342df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:23.505414 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78396d17-daba-4edf-bcc4-29b5832342df admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:23.505699 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78396d17-daba-4edf-bcc4-29b5832342df admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:23.505977 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78396d17-daba-4edf-bcc4-29b5832342df admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:23.506709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78396d17-daba-4edf-bcc4-29b5832342df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:23.509111 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78396d17-daba-4edf-bcc4-29b5832342df admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:23.530609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1162/2312] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:04:23.535992 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78396d17-daba-4edf-bcc4-29b5832342df admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:23.577659 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-56810609-5848-4d95-887b-d70910bb14b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c94de65c25534cb5a4a51127cac7ee62'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:23.589614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78396d17-daba-4edf-bcc4-29b5832342df admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:23.609038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1151/2313] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:04:22 2022] DELETE /identity/v3/users/c94de65c25534cb5a4a51127cac7ee62 => generated 0 bytes in 992 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:04:23.624626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805ad59-bc8f-4b66-8686-d36f1a6ebef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:23.625077 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d087e47-a806-4e22-95af-d01a596e2784 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:23.625452 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805ad59-bc8f-4b66-8686-d36f1a6ebef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:23.627344 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d087e47-a806-4e22-95af-d01a596e2784 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:23.627533 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805ad59-bc8f-4b66-8686-d36f1a6ebef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:23.627533 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805ad59-bc8f-4b66-8686-d36f1a6ebef0 admin admin] PATH_INFO: `/v3/projects/68f875d3804844d099942c5c8c033958/users/b60a5cb6664240c6b482a8ac2032f4af/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:23.628034 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d087e47-a806-4e22-95af-d01a596e2784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:23.671584 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805ad59-bc8f-4b66-8686-d36f1a6ebef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f875d3804844d099942c5c8c033958, user_id=b60a5cb6664240c6b482a8ac2032f4af, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:23.678542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805ad59-bc8f-4b66-8686-d36f1a6ebef0 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:23.725697 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-9d087e47-a806-4e22-95af-d01a596e2784 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:23.727353 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9d087e47-a806-4e22-95af-d01a596e2784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:23.889912 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1163/2314] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:04:23 2022] PUT /identity/v3/projects/68f875d3804844d099942c5c8c033958/users/b60a5cb6664240c6b482a8ac2032f4af/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:04:23.891006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805ad59-bc8f-4b66-8686-d36f1a6ebef0 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:23.921734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1152/2315] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:23.985955 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d087e47-a806-4e22-95af-d01a596e2784 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:23.987844 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9d087e47-a806-4e22-95af-d01a596e2784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:24.070206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:24.109564 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805ad59-bc8f-4b66-8686-d36f1a6ebef0 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:24.133610 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed27dfd-0e85-4523-94b8-9ffac62dfbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:24.134271 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed27dfd-0e85-4523-94b8-9ffac62dfbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:24.141172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed27dfd-0e85-4523-94b8-9ffac62dfbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:24.141172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed27dfd-0e85-4523-94b8-9ffac62dfbd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:24.141172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed27dfd-0e85-4523-94b8-9ffac62dfbd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:24.141172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed27dfd-0e85-4523-94b8-9ffac62dfbd0 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:24.181658 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1164/2316] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:04:24.182642 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed27dfd-0e85-4523-94b8-9ffac62dfbd0 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:24.184268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d087e47-a806-4e22-95af-d01a596e2784 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:24.216219 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed27dfd-0e85-4523-94b8-9ffac62dfbd0 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:24.245189 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77601d-2bb6-4662-a1f3-bd205ff313fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:24.245891 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77601d-2bb6-4662-a1f3-bd205ff313fb admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:24.246172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77601d-2bb6-4662-a1f3-bd205ff313fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:24.246455 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77601d-2bb6-4662-a1f3-bd205ff313fb admin admin] PATH_INFO: `/v3/projects/68f875d3804844d099942c5c8c033958/users/b60a5cb6664240c6b482a8ac2032f4af/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:24.255654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77601d-2bb6-4662-a1f3-bd205ff313fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f875d3804844d099942c5c8c033958, user_id=b60a5cb6664240c6b482a8ac2032f4af, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:24.262964 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77601d-2bb6-4662-a1f3-bd205ff313fb admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:24.308774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1165/2317] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:04:24 2022] PUT /identity/v3/projects/68f875d3804844d099942c5c8c033958/users/b60a5cb6664240c6b482a8ac2032f4af/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:04:24.351982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb780a8c-cf4e-4507-ad1d-3e3a66c4b502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:24.354755 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb780a8c-cf4e-4507-ad1d-3e3a66c4b502 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:24.354755 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb780a8c-cf4e-4507-ad1d-3e3a66c4b502 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:24.354755 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb780a8c-cf4e-4507-ad1d-3e3a66c4b502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:24.375007 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb780a8c-cf4e-4507-ad1d-3e3a66c4b502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:24.378373 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb780a8c-cf4e-4507-ad1d-3e3a66c4b502 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:24.417315 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1153/2318] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:04:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:04:24.519299 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:26.381289 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77601d-2bb6-4662-a1f3-bd205ff313fb admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:26.383489 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9a77601d-2bb6-4662-a1f3-bd205ff313fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:26.543360 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77601d-2bb6-4662-a1f3-bd205ff313fb admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:26.559994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc258b70-b9d7-48c8-83b1-a0c4f9793404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:26.560989 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc258b70-b9d7-48c8-83b1-a0c4f9793404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:26.561429 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc258b70-b9d7-48c8-83b1-a0c4f9793404 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:26.561885 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc258b70-b9d7-48c8-83b1-a0c4f9793404 admin admin] PATH_INFO: `/v3/projects/ff4d1c44d59b4583a59c9781749b34ef` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:26.564331 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc258b70-b9d7-48c8-83b1-a0c4f9793404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff4d1c44d59b4583a59c9781749b34ef)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:26.566733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc258b70-b9d7-48c8-83b1-a0c4f9793404 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:26.746049 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-bc258b70-b9d7-48c8-83b1-a0c4f9793404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff4d1c44d59b4583a59c9781749b34ef', 'request_id': 'req-bc258b70-b9d7-48c8-83b1-a0c4f9793404'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:26.849273 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-bc258b70-b9d7-48c8-83b1-a0c4f9793404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff4d1c44d59b4583a59c9781749b34ef', 'request_id': 'req-bc258b70-b9d7-48c8-83b1-a0c4f9793404'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:26.858750 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-bc258b70-b9d7-48c8-83b1-a0c4f9793404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff4d1c44d59b4583a59c9781749b34ef', 'request_id': 'req-bc258b70-b9d7-48c8-83b1-a0c4f9793404'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:26.881423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:26.920696 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-bc258b70-b9d7-48c8-83b1-a0c4f9793404 admin admin] The token cache is being invalidate because project ff4d1c44d59b4583a59c9781749b34ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:04:26.927165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-bc258b70-b9d7-48c8-83b1-a0c4f9793404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:26.927165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-bc258b70-b9d7-48c8-83b1-a0c4f9793404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:26.927165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1166/2319] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:04:26 2022] DELETE /identity/v3/projects/ff4d1c44d59b4583a59c9781749b34ef => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:04:27.964489 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:29.709044 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:29.812348 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:30.545164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9023b-fcf8-461a-8666-3e315ded6a80 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:30.545456 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9023b-fcf8-461a-8666-3e315ded6a80 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:30.545908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9023b-fcf8-461a-8666-3e315ded6a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:30.575629 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-57d9023b-fcf8-461a-8666-3e315ded6a80 None None] MFA Rules not processed for user `420e2a81b66a470e8db624efd61fd1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:30.577422 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-57d9023b-fcf8-461a-8666-3e315ded6a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:30.647974 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1154/2320] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 28 04:04:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:04:30.684585 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc258b70-b9d7-48c8-83b1-a0c4f9793404 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:30.687617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-bc258b70-b9d7-48c8-83b1-a0c4f9793404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:30.863812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:30.935255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc258b70-b9d7-48c8-83b1-a0c4f9793404 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:30.946858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b53ec-7bdb-4a94-80ff-60cad19b9678 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382ff6087bf4486d8651162880825eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:30.947774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b53ec-7bdb-4a94-80ff-60cad19b9678 service swift] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:30.948183 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b53ec-7bdb-4a94-80ff-60cad19b9678 service swift] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:30.948595 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b53ec-7bdb-4a94-80ff-60cad19b9678 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:30.963756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b53ec-7bdb-4a94-80ff-60cad19b9678 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:30.965785 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b53ec-7bdb-4a94-80ff-60cad19b9678 service swift] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:30.980718 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1167/2321] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 28 04:04:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 04:04:31.228894 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:32.478546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:33.459966 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:34.065796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f70419-dac4-4495-a9bd-d9fac145ed40 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:34.066675 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f70419-dac4-4495-a9bd-d9fac145ed40 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:34.067738 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f70419-dac4-4495-a9bd-d9fac145ed40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:34.105188 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-a2f70419-dac4-4495-a9bd-d9fac145ed40 None None] MFA Rules not processed for user `420e2a81b66a470e8db624efd61fd1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:34.106540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a2f70419-dac4-4495-a9bd-d9fac145ed40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:34.151423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:34.181743 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1155/2322] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 28 04:04:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:34.199589 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b53ec-7bdb-4a94-80ff-60cad19b9678 service swift] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:34.216605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b53ec-7bdb-4a94-80ff-60cad19b9678 service swift] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:34.225628 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3be8e1-6f25-49be-8e7e-d8b14bcf74d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382ff6087bf4486d8651162880825eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:34.227085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3be8e1-6f25-49be-8e7e-d8b14bcf74d2 service swift] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:34.227624 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3be8e1-6f25-49be-8e7e-d8b14bcf74d2 service swift] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:34.228111 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3be8e1-6f25-49be-8e7e-d8b14bcf74d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:34.238541 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3be8e1-6f25-49be-8e7e-d8b14bcf74d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:34.240582 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3be8e1-6f25-49be-8e7e-d8b14bcf74d2 service swift] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:34.264664 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1168/2323] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 28 04:04:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 04:04:35.278468 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214c118-0adf-4c4a-82ce-b956326f9fcc None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:35.279026 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214c118-0adf-4c4a-82ce-b956326f9fcc None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:35.279026 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214c118-0adf-4c4a-82ce-b956326f9fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:35.321882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-8214c118-0adf-4c4a-82ce-b956326f9fcc None None] MFA Rules not processed for user `420e2a81b66a470e8db624efd61fd1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:35.323041 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-8214c118-0adf-4c4a-82ce-b956326f9fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:35.332257 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:35.350761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1156/2324] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 28 04:04:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:35.378248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3be8e1-6f25-49be-8e7e-d8b14bcf74d2 service swift] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:35.393607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3be8e1-6f25-49be-8e7e-d8b14bcf74d2 service swift] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:35.401061 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b4034-42bd-4b09-85b8-e55b4336819e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382ff6087bf4486d8651162880825eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:35.402357 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b4034-42bd-4b09-85b8-e55b4336819e service swift] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:35.402939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b4034-42bd-4b09-85b8-e55b4336819e service swift] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:35.403457 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b4034-42bd-4b09-85b8-e55b4336819e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:35.417378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b4034-42bd-4b09-85b8-e55b4336819e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:35.419764 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b4034-42bd-4b09-85b8-e55b4336819e service swift] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:35.433825 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1169/2325] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 28 04:04:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 04:04:36.169941 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:36.743478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5325340-6584-44fd-bb1f-d59bd76481dc None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:36.743978 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5325340-6584-44fd-bb1f-d59bd76481dc None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:36.743978 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5325340-6584-44fd-bb1f-d59bd76481dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:36.767912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-b5325340-6584-44fd-bb1f-d59bd76481dc None None] MFA Rules not processed for user `420e2a81b66a470e8db624efd61fd1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:36.769323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b5325340-6584-44fd-bb1f-d59bd76481dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:36.798797 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1157/2326] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 28 04:04:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:36.806247 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b4034-42bd-4b09-85b8-e55b4336819e service swift] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:36.822114 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b4034-42bd-4b09-85b8-e55b4336819e service swift] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:36.845373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7941d0-1bb8-45c3-857b-c0479952a410 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382ff6087bf4486d8651162880825eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:36.846624 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7941d0-1bb8-45c3-857b-c0479952a410 service swift] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:36.847126 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7941d0-1bb8-45c3-857b-c0479952a410 service swift] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:36.847777 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7941d0-1bb8-45c3-857b-c0479952a410 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:36.864686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7941d0-1bb8-45c3-857b-c0479952a410 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:36.867426 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7941d0-1bb8-45c3-857b-c0479952a410 service swift] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:36.903855 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1170/2327] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 28 04:04:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 04:04:37.705753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:38.170944 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:38.575437 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:39.076809 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13919e28-bb04-49a6-956f-54df2dc2edd0 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:39.077097 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13919e28-bb04-49a6-956f-54df2dc2edd0 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:39.077373 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13919e28-bb04-49a6-956f-54df2dc2edd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:39.109390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-13919e28-bb04-49a6-956f-54df2dc2edd0 None None] MFA Rules not processed for user `b60a5cb6664240c6b482a8ac2032f4af`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:39.110689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-13919e28-bb04-49a6-956f-54df2dc2edd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:39.181494 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1158/2328] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:39.194648 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7941d0-1bb8-45c3-857b-c0479952a410 service swift] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:39.196178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-0e7941d0-1bb8-45c3-857b-c0479952a410 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:39.288154 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7941d0-1bb8-45c3-857b-c0479952a410 service swift] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:39.295932 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f2126-38d6-4521-a9c4-b7aa95115694 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bfc1fe981424313aecce5af443c8a9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:39.297043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f2126-38d6-4521-a9c4-b7aa95115694 service glance] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:39.297403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f2126-38d6-4521-a9c4-b7aa95115694 service glance] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:39.297878 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f2126-38d6-4521-a9c4-b7aa95115694 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:39.301118 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-313f2126-38d6-4521-a9c4-b7aa95115694 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:39.450480 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f2126-38d6-4521-a9c4-b7aa95115694 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:39.452048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f2126-38d6-4521-a9c4-b7aa95115694 service glance] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:39.468032 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1171/2329] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:04:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:04:39.927490 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:40.056702 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f476-3667-4bdc-ba0b-eef3a0bc239a None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:40.058257 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f476-3667-4bdc-ba0b-eef3a0bc239a None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:40.059222 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f476-3667-4bdc-ba0b-eef3a0bc239a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:40.121322 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-3933f476-3667-4bdc-ba0b-eef3a0bc239a None None] MFA Rules not processed for user `420e2a81b66a470e8db624efd61fd1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:40.124031 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-3933f476-3667-4bdc-ba0b-eef3a0bc239a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:40.164689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1159/2330] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 28 04:04:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:40.187350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f2126-38d6-4521-a9c4-b7aa95115694 service glance] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:40.211242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f2126-38d6-4521-a9c4-b7aa95115694 service glance] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:40.227132 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377d88f-aa7b-4c32-abba-485113104455 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382ff6087bf4486d8651162880825eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:40.227810 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377d88f-aa7b-4c32-abba-485113104455 service swift] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:40.228153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377d88f-aa7b-4c32-abba-485113104455 service swift] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:40.228435 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377d88f-aa7b-4c32-abba-485113104455 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:40.254615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377d88f-aa7b-4c32-abba-485113104455 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:40.256256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377d88f-aa7b-4c32-abba-485113104455 service swift] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:40.290179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1172/2331] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 28 04:04:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 04:04:40.581370 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:41.466912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933f476-3667-4bdc-ba0b-eef3a0bc239a None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:41.468590 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-3933f476-3667-4bdc-ba0b-eef3a0bc239a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:41.637248 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933f476-3667-4bdc-ba0b-eef3a0bc239a None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:41.657672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5affa-4a74-4e95-a837-d2aa2698a5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:41.658815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5affa-4a74-4e95-a837-d2aa2698a5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:41.659094 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5affa-4a74-4e95-a837-d2aa2698a5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:41.660860 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5affa-4a74-4e95-a837-d2aa2698a5bd admin admin] PATH_INFO: `/v3/users/163c3658411b48a1b9eba2426c738808` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:41.662227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5affa-4a74-4e95-a837-d2aa2698a5bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=163c3658411b48a1b9eba2426c738808)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:41.664264 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5affa-4a74-4e95-a837-d2aa2698a5bd admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:41.950962 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-8ca5affa-4a74-4e95-a837-d2aa2698a5bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '163c3658411b48a1b9eba2426c738808'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:41.952170 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-8ca5affa-4a74-4e95-a837-d2aa2698a5bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '163c3658411b48a1b9eba2426c738808'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:42.086971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-8ca5affa-4a74-4e95-a837-d2aa2698a5bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '163c3658411b48a1b9eba2426c738808'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:42.099856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-8ca5affa-4a74-4e95-a837-d2aa2698a5bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '163c3658411b48a1b9eba2426c738808'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:42.130256 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-8ca5affa-4a74-4e95-a837-d2aa2698a5bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '163c3658411b48a1b9eba2426c738808'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:42.140828 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1160/2332] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:04:41 2022] DELETE /identity/v3/users/163c3658411b48a1b9eba2426c738808 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:04:42.147538 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20174e-bc3d-4427-9735-4d900735f1a7 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:42.148072 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20174e-bc3d-4427-9735-4d900735f1a7 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:42.148388 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20174e-bc3d-4427-9735-4d900735f1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:42.180599 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-9d20174e-bc3d-4427-9735-4d900735f1a7 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:42.182192 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9d20174e-bc3d-4427-9735-4d900735f1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:42.261733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1173/2333] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:42.279055 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5affa-4a74-4e95-a837-d2aa2698a5bd admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:42.281251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-8ca5affa-4a74-4e95-a837-d2aa2698a5bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:42.322234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:42.483489 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5affa-4a74-4e95-a837-d2aa2698a5bd admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:42.498082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b7ef7-5b06-4597-a2b7-e21057dad9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:42.498769 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b7ef7-5b06-4597-a2b7-e21057dad9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:42.503565 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b7ef7-5b06-4597-a2b7-e21057dad9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:42.503922 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b7ef7-5b06-4597-a2b7-e21057dad9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:42.533806 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b7ef7-5b06-4597-a2b7-e21057dad9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:42.535561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b7ef7-5b06-4597-a2b7-e21057dad9f8 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:42.550308 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1161/2334] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:04:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:04:42.661772 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:43.423261 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20174e-bc3d-4427-9735-4d900735f1a7 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:43.425350 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9d20174e-bc3d-4427-9735-4d900735f1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:43.448172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20174e-bc3d-4427-9735-4d900735f1a7 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:43.476143 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359481a-0e56-43bc-9af3-d13b310c34d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:43.483973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359481a-0e56-43bc-9af3-d13b310c34d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:43.483973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359481a-0e56-43bc-9af3-d13b310c34d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:43.483973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359481a-0e56-43bc-9af3-d13b310c34d7 admin admin] PATH_INFO: `/v3/projects/45d61d2f9f7444feaea967313b3b85f6` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:43.483973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359481a-0e56-43bc-9af3-d13b310c34d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d61d2f9f7444feaea967313b3b85f6)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:43.491035 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359481a-0e56-43bc-9af3-d13b310c34d7 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:43.637486 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4359481a-0e56-43bc-9af3-d13b310c34d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d61d2f9f7444feaea967313b3b85f6', 'request_id': 'req-4359481a-0e56-43bc-9af3-d13b310c34d7'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:43.740521 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4359481a-0e56-43bc-9af3-d13b310c34d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d61d2f9f7444feaea967313b3b85f6', 'request_id': 'req-4359481a-0e56-43bc-9af3-d13b310c34d7'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:43.747572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4359481a-0e56-43bc-9af3-d13b310c34d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d61d2f9f7444feaea967313b3b85f6', 'request_id': 'req-4359481a-0e56-43bc-9af3-d13b310c34d7'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:43.753134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:43.799800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4359481a-0e56-43bc-9af3-d13b310c34d7 admin admin] The token cache is being invalidate because project 45d61d2f9f7444feaea967313b3b85f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:04:43.800077 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4359481a-0e56-43bc-9af3-d13b310c34d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:43.805610 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4359481a-0e56-43bc-9af3-d13b310c34d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:43.808833 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1174/2335] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:04:43 2022] DELETE /identity/v3/projects/45d61d2f9f7444feaea967313b3b85f6 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:04:43.815615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c67dee-b56d-473f-9a9b-4baa85255ff9 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:43.816576 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c67dee-b56d-473f-9a9b-4baa85255ff9 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:43.817000 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c67dee-b56d-473f-9a9b-4baa85255ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:43.870976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-35c67dee-b56d-473f-9a9b-4baa85255ff9 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:43.873497 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-35c67dee-b56d-473f-9a9b-4baa85255ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:44.004371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:44.072686 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1162/2336] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:44.078148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d15be-54d9-406b-9673-76c6416bd213 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:44.078442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d15be-54d9-406b-9673-76c6416bd213 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:44.079631 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d15be-54d9-406b-9673-76c6416bd213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:44.114243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-3e8d15be-54d9-406b-9673-76c6416bd213 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:44.116258 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-3e8d15be-54d9-406b-9673-76c6416bd213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:44.139998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1175/2337] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:44.144312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c67dee-b56d-473f-9a9b-4baa85255ff9 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:44.161546 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c67dee-b56d-473f-9a9b-4baa85255ff9 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:44.177315 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c1d73-fb21-4c81-8547-bd67a4e46340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:44.179005 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c1d73-fb21-4c81-8547-bd67a4e46340 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:44.179631 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c1d73-fb21-4c81-8547-bd67a4e46340 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:44.180068 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c1d73-fb21-4c81-8547-bd67a4e46340 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:44.184165 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c1d73-fb21-4c81-8547-bd67a4e46340 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:04:44.184691 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c1d73-fb21-4c81-8547-bd67a4e46340 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:44.189036 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c1d73-fb21-4c81-8547-bd67a4e46340 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:44.227055 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1163/2338] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:04:44.233143 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d15be-54d9-406b-9673-76c6416bd213 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:44.253808 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d15be-54d9-406b-9673-76c6416bd213 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:44.265936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd39e7-c498-4d33-b6c4-d6298fe43caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:44.269777 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd39e7-c498-4d33-b6c4-d6298fe43caa admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:44.269777 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd39e7-c498-4d33-b6c4-d6298fe43caa admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:44.269777 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd39e7-c498-4d33-b6c4-d6298fe43caa admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:44.269777 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd39e7-c498-4d33-b6c4-d6298fe43caa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:44.271177 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd39e7-c498-4d33-b6c4-d6298fe43caa admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:44.352829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:44.413312 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:44.431597 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1176/2339] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:04:44 2022] POST /identity/v3/projects => generated 397 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:04:44.432722 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c1d73-fb21-4c81-8547-bd67a4e46340 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:44.450718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c1d73-fb21-4c81-8547-bd67a4e46340 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:44.602486 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0293f04-d215-4976-a21d-86bebd4cf4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:44.603156 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0293f04-d215-4976-a21d-86bebd4cf4c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:44.603469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0293f04-d215-4976-a21d-86bebd4cf4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:44.603749 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0293f04-d215-4976-a21d-86bebd4cf4c0 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:44.605430 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0293f04-d215-4976-a21d-86bebd4cf4c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:44.608950 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0293f04-d215-4976-a21d-86bebd4cf4c0 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:45.743487 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1164/2340] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:04:44 2022] POST /identity/v3/users => generated 299 bytes in 1308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:04:45.746574 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd39e7-c498-4d33-b6c4-d6298fe43caa admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:45.769856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd39e7-c498-4d33-b6c4-d6298fe43caa admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:45.778468 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78c1f5-5b99-430f-88a5-a8dbcacec539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:45.779013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78c1f5-5b99-430f-88a5-a8dbcacec539 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:45.779284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78c1f5-5b99-430f-88a5-a8dbcacec539 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:45.779615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78c1f5-5b99-430f-88a5-a8dbcacec539 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:45.780309 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78c1f5-5b99-430f-88a5-a8dbcacec539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:45.782060 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78c1f5-5b99-430f-88a5-a8dbcacec539 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:45.801792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1177/2341] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:04:45.805778 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0293f04-d215-4976-a21d-86bebd4cf4c0 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:45.817586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0293f04-d215-4976-a21d-86bebd4cf4c0 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:45.822890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca04746-1f97-46ce-94ad-8f1ad18e4e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:45.823852 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca04746-1f97-46ce-94ad-8f1ad18e4e63 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:45.824175 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca04746-1f97-46ce-94ad-8f1ad18e4e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:45.824600 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca04746-1f97-46ce-94ad-8f1ad18e4e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:45.825310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca04746-1f97-46ce-94ad-8f1ad18e4e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:45.827033 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca04746-1f97-46ce-94ad-8f1ad18e4e63 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:45.841800 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1165/2342] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:04:45.850877 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78c1f5-5b99-430f-88a5-a8dbcacec539 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:45.859783 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78c1f5-5b99-430f-88a5-a8dbcacec539 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:45.865691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f3c57-3d1a-4a12-981b-9f0b80747a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:45.866538 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f3c57-3d1a-4a12-981b-9f0b80747a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:45.867159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f3c57-3d1a-4a12-981b-9f0b80747a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:45.867566 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f3c57-3d1a-4a12-981b-9f0b80747a1f admin admin] PATH_INFO: `/v3/projects/e2b9887b78e24a62addef9a4735c6794/users/f147fc956aae4affadb713f42e2f5ccf/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:45.886406 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f3c57-3d1a-4a12-981b-9f0b80747a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b9887b78e24a62addef9a4735c6794, user_id=f147fc956aae4affadb713f42e2f5ccf, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:45.889822 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f3c57-3d1a-4a12-981b-9f0b80747a1f admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:46.145792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1178/2343] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:04:45 2022] PUT /identity/v3/projects/e2b9887b78e24a62addef9a4735c6794/users/f147fc956aae4affadb713f42e2f5ccf/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:04:46.166156 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7187e8f-e08b-4ab2-bbdd-9244218e48b5 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:46.166623 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7187e8f-e08b-4ab2-bbdd-9244218e48b5 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:46.167086 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7187e8f-e08b-4ab2-bbdd-9244218e48b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:46.220228 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:46.225037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-a7187e8f-e08b-4ab2-bbdd-9244218e48b5 None None] MFA Rules not processed for user `f147fc956aae4affadb713f42e2f5ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:46.228144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a7187e8f-e08b-4ab2-bbdd-9244218e48b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:46.287605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:46.338227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1166/2344] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:46.353921 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f3c57-3d1a-4a12-981b-9f0b80747a1f admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:46.357529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-938f3c57-3d1a-4a12-981b-9f0b80747a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:46.463965 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f3c57-3d1a-4a12-981b-9f0b80747a1f admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:46.471536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6ecde-4bf0-43e2-b362-c1a49b59d7b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:46.472639 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6ecde-4bf0-43e2-b362-c1a49b59d7b0 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:46.473140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6ecde-4bf0-43e2-b362-c1a49b59d7b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:46.473649 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6ecde-4bf0-43e2-b362-c1a49b59d7b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:46.498711 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6ecde-4bf0-43e2-b362-c1a49b59d7b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:46.500355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6ecde-4bf0-43e2-b362-c1a49b59d7b0 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:46.512895 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1179/2345] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:04:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:04:46.633493 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:46.741118 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:46.900918 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:47.354685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:47.916056 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:49.041605 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2ef5a-ce85-4251-947d-61da26b3fb7c None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:49.042273 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2ef5a-ce85-4251-947d-61da26b3fb7c None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:49.042384 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2ef5a-ce85-4251-947d-61da26b3fb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:49.097146 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-06d2ef5a-ce85-4251-947d-61da26b3fb7c None None] MFA Rules not processed for user `135e59d1a0134ef1887224bb86701071`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:49.105786 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-06d2ef5a-ce85-4251-947d-61da26b3fb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:49.221804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1167/2346] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:49.473294 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:50.586731 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:50.819057 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:51.215700 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:51.270747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc1b5c-638d-49c9-a7b6-688ee29d685a None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:51.272432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc1b5c-638d-49c9-a7b6-688ee29d685a None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:51.272432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc1b5c-638d-49c9-a7b6-688ee29d685a None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:51.273212 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1180/2347] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 28 04:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:04:51.280333 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e21117-7b81-4e7e-989d-f9030bc177ce None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:51.280963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e21117-7b81-4e7e-989d-f9030bc177ce None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:51.281463 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e21117-7b81-4e7e-989d-f9030bc177ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:51.307151 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-c0e21117-7b81-4e7e-989d-f9030bc177ce None None] MFA Rules not processed for user `5133abf4c32a45b0b2188f71496c572b`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:51.309053 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c0e21117-7b81-4e7e-989d-f9030bc177ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:51.425605 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1168/2348] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 28 04:04:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:55.000936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc1b5c-638d-49c9-a7b6-688ee29d685a None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:55.004077 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-eecc1b5c-638d-49c9-a7b6-688ee29d685a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:55.022970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:55.105257 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc1b5c-638d-49c9-a7b6-688ee29d685a None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:55.109321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e3781-4929-45f7-9eaf-4a6985bc8dba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bfc1fe981424313aecce5af443c8a9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:55.111374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e3781-4929-45f7-9eaf-4a6985bc8dba service glance] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:55.111374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e3781-4929-45f7-9eaf-4a6985bc8dba service glance] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:55.111374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e3781-4929-45f7-9eaf-4a6985bc8dba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:55.134390 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e3781-4929-45f7-9eaf-4a6985bc8dba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:55.138021 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e3781-4929-45f7-9eaf-4a6985bc8dba service glance] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:55.167562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1181/2349] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:04:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:04:55.170454 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e21117-7b81-4e7e-989d-f9030bc177ce None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:55.176716 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:55.230337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdc8ec-c46e-4df2-8feb-b5a8dc388ae9 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:55.231055 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdc8ec-c46e-4df2-8feb-b5a8dc388ae9 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:55.232134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdc8ec-c46e-4df2-8feb-b5a8dc388ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:55.273245 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e21117-7b81-4e7e-989d-f9030bc177ce None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:55.277175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-06bdc8ec-c46e-4df2-8feb-b5a8dc388ae9 None None] MFA Rules not processed for user `114bcf2b59274aeab5f5deee67527cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:55.280442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-06bdc8ec-c46e-4df2-8feb-b5a8dc388ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:55.280566 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad480b-73fc-450d-86d6-17a96ab76798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:55.280566 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad480b-73fc-450d-86d6-17a96ab76798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:55.280566 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad480b-73fc-450d-86d6-17a96ab76798 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:55.281191 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad480b-73fc-450d-86d6-17a96ab76798 admin admin] PATH_INFO: `/v3/users/f147fc956aae4affadb713f42e2f5ccf` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:55.285312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad480b-73fc-450d-86d6-17a96ab76798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f147fc956aae4affadb713f42e2f5ccf)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:55.287577 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad480b-73fc-450d-86d6-17a96ab76798 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:55.379023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1182/2350] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:04:55.526030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a8418-1d13-4231-8486-43e34d6cc72d None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:55.527308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a8418-1d13-4231-8486-43e34d6cc72d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:55.527950 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a8418-1d13-4231-8486-43e34d6cc72d None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:55.532969 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1183/2351] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 28 04:04:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:04:55.537654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf4b68-8a2e-4a91-91d9-ddcb4ac1e1cc None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:55.537971 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf4b68-8a2e-4a91-91d9-ddcb4ac1e1cc None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:55.538255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf4b68-8a2e-4a91-91d9-ddcb4ac1e1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:55.586652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e4ad480b-73fc-450d-86d6-17a96ab76798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f147fc956aae4affadb713f42e2f5ccf'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:55.587462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e4ad480b-73fc-450d-86d6-17a96ab76798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f147fc956aae4affadb713f42e2f5ccf'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:55.595949 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-decf4b68-8a2e-4a91-91d9-ddcb4ac1e1cc None None] MFA Rules not processed for user `03742c23cae849d9bf4ce0b432edd1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:55.598625 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-decf4b68-8a2e-4a91-91d9-ddcb4ac1e1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:55.692326 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e4ad480b-73fc-450d-86d6-17a96ab76798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f147fc956aae4affadb713f42e2f5ccf'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:55.708177 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e4ad480b-73fc-450d-86d6-17a96ab76798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f147fc956aae4affadb713f42e2f5ccf'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:55.730355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1184/2352] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 28 04:04:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:04:55.746474 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e4ad480b-73fc-450d-86d6-17a96ab76798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f147fc956aae4affadb713f42e2f5ccf'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:55.781673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1169/2353] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:04:55 2022] DELETE /identity/v3/users/f147fc956aae4affadb713f42e2f5ccf => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:04:55.788241 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7091da-69b3-4ce2-9844-f056e5d2f1d8 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:55.788795 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7091da-69b3-4ce2-9844-f056e5d2f1d8 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:55.789413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7091da-69b3-4ce2-9844-f056e5d2f1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:55.810281 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad480b-73fc-450d-86d6-17a96ab76798 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:55.811799 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e4ad480b-73fc-450d-86d6-17a96ab76798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:55.828880 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-6b7091da-69b3-4ce2-9844-f056e5d2f1d8 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:55.830909 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-6b7091da-69b3-4ce2-9844-f056e5d2f1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:55.902219 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad480b-73fc-450d-86d6-17a96ab76798 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:55.907358 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c48dc-3dd5-4de5-b5e1-597a942ebfd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:55.909282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c48dc-3dd5-4de5-b5e1-597a942ebfd7 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:55.909577 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c48dc-3dd5-4de5-b5e1-597a942ebfd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:55.909857 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c48dc-3dd5-4de5-b5e1-597a942ebfd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:55.919609 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c48dc-3dd5-4de5-b5e1-597a942ebfd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:55.921910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c48dc-3dd5-4de5-b5e1-597a942ebfd7 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:55.934473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1170/2354] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:04:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:04:55.942060 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1185/2355] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:55.960341 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c48dc-3dd5-4de5-b5e1-597a942ebfd7 service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:55.963384 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c56c48dc-3dd5-4de5-b5e1-597a942ebfd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:55.989593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c48dc-3dd5-4de5-b5e1-597a942ebfd7 service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:56.009159 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41a1fb-e261-4d16-a9d3-2acb9d0c6747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:56.012686 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41a1fb-e261-4d16-a9d3-2acb9d0c6747 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:56.013252 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41a1fb-e261-4d16-a9d3-2acb9d0c6747 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:56.013789 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41a1fb-e261-4d16-a9d3-2acb9d0c6747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:56.038837 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41a1fb-e261-4d16-a9d3-2acb9d0c6747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:56.040438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41a1fb-e261-4d16-a9d3-2acb9d0c6747 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:56.065207 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1171/2356] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:04:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:04:56.114234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575a0b4-dbd0-4c24-8c00-7a1fe0f3fdd1 None None] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:56.118479 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575a0b4-dbd0-4c24-8c00-7a1fe0f3fdd1 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:56.118479 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575a0b4-dbd0-4c24-8c00-7a1fe0f3fdd1 None None] PATH_INFO: `/` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:56.118860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1186/2357] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 28 04:04:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:04:56.128993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3382591-0100-4d82-a7a2-9214eed6e2f2 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:56.129507 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3382591-0100-4d82-a7a2-9214eed6e2f2 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:56.130004 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3382591-0100-4d82-a7a2-9214eed6e2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:56.193180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-c3382591-0100-4d82-a7a2-9214eed6e2f2 None None] MFA Rules not processed for user `5133abf4c32a45b0b2188f71496c572b`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:04:56.196572 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c3382591-0100-4d82-a7a2-9214eed6e2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:56.219430 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:56.405933 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1172/2358] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 28 04:04:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:04:56.420936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575a0b4-dbd0-4c24-8c00-7a1fe0f3fdd1 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:56.453167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575a0b4-dbd0-4c24-8c00-7a1fe0f3fdd1 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:56.464244 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a604c8-5116-47a7-b22d-ff7556fc83ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:56.465250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a604c8-5116-47a7-b22d-ff7556fc83ce service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:56.465741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a604c8-5116-47a7-b22d-ff7556fc83ce service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:56.466366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a604c8-5116-47a7-b22d-ff7556fc83ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:56.489632 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:56.496820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a604c8-5116-47a7-b22d-ff7556fc83ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:56.502190 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a604c8-5116-47a7-b22d-ff7556fc83ce service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:56.528380 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1187/2359] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:04:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:04:57.263700 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3382591-0100-4d82-a7a2-9214eed6e2f2 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:04:57.269152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c3382591-0100-4d82-a7a2-9214eed6e2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:04:57.301044 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3382591-0100-4d82-a7a2-9214eed6e2f2 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:04:57.306463 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb869e9b-6114-4e9e-9703-92098ef244f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:04:57.307473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb869e9b-6114-4e9e-9703-92098ef244f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:04:57.308018 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb869e9b-6114-4e9e-9703-92098ef244f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:04:57.308444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb869e9b-6114-4e9e-9703-92098ef244f1 admin admin] PATH_INFO: `/v3/projects/e2b9887b78e24a62addef9a4735c6794` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:04:57.310060 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb869e9b-6114-4e9e-9703-92098ef244f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b9887b78e24a62addef9a4735c6794)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:04:57.312278 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb869e9b-6114-4e9e-9703-92098ef244f1 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:04:57.463123 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-fb869e9b-6114-4e9e-9703-92098ef244f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b9887b78e24a62addef9a4735c6794', 'request_id': 'req-fb869e9b-6114-4e9e-9703-92098ef244f1'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:57.473619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-fb869e9b-6114-4e9e-9703-92098ef244f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b9887b78e24a62addef9a4735c6794', 'request_id': 'req-fb869e9b-6114-4e9e-9703-92098ef244f1'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:57.481982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-fb869e9b-6114-4e9e-9703-92098ef244f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b9887b78e24a62addef9a4735c6794', 'request_id': 'req-fb869e9b-6114-4e9e-9703-92098ef244f1'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:57.607880 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-fb869e9b-6114-4e9e-9703-92098ef244f1 admin admin] The token cache is being invalidate because project e2b9887b78e24a62addef9a4735c6794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:04:57.608189 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-fb869e9b-6114-4e9e-9703-92098ef244f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:57.608851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-fb869e9b-6114-4e9e-9703-92098ef244f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:04:57.611757 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1173/2360] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:04:57 2022] DELETE /identity/v3/projects/e2b9887b78e24a62addef9a4735c6794 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:05:01.581055 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b8bbc-4967-455a-bad1-07429e5cbcdc None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:01.581912 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b8bbc-4967-455a-bad1-07429e5cbcdc None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:01.581912 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b8bbc-4967-455a-bad1-07429e5cbcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:01.610833 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-497b8bbc-4967-455a-bad1-07429e5cbcdc None None] MFA Rules not processed for user `420e2a81b66a470e8db624efd61fd1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:05:01.614100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-497b8bbc-4967-455a-bad1-07429e5cbcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:05:01.698036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1188/2361] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 28 04:05:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:05:01.715701 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb869e9b-6114-4e9e-9703-92098ef244f1 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:05:01.717230 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-fb869e9b-6114-4e9e-9703-92098ef244f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:05:01.890463 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb869e9b-6114-4e9e-9703-92098ef244f1 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:05:01.898538 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffec146-7c0c-40ce-9bbb-5b9db10c745c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382ff6087bf4486d8651162880825eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:05:01.899560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffec146-7c0c-40ce-9bbb-5b9db10c745c service swift] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:01.899953 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffec146-7c0c-40ce-9bbb-5b9db10c745c service swift] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:01.900458 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffec146-7c0c-40ce-9bbb-5b9db10c745c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:01.917412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffec146-7c0c-40ce-9bbb-5b9db10c745c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:05:01.919933 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffec146-7c0c-40ce-9bbb-5b9db10c745c service swift] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:05:01.943949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1174/2362] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 28 04:05:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 04:05:11.690022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=27 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:11.942428 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:12.542243 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3b828-ded3-4150-85e7-e8015a59ef4f None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:12.542530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3b828-ded3-4150-85e7-e8015a59ef4f None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:12.542815 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3b828-ded3-4150-85e7-e8015a59ef4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:12.565800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-1db3b828-ded3-4150-85e7-e8015a59ef4f None None] MFA Rules not processed for user `420e2a81b66a470e8db624efd61fd1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:05:12.566897 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-1db3b828-ded3-4150-85e7-e8015a59ef4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:05:12.575387 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1189/2363] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 28 04:05:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:05:12.597468 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffec146-7c0c-40ce-9bbb-5b9db10c745c service swift] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:05:12.609797 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffec146-7c0c-40ce-9bbb-5b9db10c745c service swift] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:05:12.616781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ff673-fdaf-4c76-8a02-55be1290dc0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382ff6087bf4486d8651162880825eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:05:12.617682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ff673-fdaf-4c76-8a02-55be1290dc0a service swift] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:12.618149 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ff673-fdaf-4c76-8a02-55be1290dc0a service swift] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:12.618462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ff673-fdaf-4c76-8a02-55be1290dc0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:12.628782 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ff673-fdaf-4c76-8a02-55be1290dc0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:05:12.630844 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ff673-fdaf-4c76-8a02-55be1290dc0a service swift] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:05:12.641376 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1175/2364] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 28 04:05:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:22.560310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:22.637196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=6 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:31.821037 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a30ec-b6e4-4770-afd0-6ff321d636cf None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:31.821568 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a30ec-b6e4-4770-afd0-6ff321d636cf None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:31.822060 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a30ec-b6e4-4770-afd0-6ff321d636cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:31.853197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-016a30ec-b6e4-4770-afd0-6ff321d636cf None None] MFA Rules not processed for user `420e2a81b66a470e8db624efd61fd1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:05:31.853197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-016a30ec-b6e4-4770-afd0-6ff321d636cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:05:31.856051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1190/2365] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 28 04:05:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:05:31.886753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ff673-fdaf-4c76-8a02-55be1290dc0a service swift] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:05:31.902518 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ff673-fdaf-4c76-8a02-55be1290dc0a service swift] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:05:31.908680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00aef6c-a9e7-46a1-8f63-93ef6a2312e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382ff6087bf4486d8651162880825eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:05:31.909512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aef6c-a9e7-46a1-8f63-93ef6a2312e4 service swift] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:31.912453 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aef6c-a9e7-46a1-8f63-93ef6a2312e4 service swift] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:31.912453 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aef6c-a9e7-46a1-8f63-93ef6a2312e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:31.919356 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00aef6c-a9e7-46a1-8f63-93ef6a2312e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:05:31.920991 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00aef6c-a9e7-46a1-8f63-93ef6a2312e4 service swift] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:05:31.931513 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1176/2366] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 28 04:05:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 28 04:05:32.308872 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cb5a4-42f7-4d25-90a1-9768f560eb23 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:32.309158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cb5a4-42f7-4d25-90a1-9768f560eb23 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:32.309512 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cb5a4-42f7-4d25-90a1-9768f560eb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:32.332944 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-7c4cb5a4-42f7-4d25-90a1-9768f560eb23 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:05:32.334177 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-7c4cb5a4-42f7-4d25-90a1-9768f560eb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:05:32.378677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00aef6c-a9e7-46a1-8f63-93ef6a2312e4 service swift] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:05:32.381094 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a00aef6c-a9e7-46a1-8f63-93ef6a2312e4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:05:32.414942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1191/2367] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Jul 28 04:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:05:32.429413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cb5a4-42f7-4d25-90a1-9768f560eb23 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:05:32.431004 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-7c4cb5a4-42f7-4d25-90a1-9768f560eb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:05:32.463755 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00aef6c-a9e7-46a1-8f63-93ef6a2312e4 service swift] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:05:32.469467 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73269ae-4eff-44a7-a5bf-350b542b6749 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f2584622a48bba21e1bf31c1aef30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:05:32.470338 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73269ae-4eff-44a7-a5bf-350b542b6749 service placement] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:32.470908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73269ae-4eff-44a7-a5bf-350b542b6749 service placement] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:32.471508 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73269ae-4eff-44a7-a5bf-350b542b6749 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:32.473588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c73269ae-4eff-44a7-a5bf-350b542b6749 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:05:32.487208 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73269ae-4eff-44a7-a5bf-350b542b6749 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:05:32.489158 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73269ae-4eff-44a7-a5bf-350b542b6749 service placement] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:05:32.500967 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1177/2368] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:05:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:05:32.515521 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cb5a4-42f7-4d25-90a1-9768f560eb23 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:05:32.523728 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d699d4e-771c-4f80-89db-0764f7121b77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:05:32.524375 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d699d4e-771c-4f80-89db-0764f7121b77 service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:32.524658 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d699d4e-771c-4f80-89db-0764f7121b77 service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:32.524931 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d699d4e-771c-4f80-89db-0764f7121b77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:32.538414 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d699d4e-771c-4f80-89db-0764f7121b77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:05:32.540298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d699d4e-771c-4f80-89db-0764f7121b77 service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:05:32.556291 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1192/2369] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:05:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:05:38.753792 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7914c-cab6-45c9-aabd-05cf70219932 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:38.754350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7914c-cab6-45c9-aabd-05cf70219932 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:38.754570 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7914c-cab6-45c9-aabd-05cf70219932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:38.785808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-9ca7914c-cab6-45c9-aabd-05cf70219932 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:05:38.785808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9ca7914c-cab6-45c9-aabd-05cf70219932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:05:38.809242 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1178/2370] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Jul 28 04:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:05:39.009372 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d699d4e-771c-4f80-89db-0764f7121b77 service nova] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:05:39.023082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d699d4e-771c-4f80-89db-0764f7121b77 service nova] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:05:39.029291 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcc136-6165-49ff-b097-b548da261c8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:05:39.029940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcc136-6165-49ff-b097-b548da261c8c service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:39.030223 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcc136-6165-49ff-b097-b548da261c8c service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:39.030501 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcc136-6165-49ff-b097-b548da261c8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:39.040080 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcc136-6165-49ff-b097-b548da261c8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:05:39.041746 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcc136-6165-49ff-b097-b548da261c8c service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:05:39.053312 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1193/2371] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:05:45.259024 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7914c-cab6-45c9-aabd-05cf70219932 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:05:45.260671 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9ca7914c-cab6-45c9-aabd-05cf70219932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:05:45.360447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7914c-cab6-45c9-aabd-05cf70219932 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:05:45.368235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85b6ad-1dbf-439f-aa41-ab7be3c5b840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:05:45.369315 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85b6ad-1dbf-439f-aa41-ab7be3c5b840 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:45.369796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85b6ad-1dbf-439f-aa41-ab7be3c5b840 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:45.370252 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85b6ad-1dbf-439f-aa41-ab7be3c5b840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:45.373401 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-5d85b6ad-1dbf-439f-aa41-ab7be3c5b840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:05:45.477198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85b6ad-1dbf-439f-aa41-ab7be3c5b840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:05:45.478676 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85b6ad-1dbf-439f-aa41-ab7be3c5b840 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:05:45.491019 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1179/2372] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:05:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:05:45.550865 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24a2b7-a308-4a32-b8f7-02e1e4be3114 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:45.550865 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24a2b7-a308-4a32-b8f7-02e1e4be3114 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:45.550865 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24a2b7-a308-4a32-b8f7-02e1e4be3114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:45.573580 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-ae24a2b7-a308-4a32-b8f7-02e1e4be3114 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:05:45.574851 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ae24a2b7-a308-4a32-b8f7-02e1e4be3114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:05:45.584863 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1194/2373] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Jul 28 04:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:05:45.619217 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85b6ad-1dbf-439f-aa41-ab7be3c5b840 service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:05:45.646715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85b6ad-1dbf-439f-aa41-ab7be3c5b840 service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:05:45.656506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544e669-4c34-4de2-a79f-0e3405153e8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:05:45.657573 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544e669-4c34-4de2-a79f-0e3405153e8b service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:45.658125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544e669-4c34-4de2-a79f-0e3405153e8b service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:45.658835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544e669-4c34-4de2-a79f-0e3405153e8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:45.673955 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544e669-4c34-4de2-a79f-0e3405153e8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:05:45.675852 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544e669-4c34-4de2-a79f-0e3405153e8b service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:05:45.687130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1180/2374] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:05:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:05:48.198016 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4083bc1-06db-40d6-96ce-baececa2c065 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:48.198993 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4083bc1-06db-40d6-96ce-baececa2c065 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:48.199558 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4083bc1-06db-40d6-96ce-baececa2c065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:48.223280 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-a4083bc1-06db-40d6-96ce-baececa2c065 None None] MFA Rules not processed for user `420e2a81b66a470e8db624efd61fd1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:05:48.230200 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a4083bc1-06db-40d6-96ce-baececa2c065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:05:48.233200 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1195/2375] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 28 04:05:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:05:48.248305 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544e669-4c34-4de2-a79f-0e3405153e8b service nova] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:05:48.281971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544e669-4c34-4de2-a79f-0e3405153e8b service nova] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:05:48.292380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db217548-bb6a-4519-8f87-4733f097ec60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382ff6087bf4486d8651162880825eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:05:48.293027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db217548-bb6a-4519-8f87-4733f097ec60 service swift] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:48.293304 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db217548-bb6a-4519-8f87-4733f097ec60 service swift] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:48.293754 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db217548-bb6a-4519-8f87-4733f097ec60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:48.301274 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:48.304130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db217548-bb6a-4519-8f87-4733f097ec60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:05:48.306153 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db217548-bb6a-4519-8f87-4733f097ec60 service swift] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:05:48.322224 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1181/2376] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 28 04:05:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:49.532441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15137064-bdf9-481b-b323-11ac96c5ee49 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:49.533815 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15137064-bdf9-481b-b323-11ac96c5ee49 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:49.534245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15137064-bdf9-481b-b323-11ac96c5ee49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:49.578355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-15137064-bdf9-481b-b323-11ac96c5ee49 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:05:49.581162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-15137064-bdf9-481b-b323-11ac96c5ee49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:05:49.636927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1196/2377] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Jul 28 04:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:05:49.662630 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db217548-bb6a-4519-8f87-4733f097ec60 service swift] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:05:49.717325 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db217548-bb6a-4519-8f87-4733f097ec60 service swift] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:05:49.765070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4762e65-121e-4046-9284-7e11c940d880 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:05:49.766500 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4762e65-121e-4046-9284-7e11c940d880 service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:49.767890 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4762e65-121e-4046-9284-7e11c940d880 service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:49.768721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4762e65-121e-4046-9284-7e11c940d880 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:49.830241 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4762e65-121e-4046-9284-7e11c940d880 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:05:49.834446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4762e65-121e-4046-9284-7e11c940d880 service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:05:49.867631 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1182/2378] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:05:54.124097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f96d7d-fbd7-4dd8-a55f-2e9309d7a486 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:54.127083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f96d7d-fbd7-4dd8-a55f-2e9309d7a486 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:54.127838 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f96d7d-fbd7-4dd8-a55f-2e9309d7a486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:54.163544 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=80 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:54.191568 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-58f96d7d-fbd7-4dd8-a55f-2e9309d7a486 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:05:54.192886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-58f96d7d-fbd7-4dd8-a55f-2e9309d7a486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:05:54.217923 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1197/2379] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Jul 28 04:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:05:54.236784 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4762e65-121e-4046-9284-7e11c940d880 service nova] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:05:54.258126 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4762e65-121e-4046-9284-7e11c940d880 service nova] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:05:54.270287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed993d-4b68-4d9a-9b5d-2ea017d14aad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:05:54.271301 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed993d-4b68-4d9a-9b5d-2ea017d14aad service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:54.271874 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed993d-4b68-4d9a-9b5d-2ea017d14aad service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:54.272323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed993d-4b68-4d9a-9b5d-2ea017d14aad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:54.283667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed993d-4b68-4d9a-9b5d-2ea017d14aad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:05:54.285752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed993d-4b68-4d9a-9b5d-2ea017d14aad service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:05:54.304491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1183/2380] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:05:59.594090 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086a4eb-4742-4a34-b2af-7b38fcdb0cb0 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:59.595456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086a4eb-4742-4a34-b2af-7b38fcdb0cb0 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:59.595456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086a4eb-4742-4a34-b2af-7b38fcdb0cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:59.628579 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-0086a4eb-4742-4a34-b2af-7b38fcdb0cb0 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:05:59.629959 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-0086a4eb-4742-4a34-b2af-7b38fcdb0cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:05:59.643415 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1198/2381] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Jul 28 04:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:05:59.684354 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed993d-4b68-4d9a-9b5d-2ea017d14aad service nova] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:05:59.685987 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-08ed993d-4b68-4d9a-9b5d-2ea017d14aad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:05:59.704742 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed993d-4b68-4d9a-9b5d-2ea017d14aad service nova] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:05:59.711353 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15485315-4e76-4271-a320-f8e06bb4f7c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:05:59.712054 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15485315-4e76-4271-a320-f8e06bb4f7c3 service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:05:59.712394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15485315-4e76-4271-a320-f8e06bb4f7c3 service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:05:59.712718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15485315-4e76-4271-a320-f8e06bb4f7c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:05:59.723400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15485315-4e76-4271-a320-f8e06bb4f7c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:05:59.725078 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15485315-4e76-4271-a320-f8e06bb4f7c3 service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:05:59.735809 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1184/2382] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:06:08.266376 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331b277-2438-4707-918b-284ebb855bc4 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:08.267000 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331b277-2438-4707-918b-284ebb855bc4 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:08.267608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331b277-2438-4707-918b-284ebb855bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:08.287277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-e331b277-2438-4707-918b-284ebb855bc4 None None] MFA Rules not processed for user `420e2a81b66a470e8db624efd61fd1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:06:08.288571 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e331b277-2438-4707-918b-284ebb855bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:08.295914 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1199/2383] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 28 04:06:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:06:08.309415 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15485315-4e76-4271-a320-f8e06bb4f7c3 service nova] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:06:08.321670 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15485315-4e76-4271-a320-f8e06bb4f7c3 service nova] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:06:08.327137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de39da-7c8e-4965-ac7f-a8f35d028792 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382ff6087bf4486d8651162880825eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:06:08.327803 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de39da-7c8e-4965-ac7f-a8f35d028792 service swift] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:08.328088 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de39da-7c8e-4965-ac7f-a8f35d028792 service swift] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:08.328366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de39da-7c8e-4965-ac7f-a8f35d028792 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:08.338294 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de39da-7c8e-4965-ac7f-a8f35d028792 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:06:08.340026 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de39da-7c8e-4965-ac7f-a8f35d028792 service swift] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:06:08.350749 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1185/2384] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 28 04:06:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 04:06:11.805231 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cc245-9768-49cb-9671-701ec0a41963 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:11.806044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cc245-9768-49cb-9671-701ec0a41963 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:11.806044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cc245-9768-49cb-9671-701ec0a41963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:11.833183 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-e20cc245-9768-49cb-9671-701ec0a41963 None None] MFA Rules not processed for user `707c80130c7243729f8bc6cddf2dfbf0`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:06:11.834428 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e20cc245-9768-49cb-9671-701ec0a41963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:11.905713 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1200/2385] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:06:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:06:12.083754 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308535cc-1b9b-4a1e-a941-28765f5e491d None None] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:12.084298 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308535cc-1b9b-4a1e-a941-28765f5e491d None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:12.084298 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308535cc-1b9b-4a1e-a941-28765f5e491d None None] PATH_INFO: `/` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:12.085734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1186/2386] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 28 04:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 04:06:12.123820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21275a8-f124-408c-bcde-6a7ee2489907 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:12.124806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21275a8-f124-408c-bcde-6a7ee2489907 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:12.125584 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21275a8-f124-408c-bcde-6a7ee2489907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:12.172183 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-c21275a8-f124-408c-bcde-6a7ee2489907 None None] MFA Rules not processed for user `e91f2584622a48bba21e1bf31c1aef30`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:06:12.173485 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c21275a8-f124-408c-bcde-6a7ee2489907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:12.184187 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1201/2387] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 28 04:06:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:06:12.197391 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308535cc-1b9b-4a1e-a941-28765f5e491d None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:06:12.213033 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308535cc-1b9b-4a1e-a941-28765f5e491d None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:06:12.224798 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d0112-7660-408f-8720-382493c8815f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f2584622a48bba21e1bf31c1aef30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:06:12.225914 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d0112-7660-408f-8720-382493c8815f service placement] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:12.226359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d0112-7660-408f-8720-382493c8815f service placement] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:12.226833 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d0112-7660-408f-8720-382493c8815f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:12.241018 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d0112-7660-408f-8720-382493c8815f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:06:12.242648 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d0112-7660-408f-8720-382493c8815f service placement] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:06:12.258827 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1187/2388] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:06:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:06:12.273629 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21275a8-f124-408c-bcde-6a7ee2489907 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:06:12.275972 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c21275a8-f124-408c-bcde-6a7ee2489907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:12.302333 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21275a8-f124-408c-bcde-6a7ee2489907 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:06:12.317885 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5249157-c526-45a4-946f-cf5ea99b03ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:06:12.318683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5249157-c526-45a4-946f-cf5ea99b03ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:12.319154 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5249157-c526-45a4-946f-cf5ea99b03ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:12.319683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5249157-c526-45a4-946f-cf5ea99b03ce admin admin] PATH_INFO: `/v3/users/135e59d1a0134ef1887224bb86701071` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:12.322919 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5249157-c526-45a4-946f-cf5ea99b03ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=135e59d1a0134ef1887224bb86701071)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:06:12.326283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5249157-c526-45a4-946f-cf5ea99b03ce admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:06:12.523299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b5249157-c526-45a4-946f-cf5ea99b03ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '135e59d1a0134ef1887224bb86701071'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:06:12.525369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b5249157-c526-45a4-946f-cf5ea99b03ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '135e59d1a0134ef1887224bb86701071'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:06:12.634669 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b5249157-c526-45a4-946f-cf5ea99b03ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '135e59d1a0134ef1887224bb86701071'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:06:12.652827 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b5249157-c526-45a4-946f-cf5ea99b03ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '135e59d1a0134ef1887224bb86701071'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:06:12.667788 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b5249157-c526-45a4-946f-cf5ea99b03ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '135e59d1a0134ef1887224bb86701071'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:06:12.679839 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1202/2389] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:06:12 2022] DELETE /identity/v3/users/135e59d1a0134ef1887224bb86701071 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:06:13.067608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d0112-7660-408f-8720-382493c8815f service placement] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:06:13.074325 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d0112-7660-408f-8720-382493c8815f service placement] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:06:13.183853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cba36-6f76-4942-9775-da67b7c5c73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:06:13.187838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cba36-6f76-4942-9775-da67b7c5c73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:13.188627 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cba36-6f76-4942-9775-da67b7c5c73b admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:13.191465 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cba36-6f76-4942-9775-da67b7c5c73b admin admin] PATH_INFO: `/v3/projects/47eceea474774665a1c4429466dadfd8` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:13.196797 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cba36-6f76-4942-9775-da67b7c5c73b admin admin] RBAC: Authorizing `identity:delete_project(project_id=47eceea474774665a1c4429466dadfd8)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:06:13.203810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cba36-6f76-4942-9775-da67b7c5c73b admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:06:13.356314 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-234cba36-6f76-4942-9775-da67b7c5c73b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47eceea474774665a1c4429466dadfd8', 'request_id': 'req-234cba36-6f76-4942-9775-da67b7c5c73b'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:06:13.366332 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-234cba36-6f76-4942-9775-da67b7c5c73b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47eceea474774665a1c4429466dadfd8', 'request_id': 'req-234cba36-6f76-4942-9775-da67b7c5c73b'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:06:13.379419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-234cba36-6f76-4942-9775-da67b7c5c73b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47eceea474774665a1c4429466dadfd8', 'request_id': 'req-234cba36-6f76-4942-9775-da67b7c5c73b'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:06:13.514881 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-234cba36-6f76-4942-9775-da67b7c5c73b admin admin] The token cache is being invalidate because project 47eceea474774665a1c4429466dadfd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:06:13.515418 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-234cba36-6f76-4942-9775-da67b7c5c73b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:06:13.518171 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-234cba36-6f76-4942-9775-da67b7c5c73b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:06:13.529656 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6e76b-993c-4b0d-8a91-6e14c00dacaf None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:13.530362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6e76b-993c-4b0d-8a91-6e14c00dacaf None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:13.531611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6e76b-993c-4b0d-8a91-6e14c00dacaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:13.538220 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1188/2390] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:06:13 2022] DELETE /identity/v3/projects/47eceea474774665a1c4429466dadfd8 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:06:13.572824 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-b9d6e76b-993c-4b0d-8a91-6e14c00dacaf None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:06:13.575003 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b9d6e76b-993c-4b0d-8a91-6e14c00dacaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:13.674807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:13.701153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1203/2391] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:06:13.772179 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6677cae-e71d-4569-9e83-ac8e2da4beed None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:13.772582 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6677cae-e71d-4569-9e83-ac8e2da4beed None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:13.773016 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6677cae-e71d-4569-9e83-ac8e2da4beed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:13.804453 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-b6677cae-e71d-4569-9e83-ac8e2da4beed None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:06:13.805768 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b6677cae-e71d-4569-9e83-ac8e2da4beed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:13.820307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1189/2392] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:06:13.824821 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6e76b-993c-4b0d-8a91-6e14c00dacaf None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:06:13.836672 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6e76b-993c-4b0d-8a91-6e14c00dacaf None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:06:13.841508 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cdc85-3277-434f-9800-e8691462b219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:06:13.842146 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cdc85-3277-434f-9800-e8691462b219 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:13.842423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cdc85-3277-434f-9800-e8691462b219 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:13.842695 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cdc85-3277-434f-9800-e8691462b219 admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:13.843465 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cdc85-3277-434f-9800-e8691462b219 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:06:13.843770 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cdc85-3277-434f-9800-e8691462b219 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:06:13.845414 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95cdc85-3277-434f-9800-e8691462b219 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:06:13.862594 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1204/2393] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:06:13.867233 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6677cae-e71d-4569-9e83-ac8e2da4beed None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:06:13.882497 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6677cae-e71d-4569-9e83-ac8e2da4beed None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:06:13.887982 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a79b47-72ea-4f45-b951-3134adea75d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:06:13.888465 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a79b47-72ea-4f45-b951-3134adea75d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:13.888751 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a79b47-72ea-4f45-b951-3134adea75d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:13.889210 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a79b47-72ea-4f45-b951-3134adea75d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:13.889908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a79b47-72ea-4f45-b951-3134adea75d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:06:13.891907 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a79b47-72ea-4f45-b951-3134adea75d4 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:06:13.903659 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:14.030894 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1190/2394] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:06:13 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:06:14.035748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cdc85-3277-434f-9800-e8691462b219 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:06:14.046746 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cdc85-3277-434f-9800-e8691462b219 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:06:14.144745 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c6862-48bf-4ad5-8f0f-eb17738d5158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:06:14.145417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c6862-48bf-4ad5-8f0f-eb17738d5158 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:14.145705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c6862-48bf-4ad5-8f0f-eb17738d5158 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:14.145984 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c6862-48bf-4ad5-8f0f-eb17738d5158 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:14.146761 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c6862-48bf-4ad5-8f0f-eb17738d5158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:06:14.149047 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c6862-48bf-4ad5-8f0f-eb17738d5158 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:06:14.299049 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1205/2395] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:06:14 2022] POST /identity/v3/users => generated 285 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:06:14.304038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a79b47-72ea-4f45-b951-3134adea75d4 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:06:14.315942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a79b47-72ea-4f45-b951-3134adea75d4 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:06:14.321081 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b058b78-6f0f-4a47-885b-c29e57a655d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:06:14.321778 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b058b78-6f0f-4a47-885b-c29e57a655d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:14.325877 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b058b78-6f0f-4a47-885b-c29e57a655d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:14.325877 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b058b78-6f0f-4a47-885b-c29e57a655d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:14.325877 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b058b78-6f0f-4a47-885b-c29e57a655d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:06:14.325877 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b058b78-6f0f-4a47-885b-c29e57a655d4 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:06:14.337115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1191/2396] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:06:14.342379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c6862-48bf-4ad5-8f0f-eb17738d5158 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:06:14.355959 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c6862-48bf-4ad5-8f0f-eb17738d5158 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:06:14.361150 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440b314-d65b-4b9e-9a1c-09e706ac3605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:06:14.361890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440b314-d65b-4b9e-9a1c-09e706ac3605 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:14.362175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440b314-d65b-4b9e-9a1c-09e706ac3605 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:14.362446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440b314-d65b-4b9e-9a1c-09e706ac3605 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:14.363217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440b314-d65b-4b9e-9a1c-09e706ac3605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:06:14.365024 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440b314-d65b-4b9e-9a1c-09e706ac3605 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:06:14.378270 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1206/2397] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:06:14.382984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b058b78-6f0f-4a47-885b-c29e57a655d4 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:06:14.397893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b058b78-6f0f-4a47-885b-c29e57a655d4 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:06:14.402951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd42d3a-63de-429a-a9b3-5cf6d6b5bd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:06:14.403679 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd42d3a-63de-429a-a9b3-5cf6d6b5bd61 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:14.403959 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd42d3a-63de-429a-a9b3-5cf6d6b5bd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:14.404232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd42d3a-63de-429a-a9b3-5cf6d6b5bd61 admin admin] PATH_INFO: `/v3/projects/f2f0b13f1cb4452caf15eee97f0f85d9/users/128da21f7e2147d6b6c40eafc9323296/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:14.434474 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd42d3a-63de-429a-a9b3-5cf6d6b5bd61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f0b13f1cb4452caf15eee97f0f85d9, user_id=128da21f7e2147d6b6c40eafc9323296, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:06:14.438565 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd42d3a-63de-429a-a9b3-5cf6d6b5bd61 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:06:14.527783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1192/2398] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:06:14 2022] PUT /identity/v3/projects/f2f0b13f1cb4452caf15eee97f0f85d9/users/128da21f7e2147d6b6c40eafc9323296/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:06:14.549556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca81619-5aec-4104-a80f-726de7809b0f None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:14.549556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca81619-5aec-4104-a80f-726de7809b0f None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:14.549556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca81619-5aec-4104-a80f-726de7809b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:14.578504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-fca81619-5aec-4104-a80f-726de7809b0f None None] MFA Rules not processed for user `128da21f7e2147d6b6c40eafc9323296`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:06:14.579928 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-fca81619-5aec-4104-a80f-726de7809b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:14.663489 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1207/2399] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:06:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:06:14.682195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd42d3a-63de-429a-a9b3-5cf6d6b5bd61 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:06:14.684449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-6fd42d3a-63de-429a-a9b3-5cf6d6b5bd61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:14.763449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd42d3a-63de-429a-a9b3-5cf6d6b5bd61 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:06:14.770074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e98f4c-b5b1-4863-bb0b-3981b79fb4c7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bfc1fe981424313aecce5af443c8a9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:06:14.771112 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e98f4c-b5b1-4863-bb0b-3981b79fb4c7 service glance] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:14.771548 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e98f4c-b5b1-4863-bb0b-3981b79fb4c7 service glance] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:14.771999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e98f4c-b5b1-4863-bb0b-3981b79fb4c7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:14.788689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e98f4c-b5b1-4863-bb0b-3981b79fb4c7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:06:14.791487 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e98f4c-b5b1-4863-bb0b-3981b79fb4c7 service glance] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:06:14.807844 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1193/2400] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:06:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:06:20.551104 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cdd17-89b7-46c7-bc2a-fcbc6ce05dfd None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:20.551908 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cdd17-89b7-46c7-bc2a-fcbc6ce05dfd None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:20.551908 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cdd17-89b7-46c7-bc2a-fcbc6ce05dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:20.581698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-3d6cdd17-89b7-46c7-bc2a-fcbc6ce05dfd None None] MFA Rules not processed for user `99264a023d9946e28b470d6c692e62ea`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:06:20.582652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-3d6cdd17-89b7-46c7-bc2a-fcbc6ce05dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:20.640689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:20.657488 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1208/2401] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:06:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:06:24.801406 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=45,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:30.711218 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:33.715137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a5387-9cbb-45b8-a4e1-f33cdfb9b306 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:33.715790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a5387-9cbb-45b8-a4e1-f33cdfb9b306 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:33.715790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a5387-9cbb-45b8-a4e1-f33cdfb9b306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:33.737271 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-0e8a5387-9cbb-45b8-a4e1-f33cdfb9b306 None None] MFA Rules not processed for user `414b0f1addcc487fb2834b16d7047923`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:06:33.744616 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0e8a5387-9cbb-45b8-a4e1-f33cdfb9b306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:33.816845 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1194/2402] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:06:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:06:42.773398 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba5dd7-1ecb-4d54-a7ee-95f464b80e6a None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:42.774094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba5dd7-1ecb-4d54-a7ee-95f464b80e6a None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:42.774094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba5dd7-1ecb-4d54-a7ee-95f464b80e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:42.799649 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-5aba5dd7-1ecb-4d54-a7ee-95f464b80e6a None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:06:42.801812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-5aba5dd7-1ecb-4d54-a7ee-95f464b80e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:42.873585 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1209/2403] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Jul 28 04:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:06:42.898960 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a5387-9cbb-45b8-a4e1-f33cdfb9b306 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:06:42.902163 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0e8a5387-9cbb-45b8-a4e1-f33cdfb9b306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:43.004085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a5387-9cbb-45b8-a4e1-f33cdfb9b306 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:06:43.011178 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f7601-491f-44d9-be72-12a1df4a3755 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:06:43.011869 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f7601-491f-44d9-be72-12a1df4a3755 service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:43.012331 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f7601-491f-44d9-be72-12a1df4a3755 service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:43.012634 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f7601-491f-44d9-be72-12a1df4a3755 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:43.023297 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f7601-491f-44d9-be72-12a1df4a3755 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:06:43.025044 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f7601-491f-44d9-be72-12a1df4a3755 service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:06:43.036296 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1195/2404] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:06:44.825767 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba5dd7-1ecb-4d54-a7ee-95f464b80e6a None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:06:44.837108 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba5dd7-1ecb-4d54-a7ee-95f464b80e6a None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:06:44.841865 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627bd0a-002c-4ab9-ab71-a782e345e0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:06:44.842525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627bd0a-002c-4ab9-ab71-a782e345e0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:44.842808 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627bd0a-002c-4ab9-ab71-a782e345e0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:44.843086 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627bd0a-002c-4ab9-ab71-a782e345e0ae admin admin] PATH_INFO: `/v3/users/128da21f7e2147d6b6c40eafc9323296` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:44.844302 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627bd0a-002c-4ab9-ab71-a782e345e0ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=128da21f7e2147d6b6c40eafc9323296)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:06:44.846333 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627bd0a-002c-4ab9-ab71-a782e345e0ae admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:06:45.094426 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-c627bd0a-002c-4ab9-ab71-a782e345e0ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '128da21f7e2147d6b6c40eafc9323296'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:06:45.095100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-c627bd0a-002c-4ab9-ab71-a782e345e0ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '128da21f7e2147d6b6c40eafc9323296'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:06:45.205458 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-c627bd0a-002c-4ab9-ab71-a782e345e0ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '128da21f7e2147d6b6c40eafc9323296'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:06:45.223235 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-c627bd0a-002c-4ab9-ab71-a782e345e0ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '128da21f7e2147d6b6c40eafc9323296'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:06:45.231434 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-c627bd0a-002c-4ab9-ab71-a782e345e0ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '128da21f7e2147d6b6c40eafc9323296'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:06:45.238296 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1210/2405] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:06:44 2022] DELETE /identity/v3/users/128da21f7e2147d6b6c40eafc9323296 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:06:45.243168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5b6dd-049b-4558-9ed2-9e62395e9113 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:45.243706 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5b6dd-049b-4558-9ed2-9e62395e9113 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:45.243829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5b6dd-049b-4558-9ed2-9e62395e9113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:45.265338 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-98d5b6dd-049b-4558-9ed2-9e62395e9113 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:06:45.266652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-98d5b6dd-049b-4558-9ed2-9e62395e9113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:45.332004 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1196/2406] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:06:45.341708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627bd0a-002c-4ab9-ab71-a782e345e0ae admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:06:45.343305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c627bd0a-002c-4ab9-ab71-a782e345e0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:45.435455 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627bd0a-002c-4ab9-ab71-a782e345e0ae admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:06:45.439374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530b2d2-533e-49bc-86cf-f3e3400d27d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:06:45.440077 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530b2d2-533e-49bc-86cf-f3e3400d27d7 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:45.441064 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530b2d2-533e-49bc-86cf-f3e3400d27d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:45.441451 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530b2d2-533e-49bc-86cf-f3e3400d27d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:45.451617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530b2d2-533e-49bc-86cf-f3e3400d27d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:06:45.453079 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530b2d2-533e-49bc-86cf-f3e3400d27d7 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:06:45.464403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1211/2407] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:06:46.037924 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5b6dd-049b-4558-9ed2-9e62395e9113 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:06:46.039473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-98d5b6dd-049b-4558-9ed2-9e62395e9113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:46.052627 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5b6dd-049b-4558-9ed2-9e62395e9113 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:06:46.067937 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8802f-6216-4fca-8ccc-e739db8cabb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:06:46.068628 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8802f-6216-4fca-8ccc-e739db8cabb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:46.068914 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8802f-6216-4fca-8ccc-e739db8cabb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:46.069194 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8802f-6216-4fca-8ccc-e739db8cabb3 admin admin] PATH_INFO: `/v3/projects/f2f0b13f1cb4452caf15eee97f0f85d9` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:46.070598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8802f-6216-4fca-8ccc-e739db8cabb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f0b13f1cb4452caf15eee97f0f85d9)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:06:46.072696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8802f-6216-4fca-8ccc-e739db8cabb3 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:06:46.198263 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:46.215698 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0ec8802f-6216-4fca-8ccc-e739db8cabb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f0b13f1cb4452caf15eee97f0f85d9', 'request_id': 'req-0ec8802f-6216-4fca-8ccc-e739db8cabb3'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:06:46.223389 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0ec8802f-6216-4fca-8ccc-e739db8cabb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f0b13f1cb4452caf15eee97f0f85d9', 'request_id': 'req-0ec8802f-6216-4fca-8ccc-e739db8cabb3'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:06:46.229459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0ec8802f-6216-4fca-8ccc-e739db8cabb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f0b13f1cb4452caf15eee97f0f85d9', 'request_id': 'req-0ec8802f-6216-4fca-8ccc-e739db8cabb3'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:06:46.293129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0ec8802f-6216-4fca-8ccc-e739db8cabb3 admin admin] The token cache is being invalidate because project f2f0b13f1cb4452caf15eee97f0f85d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:06:46.293911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0ec8802f-6216-4fca-8ccc-e739db8cabb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:06:46.294347 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0ec8802f-6216-4fca-8ccc-e739db8cabb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:06:46.296013 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1197/2408] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:06:46 2022] DELETE /identity/v3/projects/f2f0b13f1cb4452caf15eee97f0f85d9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:06:49.381754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d998184-7454-4e72-aa5d-1ef1eee957ce None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:49.382279 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d998184-7454-4e72-aa5d-1ef1eee957ce None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:49.382279 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d998184-7454-4e72-aa5d-1ef1eee957ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:49.405114 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-9d998184-7454-4e72-aa5d-1ef1eee957ce None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:06:49.406360 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9d998184-7454-4e72-aa5d-1ef1eee957ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:49.417453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:49.486475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1212/2409] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Jul 28 04:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:06:49.505250 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8802f-6216-4fca-8ccc-e739db8cabb3 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:06:49.507150 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0ec8802f-6216-4fca-8ccc-e739db8cabb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:49.599749 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8802f-6216-4fca-8ccc-e739db8cabb3 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:06:49.606308 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5ac89-5cab-49d0-8d0d-1dfe28787b0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:06:49.606946 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5ac89-5cab-49d0-8d0d-1dfe28787b0f service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:49.607231 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5ac89-5cab-49d0-8d0d-1dfe28787b0f service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:49.607562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5ac89-5cab-49d0-8d0d-1dfe28787b0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:49.617891 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5ac89-5cab-49d0-8d0d-1dfe28787b0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:06:49.619578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5ac89-5cab-49d0-8d0d-1dfe28787b0f service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:06:49.630592 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1198/2410] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:06:54.353581 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8998f6-074b-4cf2-b1f9-f5a4e53db6da None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:54.354134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8998f6-074b-4cf2-b1f9-f5a4e53db6da None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:54.354134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8998f6-074b-4cf2-b1f9-f5a4e53db6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:54.375009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-7b8998f6-074b-4cf2-b1f9-f5a4e53db6da None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:06:54.376270 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-7b8998f6-074b-4cf2-b1f9-f5a4e53db6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:54.384612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1213/2411] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Jul 28 04:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:06:54.407220 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5ac89-5cab-49d0-8d0d-1dfe28787b0f service nova] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:06:54.408725 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-3cc5ac89-5cab-49d0-8d0d-1dfe28787b0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:54.424707 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5ac89-5cab-49d0-8d0d-1dfe28787b0f service nova] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:06:54.430424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf437d-1e35-4137-abd4-69899f4ad66a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:06:54.431447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf437d-1e35-4137-abd4-69899f4ad66a service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:54.431447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf437d-1e35-4137-abd4-69899f4ad66a service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:54.431739 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf437d-1e35-4137-abd4-69899f4ad66a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:54.440536 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf437d-1e35-4137-abd4-69899f4ad66a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:06:54.442165 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf437d-1e35-4137-abd4-69899f4ad66a service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:06:54.452589 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1199/2412] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:06:55.491114 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75c45a-eb7b-453a-8a55-e126c02b9818 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:55.491735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75c45a-eb7b-453a-8a55-e126c02b9818 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:55.491735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75c45a-eb7b-453a-8a55-e126c02b9818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:55.511948 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-7a75c45a-eb7b-453a-8a55-e126c02b9818 None None] MFA Rules not processed for user `239971f05a0b4ba4874c167c26927c98`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:06:55.513143 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-7a75c45a-eb7b-453a-8a55-e126c02b9818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:55.570454 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1214/2413] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:06:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:06:57.655258 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcf685-afc0-44cf-bed9-8febac571a6e None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:57.655880 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcf685-afc0-44cf-bed9-8febac571a6e None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:57.655988 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcf685-afc0-44cf-bed9-8febac571a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:57.681545 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-e0dcf685-afc0-44cf-bed9-8febac571a6e None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:06:57.682808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e0dcf685-afc0-44cf-bed9-8febac571a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:06:57.692145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1200/2414] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Jul 28 04:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:06:57.718128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75c45a-eb7b-453a-8a55-e126c02b9818 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:06:57.733398 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75c45a-eb7b-453a-8a55-e126c02b9818 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:06:57.740561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f05ab7-8a5d-47c7-b581-0c2c0c90cc1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:06:57.741212 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f05ab7-8a5d-47c7-b581-0c2c0c90cc1c service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:06:57.747230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f05ab7-8a5d-47c7-b581-0c2c0c90cc1c service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:06:57.747230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f05ab7-8a5d-47c7-b581-0c2c0c90cc1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:06:57.751186 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f05ab7-8a5d-47c7-b581-0c2c0c90cc1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:06:57.753530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f05ab7-8a5d-47c7-b581-0c2c0c90cc1c service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:06:57.764911 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1215/2415] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:07:01.981882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74997e40-4d7b-4bbc-b8f4-c3d39f86410b None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:01.982349 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74997e40-4d7b-4bbc-b8f4-c3d39f86410b None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:01.982588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74997e40-4d7b-4bbc-b8f4-c3d39f86410b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:02.006410 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-74997e40-4d7b-4bbc-b8f4-c3d39f86410b None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:07:02.007794 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-74997e40-4d7b-4bbc-b8f4-c3d39f86410b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:02.017324 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1201/2416] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Jul 28 04:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:07:02.034909 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f05ab7-8a5d-47c7-b581-0c2c0c90cc1c service nova] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:02.048639 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f05ab7-8a5d-47c7-b581-0c2c0c90cc1c service nova] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:02.055810 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78699f47-731e-47a9-b904-da50d95fe0ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:02.057393 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78699f47-731e-47a9-b904-da50d95fe0ee service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:02.057891 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78699f47-731e-47a9-b904-da50d95fe0ee service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:02.058333 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78699f47-731e-47a9-b904-da50d95fe0ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:02.068612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78699f47-731e-47a9-b904-da50d95fe0ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:02.070380 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78699f47-731e-47a9-b904-da50d95fe0ee service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:02.087210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1216/2417] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:07:11.998493 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:DELETE=6,keystone:SELECT=60,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:12.076720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=60 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:19.834704 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74997e40-4d7b-4bbc-b8f4-c3d39f86410b None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:19.836345 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-74997e40-4d7b-4bbc-b8f4-c3d39f86410b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:19.895849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74997e40-4d7b-4bbc-b8f4-c3d39f86410b None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:19.900201 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0dd993-9fc7-4187-9820-81332a5059f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:19.900849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dd993-9fc7-4187-9820-81332a5059f3 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:19.901135 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dd993-9fc7-4187-9820-81332a5059f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:19.901410 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dd993-9fc7-4187-9820-81332a5059f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:19.903183 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ea0dd993-9fc7-4187-9820-81332a5059f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:19.918563 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0dd993-9fc7-4187-9820-81332a5059f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:19.920017 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0dd993-9fc7-4187-9820-81332a5059f3 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:19.932414 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1202/2418] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:07:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:07:20.360545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78699f47-731e-47a9-b904-da50d95fe0ee service nova] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:20.362189 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-78699f47-731e-47a9-b904-da50d95fe0ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:20.432280 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78699f47-731e-47a9-b904-da50d95fe0ee service nova] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:20.435836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7f635-1a83-41ca-928f-63769d339803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:20.436691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7f635-1a83-41ca-928f-63769d339803 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:20.437421 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7f635-1a83-41ca-928f-63769d339803 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:20.437421 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7f635-1a83-41ca-928f-63769d339803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:20.439421 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-03a7f635-1a83-41ca-928f-63769d339803 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:20.461473 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7f635-1a83-41ca-928f-63769d339803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:20.463086 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7f635-1a83-41ca-928f-63769d339803 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:20.477969 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1217/2419] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:07:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:07:29.927129 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=26 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:30.470501 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=26 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:36.824037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0dd993-9fc7-4187-9820-81332a5059f3 service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:36.825675 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ea0dd993-9fc7-4187-9820-81332a5059f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:36.839757 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0dd993-9fc7-4187-9820-81332a5059f3 service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:36.844265 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb006f-6673-4001-aaf8-e3290a1be28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:36.844908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb006f-6673-4001-aaf8-e3290a1be28e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:36.845187 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb006f-6673-4001-aaf8-e3290a1be28e admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:36.845463 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb006f-6673-4001-aaf8-e3290a1be28e admin admin] PATH_INFO: `/v3/users/99264a023d9946e28b470d6c692e62ea` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:36.846615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb006f-6673-4001-aaf8-e3290a1be28e admin admin] RBAC: Authorizing `identity:delete_user(user_id=99264a023d9946e28b470d6c692e62ea)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:36.848558 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb006f-6673-4001-aaf8-e3290a1be28e admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:37.008424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-36bb006f-6673-4001-aaf8-e3290a1be28e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99264a023d9946e28b470d6c692e62ea'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:07:37.009007 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-36bb006f-6673-4001-aaf8-e3290a1be28e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99264a023d9946e28b470d6c692e62ea'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:07:37.074586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-36bb006f-6673-4001-aaf8-e3290a1be28e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99264a023d9946e28b470d6c692e62ea'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:07:37.084182 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-36bb006f-6673-4001-aaf8-e3290a1be28e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99264a023d9946e28b470d6c692e62ea'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:07:37.096870 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-36bb006f-6673-4001-aaf8-e3290a1be28e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99264a023d9946e28b470d6c692e62ea'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:07:37.103579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1203/2420] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:07:36 2022] DELETE /identity/v3/users/99264a023d9946e28b470d6c692e62ea => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:07:37.184759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7f635-1a83-41ca-928f-63769d339803 service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:37.196131 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7f635-1a83-41ca-928f-63769d339803 service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:37.273347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bd05e-940f-454e-9280-d06a9b247e37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:37.276762 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bd05e-940f-454e-9280-d06a9b247e37 service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:37.277842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bd05e-940f-454e-9280-d06a9b247e37 service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:37.280712 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bd05e-940f-454e-9280-d06a9b247e37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:37.282224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d01bd05e-940f-454e-9280-d06a9b247e37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:37.348798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01bd05e-940f-454e-9280-d06a9b247e37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:37.350435 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01bd05e-940f-454e-9280-d06a9b247e37 service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:37.360859 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1218/2421] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:07:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:07:37.385380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb006f-6673-4001-aaf8-e3290a1be28e admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:37.387610 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-36bb006f-6673-4001-aaf8-e3290a1be28e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:37.473233 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb006f-6673-4001-aaf8-e3290a1be28e admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:37.479745 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ff208-b508-44d0-a1d9-1d01db6441b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:37.483975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ff208-b508-44d0-a1d9-1d01db6441b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:37.483975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ff208-b508-44d0-a1d9-1d01db6441b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:37.483975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ff208-b508-44d0-a1d9-1d01db6441b1 admin admin] PATH_INFO: `/v3/projects/fde782ca362f48389124c4b39dac53ee` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:37.483975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ff208-b508-44d0-a1d9-1d01db6441b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fde782ca362f48389124c4b39dac53ee)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:37.484366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ff208-b508-44d0-a1d9-1d01db6441b1 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:37.604072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-3e4ff208-b508-44d0-a1d9-1d01db6441b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde782ca362f48389124c4b39dac53ee', 'request_id': 'req-3e4ff208-b508-44d0-a1d9-1d01db6441b1'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:07:37.610807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-3e4ff208-b508-44d0-a1d9-1d01db6441b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde782ca362f48389124c4b39dac53ee', 'request_id': 'req-3e4ff208-b508-44d0-a1d9-1d01db6441b1'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:07:37.616576 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-3e4ff208-b508-44d0-a1d9-1d01db6441b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde782ca362f48389124c4b39dac53ee', 'request_id': 'req-3e4ff208-b508-44d0-a1d9-1d01db6441b1'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:07:37.732151 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-3e4ff208-b508-44d0-a1d9-1d01db6441b1 admin admin] The token cache is being invalidate because project fde782ca362f48389124c4b39dac53ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:07:37.732621 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-3e4ff208-b508-44d0-a1d9-1d01db6441b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:07:37.733992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-3e4ff208-b508-44d0-a1d9-1d01db6441b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:07:37.737332 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1204/2422] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:07:37 2022] DELETE /identity/v3/projects/fde782ca362f48389124c4b39dac53ee => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:07:37.744341 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb5ed6-1e53-466d-8452-d2dd6492cf18 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:37.744634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb5ed6-1e53-466d-8452-d2dd6492cf18 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:37.745114 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb5ed6-1e53-466d-8452-d2dd6492cf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:37.766054 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-78fb5ed6-1e53-466d-8452-d2dd6492cf18 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:07:37.767236 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-78fb5ed6-1e53-466d-8452-d2dd6492cf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:37.846290 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1219/2423] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:07:37.862362 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebb1a3-cd5a-400d-966a-645366dc9dee None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:37.862954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebb1a3-cd5a-400d-966a-645366dc9dee None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:37.862954 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebb1a3-cd5a-400d-966a-645366dc9dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:37.871339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:37.884586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-31ebb1a3-cd5a-400d-966a-645366dc9dee None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:07:37.886006 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-31ebb1a3-cd5a-400d-966a-645366dc9dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:37.894434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1205/2424] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:07:37.898648 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb5ed6-1e53-466d-8452-d2dd6492cf18 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:37.909712 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb5ed6-1e53-466d-8452-d2dd6492cf18 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:37.914258 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486be5d-61df-487b-b4ae-fa55c45bca9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:37.914972 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486be5d-61df-487b-b4ae-fa55c45bca9a admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:37.915253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486be5d-61df-487b-b4ae-fa55c45bca9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:37.915557 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486be5d-61df-487b-b4ae-fa55c45bca9a admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:37.917405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486be5d-61df-487b-b4ae-fa55c45bca9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:07:37.917754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486be5d-61df-487b-b4ae-fa55c45bca9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:37.919378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486be5d-61df-487b-b4ae-fa55c45bca9a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:37.933033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1220/2425] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:07:37.939698 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebb1a3-cd5a-400d-966a-645366dc9dee None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:37.950205 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebb1a3-cd5a-400d-966a-645366dc9dee None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:37.954979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c6e13-ee65-46f5-9040-496202fe6a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:37.955643 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c6e13-ee65-46f5-9040-496202fe6a46 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:37.955928 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c6e13-ee65-46f5-9040-496202fe6a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:37.956364 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c6e13-ee65-46f5-9040-496202fe6a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:37.957021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c6e13-ee65-46f5-9040-496202fe6a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:37.958937 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c6e13-ee65-46f5-9040-496202fe6a46 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:38.072947 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1206/2426] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:07:37 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:07:38.077118 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486be5d-61df-487b-b4ae-fa55c45bca9a admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:38.091120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486be5d-61df-487b-b4ae-fa55c45bca9a admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:38.114415 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:38.158446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a923e0a-d323-4eb6-a9fc-faea1cbc2848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:38.159072 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a923e0a-d323-4eb6-a9fc-faea1cbc2848 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:38.159381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a923e0a-d323-4eb6-a9fc-faea1cbc2848 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:38.159660 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a923e0a-d323-4eb6-a9fc-faea1cbc2848 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:38.160344 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a923e0a-d323-4eb6-a9fc-faea1cbc2848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:38.162283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a923e0a-d323-4eb6-a9fc-faea1cbc2848 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:38.293264 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1221/2427] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:07:38 2022] POST /identity/v3/users => generated 287 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:07:38.297651 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c6e13-ee65-46f5-9040-496202fe6a46 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:38.308242 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c6e13-ee65-46f5-9040-496202fe6a46 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:38.312750 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003167c-bcb4-4251-a029-26b386bc6402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:38.313369 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003167c-bcb4-4251-a029-26b386bc6402 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:38.313652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003167c-bcb4-4251-a029-26b386bc6402 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:38.313926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003167c-bcb4-4251-a029-26b386bc6402 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:38.314626 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003167c-bcb4-4251-a029-26b386bc6402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:38.316263 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003167c-bcb4-4251-a029-26b386bc6402 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:38.327119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1207/2428] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:07:38.331413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a923e0a-d323-4eb6-a9fc-faea1cbc2848 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:38.344736 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a923e0a-d323-4eb6-a9fc-faea1cbc2848 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:38.349678 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcee04c-c5c3-4a53-b5ef-6241b03356a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:38.350320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcee04c-c5c3-4a53-b5ef-6241b03356a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:38.350600 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcee04c-c5c3-4a53-b5ef-6241b03356a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:38.350871 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcee04c-c5c3-4a53-b5ef-6241b03356a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:38.351613 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcee04c-c5c3-4a53-b5ef-6241b03356a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:38.353768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcee04c-c5c3-4a53-b5ef-6241b03356a8 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:38.368478 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1222/2429] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:07:38.370488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003167c-bcb4-4251-a029-26b386bc6402 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:38.383288 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003167c-bcb4-4251-a029-26b386bc6402 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:38.389077 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654b278-ee19-45d7-9e6c-f1a6d8c405b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:38.389785 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654b278-ee19-45d7-9e6c-f1a6d8c405b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:38.390076 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654b278-ee19-45d7-9e6c-f1a6d8c405b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:38.390354 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654b278-ee19-45d7-9e6c-f1a6d8c405b5 admin admin] PATH_INFO: `/v3/projects/86f431550b9542219b6ef4437c98acbb/users/3f0a175f41e74f9bb73303ce748a88dc/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:38.406132 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654b278-ee19-45d7-9e6c-f1a6d8c405b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f431550b9542219b6ef4437c98acbb, user_id=3f0a175f41e74f9bb73303ce748a88dc, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:38.408873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654b278-ee19-45d7-9e6c-f1a6d8c405b5 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:38.499366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1208/2430] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:07:38 2022] PUT /identity/v3/projects/86f431550b9542219b6ef4437c98acbb/users/3f0a175f41e74f9bb73303ce748a88dc/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:07:38.504593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d592f-0a27-4afb-9e86-f7b41e8ac575 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:38.504882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d592f-0a27-4afb-9e86-f7b41e8ac575 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:38.505187 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d592f-0a27-4afb-9e86-f7b41e8ac575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:38.524970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-2e1d592f-0a27-4afb-9e86-f7b41e8ac575 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:07:38.528650 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-2e1d592f-0a27-4afb-9e86-f7b41e8ac575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:38.599884 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1223/2431] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:07:38.614032 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654b278-ee19-45d7-9e6c-f1a6d8c405b5 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:38.616600 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e654b278-ee19-45d7-9e6c-f1a6d8c405b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:38.684795 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654b278-ee19-45d7-9e6c-f1a6d8c405b5 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:38.688859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09cdc8-e9c9-4185-aa78-c9fcb05897c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:38.689818 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09cdc8-e9c9-4185-aa78-c9fcb05897c6 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:38.690275 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09cdc8-e9c9-4185-aa78-c9fcb05897c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:38.690678 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09cdc8-e9c9-4185-aa78-c9fcb05897c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:38.706272 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09cdc8-e9c9-4185-aa78-c9fcb05897c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:38.707754 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09cdc8-e9c9-4185-aa78-c9fcb05897c6 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:38.717257 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1209/2432] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:07:44.917529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d592f-0a27-4afb-9e86-f7b41e8ac575 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:44.958717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d592f-0a27-4afb-9e86-f7b41e8ac575 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:44.973820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49338e4-3877-4367-ad4f-a35527afb278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:44.976027 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49338e4-3877-4367-ad4f-a35527afb278 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:44.976544 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49338e4-3877-4367-ad4f-a35527afb278 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:44.977023 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49338e4-3877-4367-ad4f-a35527afb278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:44.983139 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c49338e4-3877-4367-ad4f-a35527afb278 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:45.001458 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49338e4-3877-4367-ad4f-a35527afb278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:45.005818 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49338e4-3877-4367-ad4f-a35527afb278 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:45.015357 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1224/2433] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:07:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:07:45.484112 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6060fc5-bb33-4c2d-ab7f-b016daaa3fa0 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:45.484866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6060fc5-bb33-4c2d-ab7f-b016daaa3fa0 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:45.484866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6060fc5-bb33-4c2d-ab7f-b016daaa3fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:45.516939 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-f6060fc5-bb33-4c2d-ab7f-b016daaa3fa0 None None] MFA Rules not processed for user `707c80130c7243729f8bc6cddf2dfbf0`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:07:45.530309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f6060fc5-bb33-4c2d-ab7f-b016daaa3fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:45.676876 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1210/2434] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:07:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:07:46.550997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a72b18-519f-407f-aef6-145076bf92b1 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:46.551493 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a72b18-519f-407f-aef6-145076bf92b1 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:46.551603 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a72b18-519f-407f-aef6-145076bf92b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:46.605929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-f6a72b18-519f-407f-aef6-145076bf92b1 None None] MFA Rules not processed for user `3f0a175f41e74f9bb73303ce748a88dc`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:07:46.605929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f6a72b18-519f-407f-aef6-145076bf92b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:46.686275 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1225/2435] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:07:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:07:46.690529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6060fc5-bb33-4c2d-ab7f-b016daaa3fa0 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:46.702028 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6060fc5-bb33-4c2d-ab7f-b016daaa3fa0 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:46.706668 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e237a-0da7-4a1a-ba7d-06c8d66227b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:46.707300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e237a-0da7-4a1a-ba7d-06c8d66227b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:46.707612 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e237a-0da7-4a1a-ba7d-06c8d66227b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:46.707888 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e237a-0da7-4a1a-ba7d-06c8d66227b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:46.708804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e237a-0da7-4a1a-ba7d-06c8d66227b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:46.710706 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e237a-0da7-4a1a-ba7d-06c8d66227b9 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:46.819503 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1211/2436] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:07:46 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:07:46.824216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a72b18-519f-407f-aef6-145076bf92b1 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:46.835593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a72b18-519f-407f-aef6-145076bf92b1 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:46.862388 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:46.914811 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa900e-45c6-44f9-b787-1c737fd53503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:46.916038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa900e-45c6-44f9-b787-1c737fd53503 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:46.916301 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa900e-45c6-44f9-b787-1c737fd53503 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:46.916798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa900e-45c6-44f9-b787-1c737fd53503 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:46.917678 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa900e-45c6-44f9-b787-1c737fd53503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:46.920038 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa900e-45c6-44f9-b787-1c737fd53503 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:47.045379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1226/2437] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:07:46 2022] POST /identity/v3/users => generated 292 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:07:47.049636 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e237a-0da7-4a1a-ba7d-06c8d66227b9 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:47.063413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e237a-0da7-4a1a-ba7d-06c8d66227b9 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:47.072723 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c26dd7-ba49-4842-af3c-be3e926722b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:47.073398 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c26dd7-ba49-4842-af3c-be3e926722b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:47.073695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c26dd7-ba49-4842-af3c-be3e926722b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:47.073914 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c26dd7-ba49-4842-af3c-be3e926722b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:47.074703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c26dd7-ba49-4842-af3c-be3e926722b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:47.076379 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c26dd7-ba49-4842-af3c-be3e926722b5 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:47.090575 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1212/2438] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:07:47.095220 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa900e-45c6-44f9-b787-1c737fd53503 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:47.107763 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa900e-45c6-44f9-b787-1c737fd53503 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:47.113451 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986f853-698f-4a57-a030-44b063e6877d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:47.114204 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986f853-698f-4a57-a030-44b063e6877d admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:47.114520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986f853-698f-4a57-a030-44b063e6877d admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:47.114858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986f853-698f-4a57-a030-44b063e6877d admin admin] PATH_INFO: `/v3/projects/b92a662811f14f1499245363a3957f6b/users/d3fc96474c594767898faa46cd366110/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:47.133371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986f853-698f-4a57-a030-44b063e6877d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92a662811f14f1499245363a3957f6b, user_id=d3fc96474c594767898faa46cd366110, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:47.137287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986f853-698f-4a57-a030-44b063e6877d admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:47.260395 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1227/2439] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:07:47 2022] PUT /identity/v3/projects/b92a662811f14f1499245363a3957f6b/users/d3fc96474c594767898faa46cd366110/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:07:47.264659 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c26dd7-ba49-4842-af3c-be3e926722b5 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:47.276144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c26dd7-ba49-4842-af3c-be3e926722b5 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:47.287478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:47.350709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae72b8-9734-4b20-9ca0-412b64bd2059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:47.351408 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae72b8-9734-4b20-9ca0-412b64bd2059 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:47.351730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae72b8-9734-4b20-9ca0-412b64bd2059 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:47.351984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae72b8-9734-4b20-9ca0-412b64bd2059 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:47.352843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae72b8-9734-4b20-9ca0-412b64bd2059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:47.355379 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae72b8-9734-4b20-9ca0-412b64bd2059 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:47.369318 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1213/2440] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:07:47.373462 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986f853-698f-4a57-a030-44b063e6877d admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:47.388495 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986f853-698f-4a57-a030-44b063e6877d admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:47.393853 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8006d-9500-4777-adf3-717226945fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:47.394684 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8006d-9500-4777-adf3-717226945fab admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:47.394970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8006d-9500-4777-adf3-717226945fab admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:47.395356 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8006d-9500-4777-adf3-717226945fab admin admin] PATH_INFO: `/v3/projects/b92a662811f14f1499245363a3957f6b/users/d3fc96474c594767898faa46cd366110/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:47.397577 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8006d-9500-4777-adf3-717226945fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92a662811f14f1499245363a3957f6b, user_id=d3fc96474c594767898faa46cd366110, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:47.400967 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8006d-9500-4777-adf3-717226945fab admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:47.415599 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1228/2441] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:07:47 2022] PUT /identity/v3/projects/b92a662811f14f1499245363a3957f6b/users/d3fc96474c594767898faa46cd366110/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:07:53.242263 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae72b8-9734-4b20-9ca0-412b64bd2059 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:53.244734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-3aae72b8-9734-4b20-9ca0-412b64bd2059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:53.334528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae72b8-9734-4b20-9ca0-412b64bd2059 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:53.407169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91990be5-0e89-4332-a863-b9f1903cb861 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:53.407844 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91990be5-0e89-4332-a863-b9f1903cb861 service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:53.408122 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91990be5-0e89-4332-a863-b9f1903cb861 service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:53.408395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91990be5-0e89-4332-a863-b9f1903cb861 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:53.410194 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-91990be5-0e89-4332-a863-b9f1903cb861 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:53.424022 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91990be5-0e89-4332-a863-b9f1903cb861 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:53.426150 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91990be5-0e89-4332-a863-b9f1903cb861 service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:53.440564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1214/2442] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:07:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:07:54.563058 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbae93e-4ced-4fa5-89e7-8ed128e37328 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:54.563781 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbae93e-4ced-4fa5-89e7-8ed128e37328 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:54.564064 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbae93e-4ced-4fa5-89e7-8ed128e37328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:54.602017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-edbae93e-4ced-4fa5-89e7-8ed128e37328 None None] MFA Rules not processed for user `420e2a81b66a470e8db624efd61fd1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:07:54.606369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-edbae93e-4ced-4fa5-89e7-8ed128e37328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:54.715677 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1229/2443] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 28 04:07:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:07:54.879527 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91990be5-0e89-4332-a863-b9f1903cb861 service nova] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:54.881226 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-91990be5-0e89-4332-a863-b9f1903cb861 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:54.921064 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:54.961321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91990be5-0e89-4332-a863-b9f1903cb861 service nova] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:54.968909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893063f-703d-4270-8b88-3e8c6528d7dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382ff6087bf4486d8651162880825eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:54.975414 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893063f-703d-4270-8b88-3e8c6528d7dd service swift] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:54.975414 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893063f-703d-4270-8b88-3e8c6528d7dd service swift] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:54.975414 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893063f-703d-4270-8b88-3e8c6528d7dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:54.982217 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893063f-703d-4270-8b88-3e8c6528d7dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:54.984098 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893063f-703d-4270-8b88-3e8c6528d7dd service swift] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:54.994146 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1215/2444] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 28 04:07:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 04:07:55.909395 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f39ce0-8290-4ff6-9ab0-871fb06f815a None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:55.909395 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f39ce0-8290-4ff6-9ab0-871fb06f815a None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:55.909395 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f39ce0-8290-4ff6-9ab0-871fb06f815a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:55.942632 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-76f39ce0-8290-4ff6-9ab0-871fb06f815a None None] MFA Rules not processed for user `d3fc96474c594767898faa46cd366110`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:07:55.943817 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-76f39ce0-8290-4ff6-9ab0-871fb06f815a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:56.074593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1230/2445] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:07:55 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:07:56.094357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893063f-703d-4270-8b88-3e8c6528d7dd service swift] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:56.115026 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893063f-703d-4270-8b88-3e8c6528d7dd service swift] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:56.125995 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10182f-8632-45f1-91fe-b124638ce7a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:56.126915 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10182f-8632-45f1-91fe-b124638ce7a5 service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:56.127497 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10182f-8632-45f1-91fe-b124638ce7a5 service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:56.127947 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10182f-8632-45f1-91fe-b124638ce7a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:56.223539 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10182f-8632-45f1-91fe-b124638ce7a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:56.226045 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10182f-8632-45f1-91fe-b124638ce7a5 service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:56.246897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1216/2446] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:07:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:07:59.250855 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdf3df-5bce-4e39-a6a5-d41bbc6a6521 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:59.251776 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdf3df-5bce-4e39-a6a5-d41bbc6a6521 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:59.252541 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdf3df-5bce-4e39-a6a5-d41bbc6a6521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:59.266021 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:59.294854 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-befdf3df-5bce-4e39-a6a5-d41bbc6a6521 None None] MFA Rules not processed for user `420e2a81b66a470e8db624efd61fd1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:07:59.298078 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-befdf3df-5bce-4e39-a6a5-d41bbc6a6521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:07:59.308813 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1231/2447] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 28 04:07:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:07:59.322832 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10182f-8632-45f1-91fe-b124638ce7a5 service nova] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:07:59.346638 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10182f-8632-45f1-91fe-b124638ce7a5 service nova] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:07:59.366603 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e5027-ee31-4477-9ed6-d38b38a28269 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382ff6087bf4486d8651162880825eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:07:59.367553 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e5027-ee31-4477-9ed6-d38b38a28269 service swift] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:07:59.368010 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e5027-ee31-4477-9ed6-d38b38a28269 service swift] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:07:59.368553 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e5027-ee31-4477-9ed6-d38b38a28269 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:07:59.406268 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e5027-ee31-4477-9ed6-d38b38a28269 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:07:59.408143 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e5027-ee31-4477-9ed6-d38b38a28269 service swift] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:07:59.420936 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1217/2448] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 28 04:07:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 04:08:00.233234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270cce2-5396-423e-b3dc-08678a7dc43e None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:00.233532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270cce2-5396-423e-b3dc-08678a7dc43e None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:00.233811 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270cce2-5396-423e-b3dc-08678a7dc43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:00.261906 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-0270cce2-5396-423e-b3dc-08678a7dc43e None None] MFA Rules not processed for user `3f0a175f41e74f9bb73303ce748a88dc`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:08:00.264195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-0270cce2-5396-423e-b3dc-08678a7dc43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:00.280133 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1232/2449] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:08:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:08:00.405740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e5027-ee31-4477-9ed6-d38b38a28269 service swift] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:00.435138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e5027-ee31-4477-9ed6-d38b38a28269 service swift] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:00.445963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778b1fb-5b62-4f6d-9321-b67148561b40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:00.450149 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778b1fb-5b62-4f6d-9321-b67148561b40 service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:00.450149 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778b1fb-5b62-4f6d-9321-b67148561b40 service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:00.450149 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778b1fb-5b62-4f6d-9321-b67148561b40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:00.463426 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-d778b1fb-5b62-4f6d-9321-b67148561b40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:00.639688 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778b1fb-5b62-4f6d-9321-b67148561b40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:00.650240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778b1fb-5b62-4f6d-9321-b67148561b40 service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:00.668568 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1218/2450] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:08:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:08:07.811522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270cce2-5396-423e-b3dc-08678a7dc43e None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:07.813232 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-0270cce2-5396-423e-b3dc-08678a7dc43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:07.938052 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270cce2-5396-423e-b3dc-08678a7dc43e None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:07.945279 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe62ff6-ae70-4f72-8b85-259ae6dbf65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:07.945956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe62ff6-ae70-4f72-8b85-259ae6dbf65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:07.946245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe62ff6-ae70-4f72-8b85-259ae6dbf65d admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:07.946594 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe62ff6-ae70-4f72-8b85-259ae6dbf65d admin admin] PATH_INFO: `/v3/users/114bcf2b59274aeab5f5deee67527cc0` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:07.947955 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe62ff6-ae70-4f72-8b85-259ae6dbf65d admin admin] RBAC: Authorizing `identity:delete_user(user_id=114bcf2b59274aeab5f5deee67527cc0)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:07.950026 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe62ff6-ae70-4f72-8b85-259ae6dbf65d admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:08.164791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-efe62ff6-ae70-4f72-8b85-259ae6dbf65d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '114bcf2b59274aeab5f5deee67527cc0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:08.167789 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-efe62ff6-ae70-4f72-8b85-259ae6dbf65d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '114bcf2b59274aeab5f5deee67527cc0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:08.238558 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-efe62ff6-ae70-4f72-8b85-259ae6dbf65d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '114bcf2b59274aeab5f5deee67527cc0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:08.253645 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-efe62ff6-ae70-4f72-8b85-259ae6dbf65d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '114bcf2b59274aeab5f5deee67527cc0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:08.262828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-efe62ff6-ae70-4f72-8b85-259ae6dbf65d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '114bcf2b59274aeab5f5deee67527cc0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:08.274229 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1233/2451] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:08:07 2022] DELETE /identity/v3/users/114bcf2b59274aeab5f5deee67527cc0 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:08:08.749970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778b1fb-5b62-4f6d-9321-b67148561b40 service nova] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:08.770447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778b1fb-5b62-4f6d-9321-b67148561b40 service nova] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:08.933765 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:08.967029 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8578d85-a1eb-496b-90d9-82a05806dc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:08.968113 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8578d85-a1eb-496b-90d9-82a05806dc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:08.968888 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8578d85-a1eb-496b-90d9-82a05806dc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:08.969400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8578d85-a1eb-496b-90d9-82a05806dc37 admin admin] PATH_INFO: `/v3/projects/f1328643d49046db89a4efa1bf477bbc` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:08.970886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8578d85-a1eb-496b-90d9-82a05806dc37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1328643d49046db89a4efa1bf477bbc)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:08.973101 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8578d85-a1eb-496b-90d9-82a05806dc37 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:09.158622 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e8578d85-a1eb-496b-90d9-82a05806dc37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1328643d49046db89a4efa1bf477bbc', 'request_id': 'req-e8578d85-a1eb-496b-90d9-82a05806dc37'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:09.169315 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e8578d85-a1eb-496b-90d9-82a05806dc37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1328643d49046db89a4efa1bf477bbc', 'request_id': 'req-e8578d85-a1eb-496b-90d9-82a05806dc37'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:09.176746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e8578d85-a1eb-496b-90d9-82a05806dc37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1328643d49046db89a4efa1bf477bbc', 'request_id': 'req-e8578d85-a1eb-496b-90d9-82a05806dc37'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:09.294058 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e8578d85-a1eb-496b-90d9-82a05806dc37 admin admin] The token cache is being invalidate because project f1328643d49046db89a4efa1bf477bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:08:09.308834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e8578d85-a1eb-496b-90d9-82a05806dc37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:09.308834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-e8578d85-a1eb-496b-90d9-82a05806dc37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:09.308834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1219/2452] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:08:08 2022] DELETE /identity/v3/projects/f1328643d49046db89a4efa1bf477bbc => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:08:09.309358 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe62ff6-ae70-4f72-8b85-259ae6dbf65d admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:09.309358 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-efe62ff6-ae70-4f72-8b85-259ae6dbf65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:09.322883 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe62ff6-ae70-4f72-8b85-259ae6dbf65d admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:09.423131 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b863e-f07b-45ff-a71b-4c2b4a0bcf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:09.423991 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b863e-f07b-45ff-a71b-4c2b4a0bcf6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:09.424433 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b863e-f07b-45ff-a71b-4c2b4a0bcf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:09.427480 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b863e-f07b-45ff-a71b-4c2b4a0bcf6e admin admin] PATH_INFO: `/v3/users/b60a5cb6664240c6b482a8ac2032f4af` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:09.427708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b863e-f07b-45ff-a71b-4c2b4a0bcf6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b60a5cb6664240c6b482a8ac2032f4af)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:09.432574 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b863e-f07b-45ff-a71b-4c2b4a0bcf6e admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:09.448389 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:09.684866 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-157b863e-f07b-45ff-a71b-4c2b4a0bcf6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b60a5cb6664240c6b482a8ac2032f4af'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:09.685655 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-157b863e-f07b-45ff-a71b-4c2b4a0bcf6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b60a5cb6664240c6b482a8ac2032f4af'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:09.846817 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-157b863e-f07b-45ff-a71b-4c2b4a0bcf6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b60a5cb6664240c6b482a8ac2032f4af'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:09.888148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-157b863e-f07b-45ff-a71b-4c2b4a0bcf6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b60a5cb6664240c6b482a8ac2032f4af'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:09.915886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-157b863e-f07b-45ff-a71b-4c2b4a0bcf6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b60a5cb6664240c6b482a8ac2032f4af'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:09.937799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1234/2453] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:08:09 2022] DELETE /identity/v3/users/b60a5cb6664240c6b482a8ac2032f4af => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:08:10.347354 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8578d85-a1eb-496b-90d9-82a05806dc37 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:10.352361 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e8578d85-a1eb-496b-90d9-82a05806dc37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:10.387224 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8578d85-a1eb-496b-90d9-82a05806dc37 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:10.480244 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127aa2c-78b5-43ba-9d6a-286fa479eb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:10.481607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127aa2c-78b5-43ba-9d6a-286fa479eb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:10.481849 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127aa2c-78b5-43ba-9d6a-286fa479eb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:10.482304 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127aa2c-78b5-43ba-9d6a-286fa479eb60 admin admin] PATH_INFO: `/v3/projects/68f875d3804844d099942c5c8c033958` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:10.483770 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127aa2c-78b5-43ba-9d6a-286fa479eb60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f875d3804844d099942c5c8c033958)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:10.485951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127aa2c-78b5-43ba-9d6a-286fa479eb60 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:10.677211 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5127aa2c-78b5-43ba-9d6a-286fa479eb60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f875d3804844d099942c5c8c033958', 'request_id': 'req-5127aa2c-78b5-43ba-9d6a-286fa479eb60'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:10.692078 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5127aa2c-78b5-43ba-9d6a-286fa479eb60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f875d3804844d099942c5c8c033958', 'request_id': 'req-5127aa2c-78b5-43ba-9d6a-286fa479eb60'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:10.699983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5127aa2c-78b5-43ba-9d6a-286fa479eb60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f875d3804844d099942c5c8c033958', 'request_id': 'req-5127aa2c-78b5-43ba-9d6a-286fa479eb60'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:10.794148 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5127aa2c-78b5-43ba-9d6a-286fa479eb60 admin admin] The token cache is being invalidate because project 68f875d3804844d099942c5c8c033958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:08:10.794445 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5127aa2c-78b5-43ba-9d6a-286fa479eb60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:10.795685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5127aa2c-78b5-43ba-9d6a-286fa479eb60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:10.797588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1220/2454] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:08:10 2022] DELETE /identity/v3/projects/68f875d3804844d099942c5c8c033958 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:08:17.538559 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b863e-f07b-45ff-a71b-4c2b4a0bcf6e admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:17.540104 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-157b863e-f07b-45ff-a71b-4c2b4a0bcf6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:17.610426 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b863e-f07b-45ff-a71b-4c2b4a0bcf6e admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:17.663917 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca2a4d-0a78-4d39-9534-32b8dc2431a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:17.664456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca2a4d-0a78-4d39-9534-32b8dc2431a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:17.664737 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca2a4d-0a78-4d39-9534-32b8dc2431a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:17.665012 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca2a4d-0a78-4d39-9534-32b8dc2431a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:17.667485 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-5eca2a4d-0a78-4d39-9534-32b8dc2431a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:17.677983 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca2a4d-0a78-4d39-9534-32b8dc2431a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:17.679707 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca2a4d-0a78-4d39-9534-32b8dc2431a8 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:17.689222 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1235/2455] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:08:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:08:18.596729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127aa2c-78b5-43ba-9d6a-286fa479eb60 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:18.598432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-5127aa2c-78b5-43ba-9d6a-286fa479eb60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:18.609273 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:18.679824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127aa2c-78b5-43ba-9d6a-286fa479eb60 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:18.690309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9ecd4-f364-4d4e-9a82-a36dede65f4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f2584622a48bba21e1bf31c1aef30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:18.690309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9ecd4-f364-4d4e-9a82-a36dede65f4f service placement] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:18.690309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9ecd4-f364-4d4e-9a82-a36dede65f4f service placement] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:18.690309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9ecd4-f364-4d4e-9a82-a36dede65f4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:18.691145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-77b9ecd4-f364-4d4e-9a82-a36dede65f4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:18.701066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9ecd4-f364-4d4e-9a82-a36dede65f4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:18.702664 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9ecd4-f364-4d4e-9a82-a36dede65f4f service placement] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:18.713275 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1221/2456] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:08:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:08:19.066733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca2a4d-0a78-4d39-9534-32b8dc2431a8 service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:19.068374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-5eca2a4d-0a78-4d39-9534-32b8dc2431a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:19.136504 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:19.163093 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca2a4d-0a78-4d39-9534-32b8dc2431a8 service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:19.169041 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d7359-f9e8-4b28-be03-80250b0d411b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:19.169663 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d7359-f9e8-4b28-be03-80250b0d411b service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:19.169945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d7359-f9e8-4b28-be03-80250b0d411b service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:19.170266 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d7359-f9e8-4b28-be03-80250b0d411b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:19.172072 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a57d7359-f9e8-4b28-be03-80250b0d411b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:19.186272 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d7359-f9e8-4b28-be03-80250b0d411b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:19.188136 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d7359-f9e8-4b28-be03-80250b0d411b service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:19.204246 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1236/2457] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:08:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:08:23.361339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9ecd4-f364-4d4e-9a82-a36dede65f4f service placement] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:23.363026 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-77b9ecd4-f364-4d4e-9a82-a36dede65f4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:23.389493 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9ecd4-f364-4d4e-9a82-a36dede65f4f service placement] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:23.393343 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbd490-576a-49d7-93fc-9a50b1beb2f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:23.394138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbd490-576a-49d7-93fc-9a50b1beb2f5 service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:23.394490 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbd490-576a-49d7-93fc-9a50b1beb2f5 service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:23.394838 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbd490-576a-49d7-93fc-9a50b1beb2f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:23.397053 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-22bbd490-576a-49d7-93fc-9a50b1beb2f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:23.414635 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbd490-576a-49d7-93fc-9a50b1beb2f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:23.416705 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbd490-576a-49d7-93fc-9a50b1beb2f5 service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:23.430138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1222/2458] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:08:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:08:24.942792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7a80a-6a9c-416b-b7ac-f9569223cc0d None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:24.943417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7a80a-6a9c-416b-b7ac-f9569223cc0d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:24.943521 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7a80a-6a9c-416b-b7ac-f9569223cc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:24.970353 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-f4b7a80a-6a9c-416b-b7ac-f9569223cc0d None None] MFA Rules not processed for user `420e2a81b66a470e8db624efd61fd1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:08:24.971671 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f4b7a80a-6a9c-416b-b7ac-f9569223cc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:25.060517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1237/2459] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 28 04:08:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:08:25.075159 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbd490-576a-49d7-93fc-9a50b1beb2f5 service nova] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:25.076830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-22bbd490-576a-49d7-93fc-9a50b1beb2f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:25.159545 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbd490-576a-49d7-93fc-9a50b1beb2f5 service nova] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:25.165471 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc797912-f3c9-4dc9-ae10-5220c2622585 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382ff6087bf4486d8651162880825eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:25.166267 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc797912-f3c9-4dc9-ae10-5220c2622585 service swift] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:25.167411 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc797912-f3c9-4dc9-ae10-5220c2622585 service swift] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:25.167767 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc797912-f3c9-4dc9-ae10-5220c2622585 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:25.178592 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc797912-f3c9-4dc9-ae10-5220c2622585 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:25.180494 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc797912-f3c9-4dc9-ae10-5220c2622585 service swift] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:25.192193 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1223/2460] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 28 04:08:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 04:08:30.481616 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7a80a-6a9c-416b-b7ac-f9569223cc0d None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:30.486253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f4b7a80a-6a9c-416b-b7ac-f9569223cc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:30.503771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7a80a-6a9c-416b-b7ac-f9569223cc0d None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:30.509090 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b7a8e-0a36-4750-ada4-c0d1aa413ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:30.509747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b7a8e-0a36-4750-ada4-c0d1aa413ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:30.510029 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b7a8e-0a36-4750-ada4-c0d1aa413ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:30.510435 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b7a8e-0a36-4750-ada4-c0d1aa413ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:30.512710 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e50b7a8e-0a36-4750-ada4-c0d1aa413ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:30.615096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b7a8e-0a36-4750-ada4-c0d1aa413ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:30.625158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b7a8e-0a36-4750-ada4-c0d1aa413ee8 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:30.662074 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1238/2461] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:08:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:08:35.187513 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=67 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:35.520918 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc797912-f3c9-4dc9-ae10-5220c2622585 service swift] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:35.522365 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-dc797912-f3c9-4dc9-ae10-5220c2622585 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:35.538669 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc797912-f3c9-4dc9-ae10-5220c2622585 service swift] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:35.544381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb8a8a-acec-4738-8878-5d21a9c2b9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:35.545530 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb8a8a-acec-4738-8878-5d21a9c2b9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:35.545530 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb8a8a-acec-4738-8878-5d21a9c2b9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:35.545725 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb8a8a-acec-4738-8878-5d21a9c2b9e2 admin admin] PATH_INFO: `/v3/users/239971f05a0b4ba4874c167c26927c98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:35.546900 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb8a8a-acec-4738-8878-5d21a9c2b9e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=239971f05a0b4ba4874c167c26927c98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:35.548872 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb8a8a-acec-4738-8878-5d21a9c2b9e2 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:35.802884 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-06cb8a8a-acec-4738-8878-5d21a9c2b9e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '239971f05a0b4ba4874c167c26927c98'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:35.803720 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-06cb8a8a-acec-4738-8878-5d21a9c2b9e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '239971f05a0b4ba4874c167c26927c98'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:35.891608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-06cb8a8a-acec-4738-8878-5d21a9c2b9e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '239971f05a0b4ba4874c167c26927c98'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:35.901776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-06cb8a8a-acec-4738-8878-5d21a9c2b9e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '239971f05a0b4ba4874c167c26927c98'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:35.917869 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-06cb8a8a-acec-4738-8878-5d21a9c2b9e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '239971f05a0b4ba4874c167c26927c98'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:35.925603 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1224/2462] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:08:35 2022] DELETE /identity/v3/users/239971f05a0b4ba4874c167c26927c98 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:08:36.305155 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b7a8e-0a36-4750-ada4-c0d1aa413ee8 service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:36.325154 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b7a8e-0a36-4750-ada4-c0d1aa413ee8 service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:36.403785 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a32be2-ea08-4072-b72f-c88a3ad5352f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:36.404452 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a32be2-ea08-4072-b72f-c88a3ad5352f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:36.404736 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a32be2-ea08-4072-b72f-c88a3ad5352f admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:36.405013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a32be2-ea08-4072-b72f-c88a3ad5352f admin admin] PATH_INFO: `/v3/projects/8a055fb7397a4ab69829b214c0a7f136` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:36.406266 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a32be2-ea08-4072-b72f-c88a3ad5352f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a055fb7397a4ab69829b214c0a7f136)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:36.408271 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a32be2-ea08-4072-b72f-c88a3ad5352f admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:36.421920 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:36.555105 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-72a32be2-ea08-4072-b72f-c88a3ad5352f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a055fb7397a4ab69829b214c0a7f136', 'request_id': 'req-72a32be2-ea08-4072-b72f-c88a3ad5352f'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:36.622992 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-72a32be2-ea08-4072-b72f-c88a3ad5352f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a055fb7397a4ab69829b214c0a7f136', 'request_id': 'req-72a32be2-ea08-4072-b72f-c88a3ad5352f'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:36.629417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-72a32be2-ea08-4072-b72f-c88a3ad5352f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a055fb7397a4ab69829b214c0a7f136', 'request_id': 'req-72a32be2-ea08-4072-b72f-c88a3ad5352f'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:36.641116 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-72a32be2-ea08-4072-b72f-c88a3ad5352f admin admin] The token cache is being invalidate because project 8a055fb7397a4ab69829b214c0a7f136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:08:36.641406 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-72a32be2-ea08-4072-b72f-c88a3ad5352f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:36.642082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-72a32be2-ea08-4072-b72f-c88a3ad5352f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:08:36.643646 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1239/2463] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:08:36 2022] DELETE /identity/v3/projects/8a055fb7397a4ab69829b214c0a7f136 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:08:36.649016 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c1572-b15d-4255-8012-9a0775c84895 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:36.649972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c1572-b15d-4255-8012-9a0775c84895 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:36.650258 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c1572-b15d-4255-8012-9a0775c84895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:36.671113 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-428c1572-b15d-4255-8012-9a0775c84895 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:08:36.672422 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-428c1572-b15d-4255-8012-9a0775c84895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:36.735220 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1225/2464] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:08:36.743145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e527f35-5572-41e4-8e1c-7b85f95ca1b7 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:36.743664 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e527f35-5572-41e4-8e1c-7b85f95ca1b7 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:36.743940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e527f35-5572-41e4-8e1c-7b85f95ca1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:36.768985 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-4e527f35-5572-41e4-8e1c-7b85f95ca1b7 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:08:36.770315 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-4e527f35-5572-41e4-8e1c-7b85f95ca1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:36.780469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1240/2465] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:08:36.785370 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c1572-b15d-4255-8012-9a0775c84895 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:36.796569 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c1572-b15d-4255-8012-9a0775c84895 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:36.801356 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd8655-6390-432c-893a-8d593d6c6ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:36.802083 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8655-6390-432c-893a-8d593d6c6ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:36.802292 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8655-6390-432c-893a-8d593d6c6ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:36.802576 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8655-6390-432c-893a-8d593d6c6ba0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:36.803291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd8655-6390-432c-893a-8d593d6c6ba0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:08:36.804691 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd8655-6390-432c-893a-8d593d6c6ba0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:36.805382 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd8655-6390-432c-893a-8d593d6c6ba0 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:36.821814 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1226/2466] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:08:36.827031 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e527f35-5572-41e4-8e1c-7b85f95ca1b7 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:36.836732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e527f35-5572-41e4-8e1c-7b85f95ca1b7 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:36.842366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d2b73-689d-4e6f-a4f5-476b7884b93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:36.843069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d2b73-689d-4e6f-a4f5-476b7884b93a admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:36.843441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d2b73-689d-4e6f-a4f5-476b7884b93a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:36.843698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d2b73-689d-4e6f-a4f5-476b7884b93a admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:36.844372 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d2b73-689d-4e6f-a4f5-476b7884b93a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:36.846405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d2b73-689d-4e6f-a4f5-476b7884b93a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:36.937751 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1241/2467] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:08:36 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:08:36.942334 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd8655-6390-432c-893a-8d593d6c6ba0 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:36.954633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd8655-6390-432c-893a-8d593d6c6ba0 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:37.036338 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2c9e4-074a-4ecb-a8c3-265777b19d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:37.036972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2c9e4-074a-4ecb-a8c3-265777b19d17 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:37.037255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2c9e4-074a-4ecb-a8c3-265777b19d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:37.037528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2c9e4-074a-4ecb-a8c3-265777b19d17 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:37.038869 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2c9e4-074a-4ecb-a8c3-265777b19d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:37.040886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2c9e4-074a-4ecb-a8c3-265777b19d17 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:37.049249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:37.147653 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1227/2468] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:08:36 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:08:37.154784 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d2b73-689d-4e6f-a4f5-476b7884b93a admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:37.168171 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d2b73-689d-4e6f-a4f5-476b7884b93a admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:37.173930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518ca7a-4db6-488e-86a5-02c565fec1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:37.174666 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518ca7a-4db6-488e-86a5-02c565fec1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:37.175032 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518ca7a-4db6-488e-86a5-02c565fec1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:37.175413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518ca7a-4db6-488e-86a5-02c565fec1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:37.176178 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518ca7a-4db6-488e-86a5-02c565fec1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:37.177985 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518ca7a-4db6-488e-86a5-02c565fec1f0 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:37.196155 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1242/2469] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:08:37.200404 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2c9e4-074a-4ecb-a8c3-265777b19d17 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:37.211270 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2c9e4-074a-4ecb-a8c3-265777b19d17 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:37.216984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389aa09-b712-4d7f-b99d-621575a9f394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:37.217663 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389aa09-b712-4d7f-b99d-621575a9f394 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:37.217931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389aa09-b712-4d7f-b99d-621575a9f394 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:37.218213 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389aa09-b712-4d7f-b99d-621575a9f394 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:37.218950 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389aa09-b712-4d7f-b99d-621575a9f394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:37.220664 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389aa09-b712-4d7f-b99d-621575a9f394 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:37.235472 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1228/2470] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:08:37.238717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518ca7a-4db6-488e-86a5-02c565fec1f0 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:37.256770 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518ca7a-4db6-488e-86a5-02c565fec1f0 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:37.264047 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce755587-8c1c-40d8-86e2-788d72ea5fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:37.270813 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce755587-8c1c-40d8-86e2-788d72ea5fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:37.270813 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce755587-8c1c-40d8-86e2-788d72ea5fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:37.270813 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce755587-8c1c-40d8-86e2-788d72ea5fcf admin admin] PATH_INFO: `/v3/projects/bb91363ae0f2423fbf1858ec807229d9/users/deba0a6ab39a4f33a509a09e875f852c/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:37.282869 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce755587-8c1c-40d8-86e2-788d72ea5fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb91363ae0f2423fbf1858ec807229d9, user_id=deba0a6ab39a4f33a509a09e875f852c, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:37.285912 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce755587-8c1c-40d8-86e2-788d72ea5fcf admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:37.429893 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1243/2471] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:08:37 2022] PUT /identity/v3/projects/bb91363ae0f2423fbf1858ec807229d9/users/deba0a6ab39a4f33a509a09e875f852c/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:08:37.435952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f814b-ee28-496c-8c27-064c5f9473a1 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:37.436420 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f814b-ee28-496c-8c27-064c5f9473a1 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:37.436629 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f814b-ee28-496c-8c27-064c5f9473a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:37.457363 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-e83f814b-ee28-496c-8c27-064c5f9473a1 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:08:37.458586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e83f814b-ee28-496c-8c27-064c5f9473a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:37.522442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1229/2472] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:08:37.533014 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce755587-8c1c-40d8-86e2-788d72ea5fcf admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:37.534764 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ce755587-8c1c-40d8-86e2-788d72ea5fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:37.601440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce755587-8c1c-40d8-86e2-788d72ea5fcf admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:37.606429 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f43a3-8727-43a9-8887-468ed48cf4f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:37.607122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f43a3-8727-43a9-8887-468ed48cf4f1 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:37.607419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f43a3-8727-43a9-8887-468ed48cf4f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:37.607690 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f43a3-8727-43a9-8887-468ed48cf4f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:37.618049 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f43a3-8727-43a9-8887-468ed48cf4f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:37.620424 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f43a3-8727-43a9-8887-468ed48cf4f1 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:37.631840 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1244/2473] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:08:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:08:42.438009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bfabd-04de-47c8-b2a2-bd1e880a9e75 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:42.438606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bfabd-04de-47c8-b2a2-bd1e880a9e75 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:42.438606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bfabd-04de-47c8-b2a2-bd1e880a9e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:42.537114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-790bfabd-04de-47c8-b2a2-bd1e880a9e75 None None] MFA Rules not processed for user `420e2a81b66a470e8db624efd61fd1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:08:42.538980 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-790bfabd-04de-47c8-b2a2-bd1e880a9e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:42.670794 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1230/2474] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 28 04:08:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:08:42.685488 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f43a3-8727-43a9-8887-468ed48cf4f1 service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:42.686949 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-239f43a3-8727-43a9-8887-468ed48cf4f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:42.821432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:42.855572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f43a3-8727-43a9-8887-468ed48cf4f1 service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:42.861768 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3ed36-12b1-434d-bb82-8963b7152747 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382ff6087bf4486d8651162880825eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:42.862758 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3ed36-12b1-434d-bb82-8963b7152747 service swift] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:42.863254 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3ed36-12b1-434d-bb82-8963b7152747 service swift] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:42.863791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3ed36-12b1-434d-bb82-8963b7152747 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:42.892513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3ed36-12b1-434d-bb82-8963b7152747 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:42.894818 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3ed36-12b1-434d-bb82-8963b7152747 service swift] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:42.925128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1245/2475] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 28 04:08:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 04:08:44.919712 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d3957-f0ce-48df-96c0-e407bfcf816d None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:44.920267 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d3957-f0ce-48df-96c0-e407bfcf816d None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:44.920267 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d3957-f0ce-48df-96c0-e407bfcf816d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:44.953384 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-c09d3957-f0ce-48df-96c0-e407bfcf816d None None] MFA Rules not processed for user `deba0a6ab39a4f33a509a09e875f852c`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:08:44.954689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c09d3957-f0ce-48df-96c0-e407bfcf816d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:45.030226 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1231/2476] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:08:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:08:45.044749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3ed36-12b1-434d-bb82-8963b7152747 service swift] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:45.046413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-6eb3ed36-12b1-434d-bb82-8963b7152747 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:45.131369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3ed36-12b1-434d-bb82-8963b7152747 service swift] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:45.138626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00febf1-8f99-4d67-90d2-f41fbf9f5c1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:45.139861 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00febf1-8f99-4d67-90d2-f41fbf9f5c1c service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:45.139861 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00febf1-8f99-4d67-90d2-f41fbf9f5c1c service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:45.140098 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00febf1-8f99-4d67-90d2-f41fbf9f5c1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:45.149550 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00febf1-8f99-4d67-90d2-f41fbf9f5c1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:45.151969 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00febf1-8f99-4d67-90d2-f41fbf9f5c1c service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:45.163068 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1246/2477] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:08:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:08:46.759033 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d3957-f0ce-48df-96c0-e407bfcf816d None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:46.761585 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c09d3957-f0ce-48df-96c0-e407bfcf816d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:46.788886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d3957-f0ce-48df-96c0-e407bfcf816d None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:46.794744 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2d5a5-f0d8-4f89-9dae-23cb1ac19ef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:46.795308 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2d5a5-f0d8-4f89-9dae-23cb1ac19ef1 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:46.795750 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2d5a5-f0d8-4f89-9dae-23cb1ac19ef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:46.796034 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2d5a5-f0d8-4f89-9dae-23cb1ac19ef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:46.798549 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-3db2d5a5-f0d8-4f89-9dae-23cb1ac19ef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:46.810937 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:46.869901 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2d5a5-f0d8-4f89-9dae-23cb1ac19ef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:46.871528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2d5a5-f0d8-4f89-9dae-23cb1ac19ef1 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:46.882169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1232/2478] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:08:46 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:08:48.373766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1134b-d29b-4eeb-8f79-1c071e3c2128 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:48.374226 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1134b-d29b-4eeb-8f79-1c071e3c2128 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:48.374339 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1134b-d29b-4eeb-8f79-1c071e3c2128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:48.394064 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-46c1134b-d29b-4eeb-8f79-1c071e3c2128 None None] MFA Rules not processed for user `deba0a6ab39a4f33a509a09e875f852c`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:08:48.395280 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-46c1134b-d29b-4eeb-8f79-1c071e3c2128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:48.402951 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1247/2479] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:08:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:08:48.777983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2d5a5-f0d8-4f89-9dae-23cb1ac19ef1 service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:48.789574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2d5a5-f0d8-4f89-9dae-23cb1ac19ef1 service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:48.794986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d71ab-0fb9-4024-bef8-6612733e7291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:48.795427 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d71ab-0fb9-4024-bef8-6612733e7291 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:48.795712 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d71ab-0fb9-4024-bef8-6612733e7291 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:48.796184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d71ab-0fb9-4024-bef8-6612733e7291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:48.798445 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ce6d71ab-0fb9-4024-bef8-6612733e7291 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:48.810427 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d71ab-0fb9-4024-bef8-6612733e7291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:48.812364 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d71ab-0fb9-4024-bef8-6612733e7291 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:48.822348 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1233/2480] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:08:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:08:49.147494 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1134b-d29b-4eeb-8f79-1c071e3c2128 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:08:49.149780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-46c1134b-d29b-4eeb-8f79-1c071e3c2128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:49.224789 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1134b-d29b-4eeb-8f79-1c071e3c2128 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:08:49.230160 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3219ca-3f2a-4c92-8870-1945168b4f22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:08:49.231396 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3219ca-3f2a-4c92-8870-1945168b4f22 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:08:49.231396 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3219ca-3f2a-4c92-8870-1945168b4f22 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:08:49.231614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3219ca-3f2a-4c92-8870-1945168b4f22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:08:49.233749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-eb3219ca-3f2a-4c92-8870-1945168b4f22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:08:49.360244 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3219ca-3f2a-4c92-8870-1945168b4f22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:08:49.362277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3219ca-3f2a-4c92-8870-1945168b4f22 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:08:49.375687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1248/2481] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:08:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:08:58.817615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=30 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:59.368499 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:01.146386 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d71ab-0fb9-4024-bef8-6612733e7291 service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:01.155798 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d71ab-0fb9-4024-bef8-6612733e7291 service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:01.159381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5a951-de09-45dd-8694-3b476fa30610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:01.160004 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5a951-de09-45dd-8694-3b476fa30610 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:01.160290 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5a951-de09-45dd-8694-3b476fa30610 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:01.160569 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5a951-de09-45dd-8694-3b476fa30610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:01.162326 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-63c5a951-de09-45dd-8694-3b476fa30610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:01.174871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5a951-de09-45dd-8694-3b476fa30610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:01.176316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5a951-de09-45dd-8694-3b476fa30610 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:01.186431 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1234/2482] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:09:05.444309 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3219ca-3f2a-4c92-8870-1945168b4f22 service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:05.445987 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-eb3219ca-3f2a-4c92-8870-1945168b4f22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:05.461224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3219ca-3f2a-4c92-8870-1945168b4f22 service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:05.467491 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae3815-e3e8-434a-914f-736341e099bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:05.468156 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae3815-e3e8-434a-914f-736341e099bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:05.468435 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae3815-e3e8-434a-914f-736341e099bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:05.468799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae3815-e3e8-434a-914f-736341e099bb admin admin] PATH_INFO: `/v3/users/707c80130c7243729f8bc6cddf2dfbf0` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:05.469883 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae3815-e3e8-434a-914f-736341e099bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=707c80130c7243729f8bc6cddf2dfbf0)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:05.471957 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae3815-e3e8-434a-914f-736341e099bb admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:05.660856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-27ae3815-e3e8-434a-914f-736341e099bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '707c80130c7243729f8bc6cddf2dfbf0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:05.661869 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-27ae3815-e3e8-434a-914f-736341e099bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '707c80130c7243729f8bc6cddf2dfbf0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:05.768961 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-27ae3815-e3e8-434a-914f-736341e099bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '707c80130c7243729f8bc6cddf2dfbf0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:05.786126 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-27ae3815-e3e8-434a-914f-736341e099bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '707c80130c7243729f8bc6cddf2dfbf0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:05.799365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-27ae3815-e3e8-434a-914f-736341e099bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '707c80130c7243729f8bc6cddf2dfbf0'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:05.809912 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1249/2483] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:09:05 2022] DELETE /identity/v3/users/707c80130c7243729f8bc6cddf2dfbf0 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:06.105506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5a951-de09-45dd-8694-3b476fa30610 service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:06.119901 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5a951-de09-45dd-8694-3b476fa30610 service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:06.185309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237444e-e2a6-4b34-a84f-f5fe1da36799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:06.185968 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237444e-e2a6-4b34-a84f-f5fe1da36799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:06.186277 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237444e-e2a6-4b34-a84f-f5fe1da36799 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:06.186588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237444e-e2a6-4b34-a84f-f5fe1da36799 admin admin] PATH_INFO: `/v3/projects/a595d454aad9412a80ea30eaba71eb53` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:06.187904 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237444e-e2a6-4b34-a84f-f5fe1da36799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a595d454aad9412a80ea30eaba71eb53)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:06.189837 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237444e-e2a6-4b34-a84f-f5fe1da36799 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:06.319859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-8237444e-e2a6-4b34-a84f-f5fe1da36799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a595d454aad9412a80ea30eaba71eb53', 'request_id': 'req-8237444e-e2a6-4b34-a84f-f5fe1da36799'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:06.328227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-8237444e-e2a6-4b34-a84f-f5fe1da36799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a595d454aad9412a80ea30eaba71eb53', 'request_id': 'req-8237444e-e2a6-4b34-a84f-f5fe1da36799'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:06.334290 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-8237444e-e2a6-4b34-a84f-f5fe1da36799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a595d454aad9412a80ea30eaba71eb53', 'request_id': 'req-8237444e-e2a6-4b34-a84f-f5fe1da36799'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:06.407934 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-8237444e-e2a6-4b34-a84f-f5fe1da36799 admin admin] The token cache is being invalidate because project a595d454aad9412a80ea30eaba71eb53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:09:06.412240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-8237444e-e2a6-4b34-a84f-f5fe1da36799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:06.412240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-8237444e-e2a6-4b34-a84f-f5fe1da36799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:06.412240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1235/2484] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:09:06 2022] DELETE /identity/v3/projects/a595d454aad9412a80ea30eaba71eb53 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:09:06.415835 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b83b-314b-4f79-94af-400428282034 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:06.416131 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b83b-314b-4f79-94af-400428282034 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:06.416566 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b83b-314b-4f79-94af-400428282034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:06.438391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-a537b83b-314b-4f79-94af-400428282034 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:06.439671 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a537b83b-314b-4f79-94af-400428282034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:06.510887 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1250/2485] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:06.518843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbe5c5-d5d5-4af7-a7f3-5c0c1fdc87b2 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:06.519134 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbe5c5-d5d5-4af7-a7f3-5c0c1fdc87b2 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:06.519446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbe5c5-d5d5-4af7-a7f3-5c0c1fdc87b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:06.543964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-78bbe5c5-d5d5-4af7-a7f3-5c0c1fdc87b2 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:06.543964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-78bbe5c5-d5d5-4af7-a7f3-5c0c1fdc87b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:06.550374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1236/2486] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:06.554815 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537b83b-314b-4f79-94af-400428282034 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:06.566445 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537b83b-314b-4f79-94af-400428282034 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:06.571463 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa80cef-f748-42b9-a39f-5e8a59b924bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:06.572895 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa80cef-f748-42b9-a39f-5e8a59b924bc admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:06.573675 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa80cef-f748-42b9-a39f-5e8a59b924bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:06.573957 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa80cef-f748-42b9-a39f-5e8a59b924bc admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:06.574693 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa80cef-f748-42b9-a39f-5e8a59b924bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:09:06.575830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa80cef-f748-42b9-a39f-5e8a59b924bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:06.577500 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa80cef-f748-42b9-a39f-5e8a59b924bc admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:06.591363 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1251/2487] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 04:09:06.595888 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbe5c5-d5d5-4af7-a7f3-5c0c1fdc87b2 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:06.606740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbe5c5-d5d5-4af7-a7f3-5c0c1fdc87b2 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:06.611637 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aa49e-7e09-4f01-8857-917fe886f5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:06.612291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aa49e-7e09-4f01-8857-917fe886f5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:06.613050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aa49e-7e09-4f01-8857-917fe886f5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:06.613050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aa49e-7e09-4f01-8857-917fe886f5a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:06.613526 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712aa49e-7e09-4f01-8857-917fe886f5a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:06.615552 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712aa49e-7e09-4f01-8857-917fe886f5a9 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:06.746437 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1237/2488] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:09:06 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:09:06.747653 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa80cef-f748-42b9-a39f-5e8a59b924bc admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:06.758090 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa80cef-f748-42b9-a39f-5e8a59b924bc admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:06.824051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea858ed5-361f-418f-911a-f4875b8c6e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:06.824803 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea858ed5-361f-418f-911a-f4875b8c6e14 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:06.825224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea858ed5-361f-418f-911a-f4875b8c6e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:06.825499 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea858ed5-361f-418f-911a-f4875b8c6e14 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:06.826168 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea858ed5-361f-418f-911a-f4875b8c6e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:06.828128 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea858ed5-361f-418f-911a-f4875b8c6e14 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:06.837470 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:06.923821 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1252/2489] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:09:06 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:09:06.928175 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aa49e-7e09-4f01-8857-917fe886f5a9 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:06.939170 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aa49e-7e09-4f01-8857-917fe886f5a9 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:06.943898 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206ed10-2a2c-4f4e-b96d-1db00bb215f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:06.944672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206ed10-2a2c-4f4e-b96d-1db00bb215f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:06.944859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206ed10-2a2c-4f4e-b96d-1db00bb215f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:06.945136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206ed10-2a2c-4f4e-b96d-1db00bb215f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:06.945841 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206ed10-2a2c-4f4e-b96d-1db00bb215f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:06.948290 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206ed10-2a2c-4f4e-b96d-1db00bb215f3 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:06.962297 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1238/2490] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:06.964530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea858ed5-361f-418f-911a-f4875b8c6e14 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:06.974815 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea858ed5-361f-418f-911a-f4875b8c6e14 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:06.980279 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb57d0f-e517-4afe-81cd-84135057ee54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:06.980986 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb57d0f-e517-4afe-81cd-84135057ee54 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:06.981391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb57d0f-e517-4afe-81cd-84135057ee54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:06.981671 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb57d0f-e517-4afe-81cd-84135057ee54 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:06.982757 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb57d0f-e517-4afe-81cd-84135057ee54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:06.984001 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb57d0f-e517-4afe-81cd-84135057ee54 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:06.996744 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1253/2491] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:07.000619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206ed10-2a2c-4f4e-b96d-1db00bb215f3 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:07.011860 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206ed10-2a2c-4f4e-b96d-1db00bb215f3 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:07.016531 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a37865-f09b-4c93-8666-a2df0d080033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:07.017196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a37865-f09b-4c93-8666-a2df0d080033 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:07.017481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a37865-f09b-4c93-8666-a2df0d080033 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:07.017897 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a37865-f09b-4c93-8666-a2df0d080033 admin admin] PATH_INFO: `/v3/projects/9ab8315a49e84d7f9fac5561b1c48bfb/users/1c6a37255ed44be397776bd1af5e3986/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:07.032443 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a37865-f09b-4c93-8666-a2df0d080033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ab8315a49e84d7f9fac5561b1c48bfb, user_id=1c6a37255ed44be397776bd1af5e3986, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:07.035110 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a37865-f09b-4c93-8666-a2df0d080033 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:07.137661 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1239/2492] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:06 2022] PUT /identity/v3/projects/9ab8315a49e84d7f9fac5561b1c48bfb/users/1c6a37255ed44be397776bd1af5e3986/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:07.151636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05f5ef-e2a9-4485-b423-4c271f4cc60e None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:07.152001 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05f5ef-e2a9-4485-b423-4c271f4cc60e None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:07.152428 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05f5ef-e2a9-4485-b423-4c271f4cc60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:07.180921 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-9a05f5ef-e2a9-4485-b423-4c271f4cc60e None None] MFA Rules not processed for user `1c6a37255ed44be397776bd1af5e3986`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:07.182864 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9a05f5ef-e2a9-4485-b423-4c271f4cc60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:07.248884 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1254/2493] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:07.260852 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a37865-f09b-4c93-8666-a2df0d080033 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:07.262690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-07a37865-f09b-4c93-8666-a2df0d080033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:07.278325 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:07.341531 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a37865-f09b-4c93-8666-a2df0d080033 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:07.347116 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c3fff-5272-4172-84b8-45917332d02c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:07.347779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c3fff-5272-4172-84b8-45917332d02c service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:07.348056 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c3fff-5272-4172-84b8-45917332d02c service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:07.348333 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c3fff-5272-4172-84b8-45917332d02c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:07.357308 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c3fff-5272-4172-84b8-45917332d02c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:07.361882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c3fff-5272-4172-84b8-45917332d02c service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:07.368632 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1240/2494] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:09:10.653424 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05f5ef-e2a9-4485-b423-4c271f4cc60e None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:10.714160 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05f5ef-e2a9-4485-b423-4c271f4cc60e None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:10.718928 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b03529-43c1-407b-9ab8-f2f6b5e71513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:10.719604 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b03529-43c1-407b-9ab8-f2f6b5e71513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:10.719887 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b03529-43c1-407b-9ab8-f2f6b5e71513 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:10.720158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b03529-43c1-407b-9ab8-f2f6b5e71513 admin admin] PATH_INFO: `/v3/users/1c6a37255ed44be397776bd1af5e3986` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:10.721317 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b03529-43c1-407b-9ab8-f2f6b5e71513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c6a37255ed44be397776bd1af5e3986)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:10.723248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b03529-43c1-407b-9ab8-f2f6b5e71513 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:10.904605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-93b03529-43c1-407b-9ab8-f2f6b5e71513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c6a37255ed44be397776bd1af5e3986'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:10.905187 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-93b03529-43c1-407b-9ab8-f2f6b5e71513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c6a37255ed44be397776bd1af5e3986'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:10.976751 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-93b03529-43c1-407b-9ab8-f2f6b5e71513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c6a37255ed44be397776bd1af5e3986'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:10.988846 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:10.990024 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-93b03529-43c1-407b-9ab8-f2f6b5e71513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c6a37255ed44be397776bd1af5e3986'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:10.997525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-93b03529-43c1-407b-9ab8-f2f6b5e71513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c6a37255ed44be397776bd1af5e3986'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:11.003566 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1255/2495] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:09:10 2022] DELETE /identity/v3/users/1c6a37255ed44be397776bd1af5e3986 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:11.008738 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3359df9-c746-433a-8a43-0406f5af9cc9 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:11.009235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3359df9-c746-433a-8a43-0406f5af9cc9 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:11.009344 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3359df9-c746-433a-8a43-0406f5af9cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:11.032949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-f3359df9-c746-433a-8a43-0406f5af9cc9 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:11.034174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f3359df9-c746-433a-8a43-0406f5af9cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:11.098746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1241/2496] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:11.110142 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b03529-43c1-407b-9ab8-f2f6b5e71513 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:11.111618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-93b03529-43c1-407b-9ab8-f2f6b5e71513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:11.172968 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b03529-43c1-407b-9ab8-f2f6b5e71513 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:11.176670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43436d-7b1c-4908-bdcd-752ff2ae8134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:11.177305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43436d-7b1c-4908-bdcd-752ff2ae8134 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:11.177585 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43436d-7b1c-4908-bdcd-752ff2ae8134 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:11.177856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43436d-7b1c-4908-bdcd-752ff2ae8134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:11.188902 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43436d-7b1c-4908-bdcd-752ff2ae8134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:11.190360 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43436d-7b1c-4908-bdcd-752ff2ae8134 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:11.200674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1256/2497] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:09:11.654903 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3359df9-c746-433a-8a43-0406f5af9cc9 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:11.661553 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f3359df9-c746-433a-8a43-0406f5af9cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:11.669802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3359df9-c746-433a-8a43-0406f5af9cc9 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:11.675030 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1744d8-7417-4b15-ba38-705878959395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:11.675719 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1744d8-7417-4b15-ba38-705878959395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:11.676003 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1744d8-7417-4b15-ba38-705878959395 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:11.676283 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1744d8-7417-4b15-ba38-705878959395 admin admin] PATH_INFO: `/v3/projects/9ab8315a49e84d7f9fac5561b1c48bfb` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:11.677552 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1744d8-7417-4b15-ba38-705878959395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ab8315a49e84d7f9fac5561b1c48bfb)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:11.679523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1744d8-7417-4b15-ba38-705878959395 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:11.829243 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0d1744d8-7417-4b15-ba38-705878959395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ab8315a49e84d7f9fac5561b1c48bfb', 'request_id': 'req-0d1744d8-7417-4b15-ba38-705878959395'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:11.835569 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0d1744d8-7417-4b15-ba38-705878959395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ab8315a49e84d7f9fac5561b1c48bfb', 'request_id': 'req-0d1744d8-7417-4b15-ba38-705878959395'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:11.841384 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0d1744d8-7417-4b15-ba38-705878959395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ab8315a49e84d7f9fac5561b1c48bfb', 'request_id': 'req-0d1744d8-7417-4b15-ba38-705878959395'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:11.926394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0d1744d8-7417-4b15-ba38-705878959395 admin admin] The token cache is being invalidate because project 9ab8315a49e84d7f9fac5561b1c48bfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:09:11.926690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0d1744d8-7417-4b15-ba38-705878959395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:11.927433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-0d1744d8-7417-4b15-ba38-705878959395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:11.929061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1242/2498] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:09:11 2022] DELETE /identity/v3/projects/9ab8315a49e84d7f9fac5561b1c48bfb => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:11.935134 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6cae-7900-4bf4-9111-e7401588fa56 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:11.935686 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6cae-7900-4bf4-9111-e7401588fa56 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:11.935838 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6cae-7900-4bf4-9111-e7401588fa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:11.956707 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-ab0e6cae-7900-4bf4-9111-e7401588fa56 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:11.957851 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ab0e6cae-7900-4bf4-9111-e7401588fa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:12.029664 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1257/2499] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:09:12.037591 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddcd30-d093-42cb-b33f-d2ea41f860ed None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:12.038064 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddcd30-d093-42cb-b33f-d2ea41f860ed None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:12.038180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddcd30-d093-42cb-b33f-d2ea41f860ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:12.059948 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-1bddcd30-d093-42cb-b33f-d2ea41f860ed None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:12.061174 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-1bddcd30-d093-42cb-b33f-d2ea41f860ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:12.069333 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1243/2500] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:12.074175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e6cae-7900-4bf4-9111-e7401588fa56 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:12.083947 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e6cae-7900-4bf4-9111-e7401588fa56 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:12.089077 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce12b7a-654f-46a9-8b2b-a1767a3809c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:12.089699 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce12b7a-654f-46a9-8b2b-a1767a3809c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:12.089977 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce12b7a-654f-46a9-8b2b-a1767a3809c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:12.090250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce12b7a-654f-46a9-8b2b-a1767a3809c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:12.090939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce12b7a-654f-46a9-8b2b-a1767a3809c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:09:12.091240 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce12b7a-654f-46a9-8b2b-a1767a3809c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:12.092881 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce12b7a-654f-46a9-8b2b-a1767a3809c1 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:12.108407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1258/2501] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:09:12.112775 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddcd30-d093-42cb-b33f-d2ea41f860ed None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:12.122729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddcd30-d093-42cb-b33f-d2ea41f860ed None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:12.127368 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202128cc-256a-4b20-a0ab-ad1973895e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:12.127979 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202128cc-256a-4b20-a0ab-ad1973895e8c admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:12.128258 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202128cc-256a-4b20-a0ab-ad1973895e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:12.128533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202128cc-256a-4b20-a0ab-ad1973895e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:12.129198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202128cc-256a-4b20-a0ab-ad1973895e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:12.131377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202128cc-256a-4b20-a0ab-ad1973895e8c admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:12.146626 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:12.256798 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1244/2502] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:09:12 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:09:12.266930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce12b7a-654f-46a9-8b2b-a1767a3809c1 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:12.277629 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce12b7a-654f-46a9-8b2b-a1767a3809c1 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:12.348104 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c63e3-29a2-4485-b512-2cc6709ae6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:12.348737 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c63e3-29a2-4485-b512-2cc6709ae6ba admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:12.349017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c63e3-29a2-4485-b512-2cc6709ae6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:12.349294 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c63e3-29a2-4485-b512-2cc6709ae6ba admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:12.349967 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c63e3-29a2-4485-b512-2cc6709ae6ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:12.351944 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c63e3-29a2-4485-b512-2cc6709ae6ba admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:12.426530 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1259/2503] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:09:12 2022] POST /identity/v3/users => generated 284 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:09:12.430841 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202128cc-256a-4b20-a0ab-ad1973895e8c admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:12.441968 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202128cc-256a-4b20-a0ab-ad1973895e8c admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:12.446613 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81544cd-b175-49e4-b5b0-854528ef89d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:12.447335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81544cd-b175-49e4-b5b0-854528ef89d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:12.447621 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81544cd-b175-49e4-b5b0-854528ef89d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:12.448522 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81544cd-b175-49e4-b5b0-854528ef89d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:12.449238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81544cd-b175-49e4-b5b0-854528ef89d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:12.450839 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81544cd-b175-49e4-b5b0-854528ef89d8 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:12.592504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1245/2504] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:09:12.596804 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c63e3-29a2-4485-b512-2cc6709ae6ba admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:12.609624 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c63e3-29a2-4485-b512-2cc6709ae6ba admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:12.614421 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af3f80-24f6-471e-aeaa-050e91b39b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:12.615231 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af3f80-24f6-471e-aeaa-050e91b39b78 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:12.615540 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af3f80-24f6-471e-aeaa-050e91b39b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:12.615823 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af3f80-24f6-471e-aeaa-050e91b39b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:12.616531 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af3f80-24f6-471e-aeaa-050e91b39b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:12.618162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af3f80-24f6-471e-aeaa-050e91b39b78 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:12.620346 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:12.631726 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1260/2505] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:12.636139 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81544cd-b175-49e4-b5b0-854528ef89d8 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:12.646203 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81544cd-b175-49e4-b5b0-854528ef89d8 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:12.651085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307666e4-4878-45b8-a7f1-2ed2e4f32f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:12.651711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307666e4-4878-45b8-a7f1-2ed2e4f32f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:12.651986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307666e4-4878-45b8-a7f1-2ed2e4f32f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:12.652260 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307666e4-4878-45b8-a7f1-2ed2e4f32f7d admin admin] PATH_INFO: `/v3/projects/8ce102f952044d25b2d1929e65397a0b/users/fffb88012e654453acdf32dc08a6540f/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:12.669014 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307666e4-4878-45b8-a7f1-2ed2e4f32f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce102f952044d25b2d1929e65397a0b, user_id=fffb88012e654453acdf32dc08a6540f, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:12.671834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307666e4-4878-45b8-a7f1-2ed2e4f32f7d admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:12.771554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1246/2506] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:12 2022] PUT /identity/v3/projects/8ce102f952044d25b2d1929e65397a0b/users/fffb88012e654453acdf32dc08a6540f/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:12.785565 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e898441-cc31-42b2-9092-de98785ca426 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:12.785987 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e898441-cc31-42b2-9092-de98785ca426 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:12.786402 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e898441-cc31-42b2-9092-de98785ca426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:12.824705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-8e898441-cc31-42b2-9092-de98785ca426 None None] MFA Rules not processed for user `fffb88012e654453acdf32dc08a6540f`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:12.827489 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-8e898441-cc31-42b2-9092-de98785ca426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:12.905024 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1261/2507] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:12.909083 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307666e4-4878-45b8-a7f1-2ed2e4f32f7d admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:12.980497 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307666e4-4878-45b8-a7f1-2ed2e4f32f7d admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:12.985383 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe3e10-6acc-4bd8-918d-1be4885be009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:12.990100 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe3e10-6acc-4bd8-918d-1be4885be009 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:12.990100 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe3e10-6acc-4bd8-918d-1be4885be009 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:12.990100 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe3e10-6acc-4bd8-918d-1be4885be009 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:12.990100 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe3e10-6acc-4bd8-918d-1be4885be009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:12.990100 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe3e10-6acc-4bd8-918d-1be4885be009 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:13.099413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1247/2508] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:09:12 2022] POST /identity/v3/projects => generated 369 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:09:13.103293 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e898441-cc31-42b2-9092-de98785ca426 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:13.115306 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e898441-cc31-42b2-9092-de98785ca426 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:13.196246 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f3d7d-1dc3-4b55-8c67-f59f37d7a94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:13.196800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f3d7d-1dc3-4b55-8c67-f59f37d7a94f admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:13.197085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f3d7d-1dc3-4b55-8c67-f59f37d7a94f admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:13.197366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f3d7d-1dc3-4b55-8c67-f59f37d7a94f admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:13.198923 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f3d7d-1dc3-4b55-8c67-f59f37d7a94f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:13.200938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f3d7d-1dc3-4b55-8c67-f59f37d7a94f admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:13.329798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1262/2509] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:09:13 2022] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:09:13.333964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe3e10-6acc-4bd8-918d-1be4885be009 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:13.345001 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe3e10-6acc-4bd8-918d-1be4885be009 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:13.349858 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb57dae-50d1-49af-a774-b5fc9a2bd554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:13.350523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb57dae-50d1-49af-a774-b5fc9a2bd554 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:13.350805 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb57dae-50d1-49af-a774-b5fc9a2bd554 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:13.351079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb57dae-50d1-49af-a774-b5fc9a2bd554 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:13.351876 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb57dae-50d1-49af-a774-b5fc9a2bd554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:13.353487 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb57dae-50d1-49af-a774-b5fc9a2bd554 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:13.365150 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1248/2510] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:13.369913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f3d7d-1dc3-4b55-8c67-f59f37d7a94f admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:13.382482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f3d7d-1dc3-4b55-8c67-f59f37d7a94f admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:13.388160 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5ea6b-ece5-4035-807a-134b81cfbcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:13.388928 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5ea6b-ece5-4035-807a-134b81cfbcff admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:13.389230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5ea6b-ece5-4035-807a-134b81cfbcff admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:13.389488 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5ea6b-ece5-4035-807a-134b81cfbcff admin admin] PATH_INFO: `/v3/projects/3f1ecc83c7e04bd2858e05442173504a/users/dd939b638e5f426a8d5140e2eaf8db71/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:13.408200 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5ea6b-ece5-4035-807a-134b81cfbcff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1ecc83c7e04bd2858e05442173504a, user_id=dd939b638e5f426a8d5140e2eaf8db71, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:13.411147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5ea6b-ece5-4035-807a-134b81cfbcff admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:13.484515 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1263/2511] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:13 2022] PUT /identity/v3/projects/3f1ecc83c7e04bd2858e05442173504a/users/dd939b638e5f426a8d5140e2eaf8db71/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:13.489521 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb57dae-50d1-49af-a774-b5fc9a2bd554 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:13.501046 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb57dae-50d1-49af-a774-b5fc9a2bd554 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:13.561998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afecd3-4c3a-416e-b456-cf934449d1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:13.562639 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afecd3-4c3a-416e-b456-cf934449d1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:13.562918 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afecd3-4c3a-416e-b456-cf934449d1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:13.563287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afecd3-4c3a-416e-b456-cf934449d1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:13.564039 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afecd3-4c3a-416e-b456-cf934449d1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:13.565746 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afecd3-4c3a-416e-b456-cf934449d1c4 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:13.577017 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1249/2512] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:13.581310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5ea6b-ece5-4035-807a-134b81cfbcff admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:13.593514 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5ea6b-ece5-4035-807a-134b81cfbcff admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:13.600204 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3a4ce-ec5f-4b31-a5c7-bb4e16c73c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:13.600895 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3a4ce-ec5f-4b31-a5c7-bb4e16c73c01 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:13.601175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3a4ce-ec5f-4b31-a5c7-bb4e16c73c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:13.601450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3a4ce-ec5f-4b31-a5c7-bb4e16c73c01 admin admin] PATH_INFO: `/v3/projects/3f1ecc83c7e04bd2858e05442173504a/users/dd939b638e5f426a8d5140e2eaf8db71/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:13.603743 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3a4ce-ec5f-4b31-a5c7-bb4e16c73c01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f1ecc83c7e04bd2858e05442173504a, user_id=dd939b638e5f426a8d5140e2eaf8db71, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:13.606468 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3a4ce-ec5f-4b31-a5c7-bb4e16c73c01 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:13.618727 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1264/2513] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:13 2022] PUT /identity/v3/projects/3f1ecc83c7e04bd2858e05442173504a/users/dd939b638e5f426a8d5140e2eaf8db71/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:13.630072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92b7ca-4f2c-4740-826e-530eb3d855b1 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:13.630413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92b7ca-4f2c-4740-826e-530eb3d855b1 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:13.630816 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92b7ca-4f2c-4740-826e-530eb3d855b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:13.666462 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-1a92b7ca-4f2c-4740-826e-530eb3d855b1 None None] MFA Rules not processed for user `dd939b638e5f426a8d5140e2eaf8db71`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:13.668083 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-1a92b7ca-4f2c-4740-826e-530eb3d855b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:13.687395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:13.757887 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1250/2514] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:13 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:13.769882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3a4ce-ec5f-4b31-a5c7-bb4e16c73c01 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:13.771726 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-80b3a4ce-ec5f-4b31-a5c7-bb4e16c73c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:13.824105 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:13.839819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3a4ce-ec5f-4b31-a5c7-bb4e16c73c01 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:13.843689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9897607-85f9-4e2f-9415-9eabcf610d34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:13.844315 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9897607-85f9-4e2f-9415-9eabcf610d34 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:13.844588 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9897607-85f9-4e2f-9415-9eabcf610d34 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:13.844859 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9897607-85f9-4e2f-9415-9eabcf610d34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:13.854470 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9897607-85f9-4e2f-9415-9eabcf610d34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:13.855956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9897607-85f9-4e2f-9415-9eabcf610d34 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:13.865806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1265/2515] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:13 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:09:16.849753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92b7ca-4f2c-4740-826e-530eb3d855b1 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:16.920922 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92b7ca-4f2c-4740-826e-530eb3d855b1 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:16.926187 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f1758-1a93-4dc1-b8fc-efcd3f6285fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:16.926853 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f1758-1a93-4dc1-b8fc-efcd3f6285fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:16.927134 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f1758-1a93-4dc1-b8fc-efcd3f6285fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:16.927511 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f1758-1a93-4dc1-b8fc-efcd3f6285fa admin admin] PATH_INFO: `/v3/users/fffb88012e654453acdf32dc08a6540f` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:16.928650 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f1758-1a93-4dc1-b8fc-efcd3f6285fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fffb88012e654453acdf32dc08a6540f)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:16.930581 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f1758-1a93-4dc1-b8fc-efcd3f6285fa admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:17.135356 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b37f1758-1a93-4dc1-b8fc-efcd3f6285fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fffb88012e654453acdf32dc08a6540f'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:17.136017 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b37f1758-1a93-4dc1-b8fc-efcd3f6285fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fffb88012e654453acdf32dc08a6540f'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:17.210755 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b37f1758-1a93-4dc1-b8fc-efcd3f6285fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fffb88012e654453acdf32dc08a6540f'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:17.218661 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b37f1758-1a93-4dc1-b8fc-efcd3f6285fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fffb88012e654453acdf32dc08a6540f'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:17.231497 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b37f1758-1a93-4dc1-b8fc-efcd3f6285fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fffb88012e654453acdf32dc08a6540f'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:17.237607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1251/2516] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:09:16 2022] DELETE /identity/v3/users/fffb88012e654453acdf32dc08a6540f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:17.242141 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c40064-e29a-4ffa-b14f-534752e7c419 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:17.242640 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c40064-e29a-4ffa-b14f-534752e7c419 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:17.242776 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c40064-e29a-4ffa-b14f-534752e7c419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:17.262968 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-f0c40064-e29a-4ffa-b14f-534752e7c419 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:17.264245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f0c40064-e29a-4ffa-b14f-534752e7c419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:17.324952 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1266/2517] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:17.337593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f1758-1a93-4dc1-b8fc-efcd3f6285fa admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:17.340648 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b37f1758-1a93-4dc1-b8fc-efcd3f6285fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:17.387860 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:17.411841 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f1758-1a93-4dc1-b8fc-efcd3f6285fa admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:17.415678 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e20c80-0338-46ae-a358-d7ee6bd8ef9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:17.416828 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e20c80-0338-46ae-a358-d7ee6bd8ef9a service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:17.417287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e20c80-0338-46ae-a358-d7ee6bd8ef9a service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:17.417886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e20c80-0338-46ae-a358-d7ee6bd8ef9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:17.427579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e20c80-0338-46ae-a358-d7ee6bd8ef9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:17.429034 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e20c80-0338-46ae-a358-d7ee6bd8ef9a service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:17.440187 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1252/2518] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:09:17.906729 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c40064-e29a-4ffa-b14f-534752e7c419 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:17.908521 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f0c40064-e29a-4ffa-b14f-534752e7c419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:17.921898 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c40064-e29a-4ffa-b14f-534752e7c419 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:17.926660 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a331987-b9f3-4be9-ab18-a6f29ad4a4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:17.927353 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a331987-b9f3-4be9-ab18-a6f29ad4a4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:17.927641 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a331987-b9f3-4be9-ab18-a6f29ad4a4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:17.927917 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a331987-b9f3-4be9-ab18-a6f29ad4a4b5 admin admin] PATH_INFO: `/v3/projects/8ce102f952044d25b2d1929e65397a0b` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:17.929174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a331987-b9f3-4be9-ab18-a6f29ad4a4b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ce102f952044d25b2d1929e65397a0b)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:17.931091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a331987-b9f3-4be9-ab18-a6f29ad4a4b5 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:18.041512 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-9a331987-b9f3-4be9-ab18-a6f29ad4a4b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ce102f952044d25b2d1929e65397a0b', 'request_id': 'req-9a331987-b9f3-4be9-ab18-a6f29ad4a4b5'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:18.128969 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-9a331987-b9f3-4be9-ab18-a6f29ad4a4b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ce102f952044d25b2d1929e65397a0b', 'request_id': 'req-9a331987-b9f3-4be9-ab18-a6f29ad4a4b5'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:18.136968 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-9a331987-b9f3-4be9-ab18-a6f29ad4a4b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ce102f952044d25b2d1929e65397a0b', 'request_id': 'req-9a331987-b9f3-4be9-ab18-a6f29ad4a4b5'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:18.149107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-9a331987-b9f3-4be9-ab18-a6f29ad4a4b5 admin admin] The token cache is being invalidate because project 8ce102f952044d25b2d1929e65397a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:09:18.149328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-9a331987-b9f3-4be9-ab18-a6f29ad4a4b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:18.149976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-9a331987-b9f3-4be9-ab18-a6f29ad4a4b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:18.152219 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1267/2519] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:09:17 2022] DELETE /identity/v3/projects/8ce102f952044d25b2d1929e65397a0b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:18.156299 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e20c80-0338-46ae-a358-d7ee6bd8ef9a service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:18.166028 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e20c80-0338-46ae-a358-d7ee6bd8ef9a service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:18.224143 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b4e04-c9dc-43e9-8dfa-04dfbe2f550d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:18.224789 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b4e04-c9dc-43e9-8dfa-04dfbe2f550d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:18.225103 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b4e04-c9dc-43e9-8dfa-04dfbe2f550d admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:18.225376 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b4e04-c9dc-43e9-8dfa-04dfbe2f550d admin admin] PATH_INFO: `/v3/users/dd939b638e5f426a8d5140e2eaf8db71` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:18.226530 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b4e04-c9dc-43e9-8dfa-04dfbe2f550d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd939b638e5f426a8d5140e2eaf8db71)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:18.228466 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b4e04-c9dc-43e9-8dfa-04dfbe2f550d admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:18.470990 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-491b4e04-c9dc-43e9-8dfa-04dfbe2f550d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd939b638e5f426a8d5140e2eaf8db71'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:18.471632 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-491b4e04-c9dc-43e9-8dfa-04dfbe2f550d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd939b638e5f426a8d5140e2eaf8db71'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:18.570521 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-491b4e04-c9dc-43e9-8dfa-04dfbe2f550d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd939b638e5f426a8d5140e2eaf8db71'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:18.579700 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-491b4e04-c9dc-43e9-8dfa-04dfbe2f550d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd939b638e5f426a8d5140e2eaf8db71'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:18.593228 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-491b4e04-c9dc-43e9-8dfa-04dfbe2f550d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd939b638e5f426a8d5140e2eaf8db71'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:18.599299 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1253/2520] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:09:18 2022] DELETE /identity/v3/users/dd939b638e5f426a8d5140e2eaf8db71 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:19.178919 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a331987-b9f3-4be9-ab18-a6f29ad4a4b5 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:19.180528 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9a331987-b9f3-4be9-ab18-a6f29ad4a4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:19.204535 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a331987-b9f3-4be9-ab18-a6f29ad4a4b5 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:19.276297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5829ad-64d3-46ad-b441-fa300d0a1c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:19.276416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5829ad-64d3-46ad-b441-fa300d0a1c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:19.276689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5829ad-64d3-46ad-b441-fa300d0a1c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:19.277663 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5829ad-64d3-46ad-b441-fa300d0a1c8a admin admin] PATH_INFO: `/v3/projects/3f1ecc83c7e04bd2858e05442173504a` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:19.278904 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5829ad-64d3-46ad-b441-fa300d0a1c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f1ecc83c7e04bd2858e05442173504a)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:19.281037 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5829ad-64d3-46ad-b441-fa300d0a1c8a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:19.287820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:19.390195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6e5829ad-64d3-46ad-b441-fa300d0a1c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f1ecc83c7e04bd2858e05442173504a', 'request_id': 'req-6e5829ad-64d3-46ad-b441-fa300d0a1c8a'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:19.466273 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6e5829ad-64d3-46ad-b441-fa300d0a1c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f1ecc83c7e04bd2858e05442173504a', 'request_id': 'req-6e5829ad-64d3-46ad-b441-fa300d0a1c8a'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:19.472612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6e5829ad-64d3-46ad-b441-fa300d0a1c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f1ecc83c7e04bd2858e05442173504a', 'request_id': 'req-6e5829ad-64d3-46ad-b441-fa300d0a1c8a'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:19.484108 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6e5829ad-64d3-46ad-b441-fa300d0a1c8a admin admin] The token cache is being invalidate because project 3f1ecc83c7e04bd2858e05442173504a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:09:19.487960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6e5829ad-64d3-46ad-b441-fa300d0a1c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:19.487960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6e5829ad-64d3-46ad-b441-fa300d0a1c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:19.487960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1268/2521] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:09:19 2022] DELETE /identity/v3/projects/3f1ecc83c7e04bd2858e05442173504a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:19.491672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b0cfc-34eb-449c-85b2-8c53d40b65b3 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:19.492121 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b0cfc-34eb-449c-85b2-8c53d40b65b3 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:19.492234 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b0cfc-34eb-449c-85b2-8c53d40b65b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:19.513416 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-0c4b0cfc-34eb-449c-85b2-8c53d40b65b3 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:19.514607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0c4b0cfc-34eb-449c-85b2-8c53d40b65b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:19.563896 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:19.576279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1254/2522] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:19.584355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834f1fd-175a-460b-b8a5-c644fc1731fc None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:19.584652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834f1fd-175a-460b-b8a5-c644fc1731fc None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:19.584922 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834f1fd-175a-460b-b8a5-c644fc1731fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:19.609104 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-1834f1fd-175a-460b-b8a5-c644fc1731fc None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:19.610403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-1834f1fd-175a-460b-b8a5-c644fc1731fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:19.619273 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1269/2523] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:19.624277 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b0cfc-34eb-449c-85b2-8c53d40b65b3 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:19.634391 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b0cfc-34eb-449c-85b2-8c53d40b65b3 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:19.639752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16765081-d026-48a6-a40a-f4e322ed58b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:19.640373 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16765081-d026-48a6-a40a-f4e322ed58b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:19.640649 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16765081-d026-48a6-a40a-f4e322ed58b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:19.640921 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16765081-d026-48a6-a40a-f4e322ed58b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:19.641618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16765081-d026-48a6-a40a-f4e322ed58b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:09:19.641918 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16765081-d026-48a6-a40a-f4e322ed58b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:19.643603 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16765081-d026-48a6-a40a-f4e322ed58b8 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:19.656803 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1255/2524] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:09:19.661405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834f1fd-175a-460b-b8a5-c644fc1731fc None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:19.672071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834f1fd-175a-460b-b8a5-c644fc1731fc None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:19.676873 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda89764-d7e8-484f-939a-5e588ecba72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:19.677501 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda89764-d7e8-484f-939a-5e588ecba72e admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:19.677787 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda89764-d7e8-484f-939a-5e588ecba72e admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:19.678065 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda89764-d7e8-484f-939a-5e588ecba72e admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:19.678772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda89764-d7e8-484f-939a-5e588ecba72e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:19.680770 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda89764-d7e8-484f-939a-5e588ecba72e admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:19.787145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1270/2525] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:09:19 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:09:19.788629 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16765081-d026-48a6-a40a-f4e322ed58b8 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:19.799742 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16765081-d026-48a6-a40a-f4e322ed58b8 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:19.860725 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefd7ec-e4ad-44ce-8416-1daa7d35c86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:19.861420 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefd7ec-e4ad-44ce-8416-1daa7d35c86d admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:19.861706 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefd7ec-e4ad-44ce-8416-1daa7d35c86d admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:19.861980 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefd7ec-e4ad-44ce-8416-1daa7d35c86d admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:19.862656 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefd7ec-e4ad-44ce-8416-1daa7d35c86d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:19.864600 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefd7ec-e4ad-44ce-8416-1daa7d35c86d admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:19.946271 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1256/2526] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:09:19 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:09:19.951067 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda89764-d7e8-484f-939a-5e588ecba72e admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:19.961973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda89764-d7e8-484f-939a-5e588ecba72e admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:19.967683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2efc16-2283-402d-86d3-11c181df93f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:19.968401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2efc16-2283-402d-86d3-11c181df93f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:19.968683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2efc16-2283-402d-86d3-11c181df93f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:19.968959 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2efc16-2283-402d-86d3-11c181df93f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:19.969663 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2efc16-2283-402d-86d3-11c181df93f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:19.971307 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2efc16-2283-402d-86d3-11c181df93f2 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:19.982076 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1271/2527] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:09:19.986419 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefd7ec-e4ad-44ce-8416-1daa7d35c86d admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:19.998654 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefd7ec-e4ad-44ce-8416-1daa7d35c86d admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:20.003367 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d17869-3b0f-43b3-ab4b-87caf1e04d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:20.004012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d17869-3b0f-43b3-ab4b-87caf1e04d51 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:20.004315 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d17869-3b0f-43b3-ab4b-87caf1e04d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:20.004848 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d17869-3b0f-43b3-ab4b-87caf1e04d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:20.005561 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d17869-3b0f-43b3-ab4b-87caf1e04d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:20.007163 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d17869-3b0f-43b3-ab4b-87caf1e04d51 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:20.019618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1257/2528] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:20.023945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2efc16-2283-402d-86d3-11c181df93f2 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:20.034645 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2efc16-2283-402d-86d3-11c181df93f2 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:20.039482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f66d17-bfd0-442e-b4d3-3377dbb53ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:20.040105 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f66d17-bfd0-442e-b4d3-3377dbb53ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:20.040383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f66d17-bfd0-442e-b4d3-3377dbb53ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:20.040654 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f66d17-bfd0-442e-b4d3-3377dbb53ed1 admin admin] PATH_INFO: `/v3/projects/69b047a800374800acc939c0980130b3/users/6494583b3f4f429ab94b6e40961c33df/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:20.057342 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f66d17-bfd0-442e-b4d3-3377dbb53ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b047a800374800acc939c0980130b3, user_id=6494583b3f4f429ab94b6e40961c33df, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:20.060787 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f66d17-bfd0-442e-b4d3-3377dbb53ed1 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:20.163257 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1272/2529] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:20 2022] PUT /identity/v3/projects/69b047a800374800acc939c0980130b3/users/6494583b3f4f429ab94b6e40961c33df/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:20.175752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496a198-84a7-4cec-9fb9-ab1a7cc98e4c None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:20.176290 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496a198-84a7-4cec-9fb9-ab1a7cc98e4c None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:20.176540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496a198-84a7-4cec-9fb9-ab1a7cc98e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:20.205636 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-0496a198-84a7-4cec-9fb9-ab1a7cc98e4c None None] MFA Rules not processed for user `6494583b3f4f429ab94b6e40961c33df`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:20.206893 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0496a198-84a7-4cec-9fb9-ab1a7cc98e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:20.272820 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1258/2530] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:20.278165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f66d17-bfd0-442e-b4d3-3377dbb53ed1 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:20.343989 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f66d17-bfd0-442e-b4d3-3377dbb53ed1 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:20.348712 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e2937-5303-4e54-bcac-22c9327b939e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:20.349336 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e2937-5303-4e54-bcac-22c9327b939e admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:20.349616 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e2937-5303-4e54-bcac-22c9327b939e admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:20.349890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e2937-5303-4e54-bcac-22c9327b939e admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:20.350673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e2937-5303-4e54-bcac-22c9327b939e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:20.352513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e2937-5303-4e54-bcac-22c9327b939e admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:20.458044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1273/2531] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:09:20 2022] POST /identity/v3/projects => generated 367 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:09:20.462149 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496a198-84a7-4cec-9fb9-ab1a7cc98e4c None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:20.473693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496a198-84a7-4cec-9fb9-ab1a7cc98e4c None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:20.520458 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:20.530562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddd10d-944e-4355-a09d-fc6589d05645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:20.531243 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddd10d-944e-4355-a09d-fc6589d05645 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:20.531631 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddd10d-944e-4355-a09d-fc6589d05645 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:20.534690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddd10d-944e-4355-a09d-fc6589d05645 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:20.534690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddd10d-944e-4355-a09d-fc6589d05645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:20.534690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddd10d-944e-4355-a09d-fc6589d05645 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:20.634115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1259/2532] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:09:20 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:09:20.638114 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e2937-5303-4e54-bcac-22c9327b939e admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:20.648485 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e2937-5303-4e54-bcac-22c9327b939e admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:20.653618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ea968-1b55-4b77-9669-2828bddcf17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:20.654239 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ea968-1b55-4b77-9669-2828bddcf17c admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:20.654523 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ea968-1b55-4b77-9669-2828bddcf17c admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:20.654796 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ea968-1b55-4b77-9669-2828bddcf17c admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:20.655544 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ea968-1b55-4b77-9669-2828bddcf17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:20.660850 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ea968-1b55-4b77-9669-2828bddcf17c admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:20.668330 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1274/2533] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:20.672571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddd10d-944e-4355-a09d-fc6589d05645 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:20.682899 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddd10d-944e-4355-a09d-fc6589d05645 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:20.687968 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55b923-97a9-4d91-9414-45dc1a9aa791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:20.688721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55b923-97a9-4d91-9414-45dc1a9aa791 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:20.689076 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55b923-97a9-4d91-9414-45dc1a9aa791 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:20.689373 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55b923-97a9-4d91-9414-45dc1a9aa791 admin admin] PATH_INFO: `/v3/projects/6211e5c318bd46cf91629c818cdfd3db/users/b6d2088b2f7740fdba728b9c1594ebe4/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:20.704785 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55b923-97a9-4d91-9414-45dc1a9aa791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6211e5c318bd46cf91629c818cdfd3db, user_id=b6d2088b2f7740fdba728b9c1594ebe4, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:20.707503 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55b923-97a9-4d91-9414-45dc1a9aa791 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:20.770364 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1260/2534] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:20 2022] PUT /identity/v3/projects/6211e5c318bd46cf91629c818cdfd3db/users/b6d2088b2f7740fdba728b9c1594ebe4/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:20.774595 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ea968-1b55-4b77-9669-2828bddcf17c admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:20.783642 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:20.788145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ea968-1b55-4b77-9669-2828bddcf17c admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:20.845378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2003303-19ce-453a-bab8-129ff2b300b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:20.846009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2003303-19ce-453a-bab8-129ff2b300b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:20.846295 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2003303-19ce-453a-bab8-129ff2b300b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:20.846566 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2003303-19ce-453a-bab8-129ff2b300b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:20.847257 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2003303-19ce-453a-bab8-129ff2b300b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:20.848892 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2003303-19ce-453a-bab8-129ff2b300b5 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:20.859798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1275/2535] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:20.864176 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55b923-97a9-4d91-9414-45dc1a9aa791 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:20.874412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55b923-97a9-4d91-9414-45dc1a9aa791 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:20.878975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85271cfc-e3c4-40d8-840c-b031f9f5940d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:20.879923 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85271cfc-e3c4-40d8-840c-b031f9f5940d admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:20.880204 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85271cfc-e3c4-40d8-840c-b031f9f5940d admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:20.880473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85271cfc-e3c4-40d8-840c-b031f9f5940d admin admin] PATH_INFO: `/v3/projects/6211e5c318bd46cf91629c818cdfd3db/users/b6d2088b2f7740fdba728b9c1594ebe4/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:20.882421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85271cfc-e3c4-40d8-840c-b031f9f5940d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6211e5c318bd46cf91629c818cdfd3db, user_id=b6d2088b2f7740fdba728b9c1594ebe4, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:20.885171 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85271cfc-e3c4-40d8-840c-b031f9f5940d admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:20.896785 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1261/2536] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:20 2022] PUT /identity/v3/projects/6211e5c318bd46cf91629c818cdfd3db/users/b6d2088b2f7740fdba728b9c1594ebe4/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:20.907878 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7415a-d114-4723-8f71-b73070afc63e None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:20.908167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7415a-d114-4723-8f71-b73070afc63e None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:20.908444 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7415a-d114-4723-8f71-b73070afc63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:20.937376 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-b6c7415a-d114-4723-8f71-b73070afc63e None None] MFA Rules not processed for user `b6d2088b2f7740fdba728b9c1594ebe4`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:20.938607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b6c7415a-d114-4723-8f71-b73070afc63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:21.017342 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1276/2537] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:21.029352 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85271cfc-e3c4-40d8-840c-b031f9f5940d admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:21.031203 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-85271cfc-e3c4-40d8-840c-b031f9f5940d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:21.092390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85271cfc-e3c4-40d8-840c-b031f9f5940d admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:21.095999 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b02d8-73c2-4693-b6e3-376521065f8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:21.096611 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b02d8-73c2-4693-b6e3-376521065f8f service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:21.096896 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b02d8-73c2-4693-b6e3-376521065f8f service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:21.097167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b02d8-73c2-4693-b6e3-376521065f8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:21.106457 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b02d8-73c2-4693-b6e3-376521065f8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:21.108109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b02d8-73c2-4693-b6e3-376521065f8f service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:21.118036 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1262/2538] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:09:21.265533 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7415a-d114-4723-8f71-b73070afc63e None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:21.267431 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b6c7415a-d114-4723-8f71-b73070afc63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:21.279869 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7415a-d114-4723-8f71-b73070afc63e None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:21.284355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f34f6d-2176-4109-90ad-489566548026 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:21.284987 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f34f6d-2176-4109-90ad-489566548026 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:21.285265 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f34f6d-2176-4109-90ad-489566548026 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:21.285562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f34f6d-2176-4109-90ad-489566548026 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:21.347379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f34f6d-2176-4109-90ad-489566548026 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:21.348880 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f34f6d-2176-4109-90ad-489566548026 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:21.358288 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1277/2539] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:09:26.607885 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b02d8-73c2-4693-b6e3-376521065f8f service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:26.671991 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b02d8-73c2-4693-b6e3-376521065f8f service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:26.676577 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b1470-8015-4775-ad45-54b441db5e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:26.677225 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b1470-8015-4775-ad45-54b441db5e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:26.677505 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b1470-8015-4775-ad45-54b441db5e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:26.677785 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b1470-8015-4775-ad45-54b441db5e70 admin admin] PATH_INFO: `/v3/users/6494583b3f4f429ab94b6e40961c33df` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:26.678946 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b1470-8015-4775-ad45-54b441db5e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6494583b3f4f429ab94b6e40961c33df)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:26.680913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b1470-8015-4775-ad45-54b441db5e70 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:26.891752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5b3b1470-8015-4775-ad45-54b441db5e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6494583b3f4f429ab94b6e40961c33df'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:26.892405 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5b3b1470-8015-4775-ad45-54b441db5e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6494583b3f4f429ab94b6e40961c33df'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:26.894114 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:26.986492 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f34f6d-2176-4109-90ad-489566548026 service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:26.987959 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-88f34f6d-2176-4109-90ad-489566548026 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:26.988226 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5b3b1470-8015-4775-ad45-54b441db5e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6494583b3f4f429ab94b6e40961c33df'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:26.996150 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5b3b1470-8015-4775-ad45-54b441db5e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6494583b3f4f429ab94b6e40961c33df'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:27.010375 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5b3b1470-8015-4775-ad45-54b441db5e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6494583b3f4f429ab94b6e40961c33df'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:27.017873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1263/2540] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:09:26 2022] DELETE /identity/v3/users/6494583b3f4f429ab94b6e40961c33df => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:27.018656 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:27.022233 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e1480-38d0-4edd-ba0f-bcd88d83b73f None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:27.022522 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e1480-38d0-4edd-ba0f-bcd88d83b73f None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:27.022802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e1480-38d0-4edd-ba0f-bcd88d83b73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:27.043094 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-0c8e1480-38d0-4edd-ba0f-bcd88d83b73f None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:27.044340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0c8e1480-38d0-4edd-ba0f-bcd88d83b73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:27.049707 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f34f6d-2176-4109-90ad-489566548026 service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:27.103461 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54facb7b-1fee-4360-81f8-a6114b85e586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:27.104181 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54facb7b-1fee-4360-81f8-a6114b85e586 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:27.104541 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54facb7b-1fee-4360-81f8-a6114b85e586 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:27.105027 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54facb7b-1fee-4360-81f8-a6114b85e586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:27.107096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-54facb7b-1fee-4360-81f8-a6114b85e586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:27.108455 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1264/2541] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:09:27.119063 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e1480-38d0-4edd-ba0f-bcd88d83b73f None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:27.120253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54facb7b-1fee-4360-81f8-a6114b85e586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:27.120599 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0c8e1480-38d0-4edd-ba0f-bcd88d83b73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:27.121764 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54facb7b-1fee-4360-81f8-a6114b85e586 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:27.132528 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1278/2542] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:09:27.133313 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e1480-38d0-4edd-ba0f-bcd88d83b73f None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:27.137701 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d11ef-98a9-42c2-bf9f-b3f11028556b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:27.138266 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d11ef-98a9-42c2-bf9f-b3f11028556b service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:27.138544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d11ef-98a9-42c2-bf9f-b3f11028556b service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:27.138819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d11ef-98a9-42c2-bf9f-b3f11028556b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:27.148234 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d11ef-98a9-42c2-bf9f-b3f11028556b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:27.149677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d11ef-98a9-42c2-bf9f-b3f11028556b service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:27.160405 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1265/2543] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:09:27.990034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54facb7b-1fee-4360-81f8-a6114b85e586 service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:27.991922 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-54facb7b-1fee-4360-81f8-a6114b85e586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:28.005688 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54facb7b-1fee-4360-81f8-a6114b85e586 service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:28.010678 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc246ed-f7a2-4eb9-8b45-490f3992f7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:28.017018 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc246ed-f7a2-4eb9-8b45-490f3992f7fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:28.017018 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc246ed-f7a2-4eb9-8b45-490f3992f7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:28.017018 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc246ed-f7a2-4eb9-8b45-490f3992f7fc admin admin] PATH_INFO: `/v3/projects/69b047a800374800acc939c0980130b3` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:28.017018 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc246ed-f7a2-4eb9-8b45-490f3992f7fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b047a800374800acc939c0980130b3)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:28.017018 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc246ed-f7a2-4eb9-8b45-490f3992f7fc admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:28.113068 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-0dc246ed-f7a2-4eb9-8b45-490f3992f7fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b047a800374800acc939c0980130b3', 'request_id': 'req-0dc246ed-f7a2-4eb9-8b45-490f3992f7fc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:28.187642 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-0dc246ed-f7a2-4eb9-8b45-490f3992f7fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b047a800374800acc939c0980130b3', 'request_id': 'req-0dc246ed-f7a2-4eb9-8b45-490f3992f7fc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:28.196833 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-0dc246ed-f7a2-4eb9-8b45-490f3992f7fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b047a800374800acc939c0980130b3', 'request_id': 'req-0dc246ed-f7a2-4eb9-8b45-490f3992f7fc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:28.208580 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-0dc246ed-f7a2-4eb9-8b45-490f3992f7fc admin admin] The token cache is being invalidate because project 69b047a800374800acc939c0980130b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:09:28.208858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-0dc246ed-f7a2-4eb9-8b45-490f3992f7fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:28.209519 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-0dc246ed-f7a2-4eb9-8b45-490f3992f7fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:28.211259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1279/2544] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:09:27 2022] DELETE /identity/v3/projects/69b047a800374800acc939c0980130b3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:28.216322 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d11ef-98a9-42c2-bf9f-b3f11028556b service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:28.226749 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d11ef-98a9-42c2-bf9f-b3f11028556b service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:28.286888 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0a0a6-0131-45c3-bcb8-8e1571616c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:28.287803 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0a0a6-0131-45c3-bcb8-8e1571616c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:28.288084 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0a0a6-0131-45c3-bcb8-8e1571616c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:28.288359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0a0a6-0131-45c3-bcb8-8e1571616c73 admin admin] PATH_INFO: `/v3/users/b6d2088b2f7740fdba728b9c1594ebe4` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:28.289886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0a0a6-0131-45c3-bcb8-8e1571616c73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6d2088b2f7740fdba728b9c1594ebe4)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:28.292021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0a0a6-0131-45c3-bcb8-8e1571616c73 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:28.504962 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-8ba0a0a6-0131-45c3-bcb8-8e1571616c73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6d2088b2f7740fdba728b9c1594ebe4'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:28.505780 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-8ba0a0a6-0131-45c3-bcb8-8e1571616c73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6d2088b2f7740fdba728b9c1594ebe4'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:28.582324 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-8ba0a0a6-0131-45c3-bcb8-8e1571616c73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6d2088b2f7740fdba728b9c1594ebe4'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:28.584135 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:28.591922 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-8ba0a0a6-0131-45c3-bcb8-8e1571616c73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6d2088b2f7740fdba728b9c1594ebe4'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:28.606560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-8ba0a0a6-0131-45c3-bcb8-8e1571616c73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6d2088b2f7740fdba728b9c1594ebe4'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:28.613776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1266/2545] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:09:28 2022] DELETE /identity/v3/users/b6d2088b2f7740fdba728b9c1594ebe4 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:29.278507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc246ed-f7a2-4eb9-8b45-490f3992f7fc admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:29.280078 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-0dc246ed-f7a2-4eb9-8b45-490f3992f7fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:29.295527 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc246ed-f7a2-4eb9-8b45-490f3992f7fc admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:29.364828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67824a9e-9fc0-4cf9-8dcb-35dc12e63b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:29.366037 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67824a9e-9fc0-4cf9-8dcb-35dc12e63b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:29.366536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67824a9e-9fc0-4cf9-8dcb-35dc12e63b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:29.367042 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67824a9e-9fc0-4cf9-8dcb-35dc12e63b6d admin admin] PATH_INFO: `/v3/projects/6211e5c318bd46cf91629c818cdfd3db` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:29.368482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67824a9e-9fc0-4cf9-8dcb-35dc12e63b6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6211e5c318bd46cf91629c818cdfd3db)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:29.371469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67824a9e-9fc0-4cf9-8dcb-35dc12e63b6d admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:29.381454 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:29.498942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-67824a9e-9fc0-4cf9-8dcb-35dc12e63b6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6211e5c318bd46cf91629c818cdfd3db', 'request_id': 'req-67824a9e-9fc0-4cf9-8dcb-35dc12e63b6d'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:29.599830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-67824a9e-9fc0-4cf9-8dcb-35dc12e63b6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6211e5c318bd46cf91629c818cdfd3db', 'request_id': 'req-67824a9e-9fc0-4cf9-8dcb-35dc12e63b6d'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:29.608756 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-67824a9e-9fc0-4cf9-8dcb-35dc12e63b6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6211e5c318bd46cf91629c818cdfd3db', 'request_id': 'req-67824a9e-9fc0-4cf9-8dcb-35dc12e63b6d'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:29.626184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-67824a9e-9fc0-4cf9-8dcb-35dc12e63b6d admin admin] The token cache is being invalidate because project 6211e5c318bd46cf91629c818cdfd3db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:09:29.626667 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-67824a9e-9fc0-4cf9-8dcb-35dc12e63b6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:29.627684 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-67824a9e-9fc0-4cf9-8dcb-35dc12e63b6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:29.633857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1280/2546] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:09:29 2022] DELETE /identity/v3/projects/6211e5c318bd46cf91629c818cdfd3db => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:29.635708 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d979b3d-0c38-49ea-a56c-853c4d97cd1c None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:29.636250 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d979b3d-0c38-49ea-a56c-853c4d97cd1c None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:29.636720 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d979b3d-0c38-49ea-a56c-853c4d97cd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:29.658673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-5d979b3d-0c38-49ea-a56c-853c4d97cd1c None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:29.660093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-5d979b3d-0c38-49ea-a56c-853c4d97cd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:29.751740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1267/2547] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:29.759837 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a76eef-fa23-4c7b-bd5c-1745ada2f74b None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:29.760125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a76eef-fa23-4c7b-bd5c-1745ada2f74b None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:29.760401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a76eef-fa23-4c7b-bd5c-1745ada2f74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:29.797832 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-11a76eef-fa23-4c7b-bd5c-1745ada2f74b None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:29.799771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-11a76eef-fa23-4c7b-bd5c-1745ada2f74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:29.809633 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1281/2548] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:29.814033 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d979b3d-0c38-49ea-a56c-853c4d97cd1c None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:29.830200 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d979b3d-0c38-49ea-a56c-853c4d97cd1c None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:29.836030 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b4066-fce4-425b-8b42-4b14386b8222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:29.836835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b4066-fce4-425b-8b42-4b14386b8222 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:29.837127 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b4066-fce4-425b-8b42-4b14386b8222 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:29.837404 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b4066-fce4-425b-8b42-4b14386b8222 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:29.838116 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b4066-fce4-425b-8b42-4b14386b8222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:09:29.838420 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b4066-fce4-425b-8b42-4b14386b8222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:29.840827 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b4066-fce4-425b-8b42-4b14386b8222 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:29.853557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1268/2549] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:09:29.858322 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a76eef-fa23-4c7b-bd5c-1745ada2f74b None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:29.867962 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a76eef-fa23-4c7b-bd5c-1745ada2f74b None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:29.872970 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796c8af-ad9b-480e-8b10-1908abea3189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:29.873595 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796c8af-ad9b-480e-8b10-1908abea3189 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:29.873874 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796c8af-ad9b-480e-8b10-1908abea3189 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:29.874153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796c8af-ad9b-480e-8b10-1908abea3189 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:29.874826 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796c8af-ad9b-480e-8b10-1908abea3189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:29.876833 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796c8af-ad9b-480e-8b10-1908abea3189 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:30.013146 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1282/2550] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:09:29 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:09:30.017283 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b4066-fce4-425b-8b42-4b14386b8222 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:30.028851 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b4066-fce4-425b-8b42-4b14386b8222 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:30.087724 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff8c9f-beee-428b-82be-2910107a3ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:30.088272 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff8c9f-beee-428b-82be-2910107a3ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:30.088551 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff8c9f-beee-428b-82be-2910107a3ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:30.088825 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff8c9f-beee-428b-82be-2910107a3ce0 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:30.090316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff8c9f-beee-428b-82be-2910107a3ce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:30.092432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff8c9f-beee-428b-82be-2910107a3ce0 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:30.177138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1269/2551] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:09:30 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:09:30.181499 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796c8af-ad9b-480e-8b10-1908abea3189 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:30.194621 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796c8af-ad9b-480e-8b10-1908abea3189 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:30.200720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0530fa-e551-4ee0-8852-19691336a7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:30.201511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0530fa-e551-4ee0-8852-19691336a7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:30.201924 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0530fa-e551-4ee0-8852-19691336a7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:30.202266 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0530fa-e551-4ee0-8852-19691336a7e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:30.203051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0530fa-e551-4ee0-8852-19691336a7e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:30.204881 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0530fa-e551-4ee0-8852-19691336a7e5 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:30.216415 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1283/2552] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:30.220587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff8c9f-beee-428b-82be-2910107a3ce0 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:30.235825 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff8c9f-beee-428b-82be-2910107a3ce0 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:30.239183 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56a3f8-8055-423a-b703-f40759add200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:30.239868 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56a3f8-8055-423a-b703-f40759add200 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:30.240149 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56a3f8-8055-423a-b703-f40759add200 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:30.240422 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56a3f8-8055-423a-b703-f40759add200 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:30.241117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56a3f8-8055-423a-b703-f40759add200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:30.242715 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56a3f8-8055-423a-b703-f40759add200 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:30.256210 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1270/2553] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:30.260432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0530fa-e551-4ee0-8852-19691336a7e5 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:30.271043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0530fa-e551-4ee0-8852-19691336a7e5 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:30.277194 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89fc22-5552-4f99-801f-50ea676e559f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:30.278195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89fc22-5552-4f99-801f-50ea676e559f admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:30.278195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89fc22-5552-4f99-801f-50ea676e559f admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:30.278427 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89fc22-5552-4f99-801f-50ea676e559f admin admin] PATH_INFO: `/v3/projects/27d3bb30e5fb4e049d75f15714b8b57b/users/99cc62059dfd4593ba66380d708652bc/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:30.294855 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89fc22-5552-4f99-801f-50ea676e559f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d3bb30e5fb4e049d75f15714b8b57b, user_id=99cc62059dfd4593ba66380d708652bc, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:30.297895 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89fc22-5552-4f99-801f-50ea676e559f admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:30.369349 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1284/2554] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:30 2022] PUT /identity/v3/projects/27d3bb30e5fb4e049d75f15714b8b57b/users/99cc62059dfd4593ba66380d708652bc/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:30.439961 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62563ff7-4799-4628-9898-4f3e3311fcf8 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:30.440253 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62563ff7-4799-4628-9898-4f3e3311fcf8 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:30.440539 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62563ff7-4799-4628-9898-4f3e3311fcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:30.470241 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-62563ff7-4799-4628-9898-4f3e3311fcf8 None None] MFA Rules not processed for user `99cc62059dfd4593ba66380d708652bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:30.471491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-62563ff7-4799-4628-9898-4f3e3311fcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:30.498207 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:30.538482 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1271/2555] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:30.543672 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89fc22-5552-4f99-801f-50ea676e559f admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:30.611694 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89fc22-5552-4f99-801f-50ea676e559f admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:30.617818 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374362ad-04fc-4484-acf8-4f52862b1d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:30.618466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374362ad-04fc-4484-acf8-4f52862b1d4e admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:30.618742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374362ad-04fc-4484-acf8-4f52862b1d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:30.619562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374362ad-04fc-4484-acf8-4f52862b1d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:30.619734 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374362ad-04fc-4484-acf8-4f52862b1d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:30.623070 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374362ad-04fc-4484-acf8-4f52862b1d4e admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:30.730191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1285/2556] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:09:30 2022] POST /identity/v3/projects => generated 379 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:09:30.734173 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62563ff7-4799-4628-9898-4f3e3311fcf8 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:30.755739 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62563ff7-4799-4628-9898-4f3e3311fcf8 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:30.856499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8e9d0-c491-4ebf-bf47-50ee9a4dc9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:30.857415 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8e9d0-c491-4ebf-bf47-50ee9a4dc9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:30.857795 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8e9d0-c491-4ebf-bf47-50ee9a4dc9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:30.858312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8e9d0-c491-4ebf-bf47-50ee9a4dc9a5 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:30.860404 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8e9d0-c491-4ebf-bf47-50ee9a4dc9a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:30.862511 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8e9d0-c491-4ebf-bf47-50ee9a4dc9a5 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:30.937589 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1272/2557] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:09:30 2022] POST /identity/v3/users => generated 296 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:09:30.941788 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374362ad-04fc-4484-acf8-4f52862b1d4e admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:30.956483 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374362ad-04fc-4484-acf8-4f52862b1d4e admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:30.962561 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2505e8-d179-404f-8e1c-767a8d2a9353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:30.963299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2505e8-d179-404f-8e1c-767a8d2a9353 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:30.963705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2505e8-d179-404f-8e1c-767a8d2a9353 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:30.964621 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2505e8-d179-404f-8e1c-767a8d2a9353 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:30.965384 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2505e8-d179-404f-8e1c-767a8d2a9353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:30.967086 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2505e8-d179-404f-8e1c-767a8d2a9353 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:30.979059 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1286/2558] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:30.984045 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8e9d0-c491-4ebf-bf47-50ee9a4dc9a5 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:30.994638 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8e9d0-c491-4ebf-bf47-50ee9a4dc9a5 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:31.000290 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3450a0e-7f27-4c7b-a9cf-9e54722893dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:31.000843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450a0e-7f27-4c7b-a9cf-9e54722893dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:31.001190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450a0e-7f27-4c7b-a9cf-9e54722893dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:31.001514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450a0e-7f27-4c7b-a9cf-9e54722893dd admin admin] PATH_INFO: `/v3/projects/ccc291623df34e1ea52a9a069599143f/users/2739ac3da21949f489ea1a0a108b9607/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:31.030885 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3450a0e-7f27-4c7b-a9cf-9e54722893dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc291623df34e1ea52a9a069599143f, user_id=2739ac3da21949f489ea1a0a108b9607, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:31.033187 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3450a0e-7f27-4c7b-a9cf-9e54722893dd admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:31.120172 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1273/2559] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:30 2022] PUT /identity/v3/projects/ccc291623df34e1ea52a9a069599143f/users/2739ac3da21949f489ea1a0a108b9607/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:31.124560 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2505e8-d179-404f-8e1c-767a8d2a9353 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:31.140909 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2505e8-d179-404f-8e1c-767a8d2a9353 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:31.145089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:31.185726 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3450a0e-7f27-4c7b-a9cf-9e54722893dd admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:31.187559 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b3450a0e-7f27-4c7b-a9cf-9e54722893dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:31.209287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51a5c0-a5b3-4b4f-9af5-da3ad96af108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:31.211181 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51a5c0-a5b3-4b4f-9af5-da3ad96af108 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:31.211713 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51a5c0-a5b3-4b4f-9af5-da3ad96af108 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:31.213042 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51a5c0-a5b3-4b4f-9af5-da3ad96af108 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:31.213939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51a5c0-a5b3-4b4f-9af5-da3ad96af108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:31.216605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51a5c0-a5b3-4b4f-9af5-da3ad96af108 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:31.228973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1287/2560] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:31.233926 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51a5c0-a5b3-4b4f-9af5-da3ad96af108 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:31.244263 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51a5c0-a5b3-4b4f-9af5-da3ad96af108 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:31.249011 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72168b85-1c9a-4b8b-8cd5-4d4ed6ab88ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:31.249732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72168b85-1c9a-4b8b-8cd5-4d4ed6ab88ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:31.250047 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72168b85-1c9a-4b8b-8cd5-4d4ed6ab88ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:31.250371 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72168b85-1c9a-4b8b-8cd5-4d4ed6ab88ee admin admin] PATH_INFO: `/v3/projects/ccc291623df34e1ea52a9a069599143f/users/2739ac3da21949f489ea1a0a108b9607/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:31.252405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72168b85-1c9a-4b8b-8cd5-4d4ed6ab88ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc291623df34e1ea52a9a069599143f, user_id=2739ac3da21949f489ea1a0a108b9607, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:31.255386 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72168b85-1c9a-4b8b-8cd5-4d4ed6ab88ee admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:31.264235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3450a0e-7f27-4c7b-a9cf-9e54722893dd admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:31.266973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1288/2561] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:31 2022] PUT /identity/v3/projects/ccc291623df34e1ea52a9a069599143f/users/2739ac3da21949f489ea1a0a108b9607/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:09:31.277987 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2700a0-0403-4f4f-a7aa-df4fb519b3b9 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:31.278272 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2700a0-0403-4f4f-a7aa-df4fb519b3b9 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:31.278568 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2700a0-0403-4f4f-a7aa-df4fb519b3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:31.310532 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:31.313495 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-5b2700a0-0403-4f4f-a7aa-df4fb519b3b9 None None] MFA Rules not processed for user `2739ac3da21949f489ea1a0a108b9607`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:31.314747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-5b2700a0-0403-4f4f-a7aa-df4fb519b3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:31.342289 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08734a-1c74-4e1b-ac6f-329b07f51512 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f2584622a48bba21e1bf31c1aef30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:31.342866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08734a-1c74-4e1b-ac6f-329b07f51512 service placement] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:31.343151 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08734a-1c74-4e1b-ac6f-329b07f51512 service placement] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:31.343478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08734a-1c74-4e1b-ac6f-329b07f51512 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:31.345290 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-8c08734a-1c74-4e1b-ac6f-329b07f51512 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:31.357050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08734a-1c74-4e1b-ac6f-329b07f51512 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:31.358698 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08734a-1c74-4e1b-ac6f-329b07f51512 service placement] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:31.369317 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1274/2562] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:09:31.369995 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08734a-1c74-4e1b-ac6f-329b07f51512 service placement] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:31.371691 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-8c08734a-1c74-4e1b-ac6f-329b07f51512 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:31.394322 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1289/2563] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:09:31.408251 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2700a0-0403-4f4f-a7aa-df4fb519b3b9 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:31.409915 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-5b2700a0-0403-4f4f-a7aa-df4fb519b3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:31.443926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08734a-1c74-4e1b-ac6f-329b07f51512 service placement] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:31.449479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478f949-7874-490c-b4d3-0cfaace6cf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:31.450188 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478f949-7874-490c-b4d3-0cfaace6cf1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:31.450498 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478f949-7874-490c-b4d3-0cfaace6cf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:31.450778 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478f949-7874-490c-b4d3-0cfaace6cf1a admin admin] PATH_INFO: `/v3/users/414b0f1addcc487fb2834b16d7047923` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:31.452044 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478f949-7874-490c-b4d3-0cfaace6cf1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=414b0f1addcc487fb2834b16d7047923)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:31.453990 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478f949-7874-490c-b4d3-0cfaace6cf1a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:31.471166 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2700a0-0403-4f4f-a7aa-df4fb519b3b9 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:31.474858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ba4ec-1501-41bc-a08c-04d6ff0e8d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:31.476309 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ba4ec-1501-41bc-a08c-04d6ff0e8d5a service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:31.476585 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ba4ec-1501-41bc-a08c-04d6ff0e8d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:31.476854 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ba4ec-1501-41bc-a08c-04d6ff0e8d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:31.486867 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ba4ec-1501-41bc-a08c-04d6ff0e8d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:31.488338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ba4ec-1501-41bc-a08c-04d6ff0e8d5a service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:31.498056 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1290/2564] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:09:31.643881 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f478f949-7874-490c-b4d3-0cfaace6cf1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '414b0f1addcc487fb2834b16d7047923'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:31.644947 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f478f949-7874-490c-b4d3-0cfaace6cf1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '414b0f1addcc487fb2834b16d7047923'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:31.724831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f478f949-7874-490c-b4d3-0cfaace6cf1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '414b0f1addcc487fb2834b16d7047923'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:31.736216 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f478f949-7874-490c-b4d3-0cfaace6cf1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '414b0f1addcc487fb2834b16d7047923'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:31.753496 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f478f949-7874-490c-b4d3-0cfaace6cf1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '414b0f1addcc487fb2834b16d7047923'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:31.761836 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1275/2565] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:09:31 2022] DELETE /identity/v3/users/414b0f1addcc487fb2834b16d7047923 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:32.103491 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ba4ec-1501-41bc-a08c-04d6ff0e8d5a service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:32.125182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ba4ec-1501-41bc-a08c-04d6ff0e8d5a service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:32.142387 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478f949-7874-490c-b4d3-0cfaace6cf1a admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:32.146188 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f478f949-7874-490c-b4d3-0cfaace6cf1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:32.148953 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:32.213871 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6197e-4ed9-4545-a8e0-019fb75b023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:32.214626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6197e-4ed9-4545-a8e0-019fb75b023a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:32.215035 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6197e-4ed9-4545-a8e0-019fb75b023a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:32.215548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6197e-4ed9-4545-a8e0-019fb75b023a admin admin] PATH_INFO: `/v3/projects/c2aaa893884440db9d577a7cde4cecbf` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:32.216916 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6197e-4ed9-4545-a8e0-019fb75b023a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2aaa893884440db9d577a7cde4cecbf)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:32.217564 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:32.218868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6197e-4ed9-4545-a8e0-019fb75b023a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:32.249287 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478f949-7874-490c-b4d3-0cfaace6cf1a admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:32.257619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7430b-2ea3-44a8-a53a-eaed5022718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:32.258820 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7430b-2ea3-44a8-a53a-eaed5022718c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:32.258820 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7430b-2ea3-44a8-a53a-eaed5022718c admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:32.259030 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7430b-2ea3-44a8-a53a-eaed5022718c admin admin] PATH_INFO: `/v3/users/99cc62059dfd4593ba66380d708652bc` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:32.260354 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7430b-2ea3-44a8-a53a-eaed5022718c admin admin] RBAC: Authorizing `identity:delete_user(user_id=99cc62059dfd4593ba66380d708652bc)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:32.262900 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7430b-2ea3-44a8-a53a-eaed5022718c admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:32.450986 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-adb6197e-4ed9-4545-a8e0-019fb75b023a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2aaa893884440db9d577a7cde4cecbf', 'request_id': 'req-adb6197e-4ed9-4545-a8e0-019fb75b023a'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:32.575288 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-adb6197e-4ed9-4545-a8e0-019fb75b023a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2aaa893884440db9d577a7cde4cecbf', 'request_id': 'req-adb6197e-4ed9-4545-a8e0-019fb75b023a'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:32.582196 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-adb6197e-4ed9-4545-a8e0-019fb75b023a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2aaa893884440db9d577a7cde4cecbf', 'request_id': 'req-adb6197e-4ed9-4545-a8e0-019fb75b023a'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:32.595739 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-adb6197e-4ed9-4545-a8e0-019fb75b023a admin admin] The token cache is being invalidate because project c2aaa893884440db9d577a7cde4cecbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:09:32.595739 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-adb6197e-4ed9-4545-a8e0-019fb75b023a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:32.596662 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-adb6197e-4ed9-4545-a8e0-019fb75b023a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:32.607155 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1dd7430b-2ea3-44a8-a53a-eaed5022718c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99cc62059dfd4593ba66380d708652bc'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:32.613498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1291/2566] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:09:32 2022] DELETE /identity/v3/projects/c2aaa893884440db9d577a7cde4cecbf => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:32.613735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1dd7430b-2ea3-44a8-a53a-eaed5022718c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99cc62059dfd4593ba66380d708652bc'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:32.614213 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd57d3-f876-4a39-9d63-1dbb179ae02e None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:32.614512 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd57d3-f876-4a39-9d63-1dbb179ae02e None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:32.614796 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd57d3-f876-4a39-9d63-1dbb179ae02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:32.640645 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-d7bd57d3-f876-4a39-9d63-1dbb179ae02e None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:32.642472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d7bd57d3-f876-4a39-9d63-1dbb179ae02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:32.707699 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1dd7430b-2ea3-44a8-a53a-eaed5022718c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99cc62059dfd4593ba66380d708652bc'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:32.712790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1292/2567] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:09:32.719277 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1dd7430b-2ea3-44a8-a53a-eaed5022718c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99cc62059dfd4593ba66380d708652bc'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:32.724956 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936b239-fcb3-4472-bbd1-84afd03cd36e None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:32.725242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936b239-fcb3-4472-bbd1-84afd03cd36e None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:32.725520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936b239-fcb3-4472-bbd1-84afd03cd36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:32.734730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1dd7430b-2ea3-44a8-a53a-eaed5022718c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99cc62059dfd4593ba66380d708652bc'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:32.741222 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1276/2568] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:09:32 2022] DELETE /identity/v3/users/99cc62059dfd4593ba66380d708652bc => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:32.749427 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-f936b239-fcb3-4472-bbd1-84afd03cd36e None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:32.749635 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fe9ca-31f2-48e8-b215-87cc64657ef2 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:32.749635 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fe9ca-31f2-48e8-b215-87cc64657ef2 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:32.750290 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f936b239-fcb3-4472-bbd1-84afd03cd36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:32.750390 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fe9ca-31f2-48e8-b215-87cc64657ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:32.768195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-c17fe9ca-31f2-48e8-b215-87cc64657ef2 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:32.769459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c17fe9ca-31f2-48e8-b215-87cc64657ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:32.800922 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:32.818119 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1293/2569] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:09:32.825345 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936b239-fcb3-4472-bbd1-84afd03cd36e None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:32.837623 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1277/2570] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:09:32.841929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936b239-fcb3-4472-bbd1-84afd03cd36e None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:32.847567 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fe9ca-31f2-48e8-b215-87cc64657ef2 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:32.849018 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c17fe9ca-31f2-48e8-b215-87cc64657ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:32.849359 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17151456-ac78-4383-8663-9a1623f7123e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:32.850403 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17151456-ac78-4383-8663-9a1623f7123e admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:32.850964 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17151456-ac78-4383-8663-9a1623f7123e admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:32.851526 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17151456-ac78-4383-8663-9a1623f7123e admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:32.853835 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17151456-ac78-4383-8663-9a1623f7123e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:09:32.853835 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17151456-ac78-4383-8663-9a1623f7123e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:32.856926 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17151456-ac78-4383-8663-9a1623f7123e admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:32.884272 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1294/2571] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 04:09:32.885454 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17151456-ac78-4383-8663-9a1623f7123e admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:32.895667 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17151456-ac78-4383-8663-9a1623f7123e admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:32.900464 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe606b-215e-41f6-bb7f-2426f269438d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:32.901080 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe606b-215e-41f6-bb7f-2426f269438d admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:32.901363 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe606b-215e-41f6-bb7f-2426f269438d admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:32.901674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe606b-215e-41f6-bb7f-2426f269438d admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:32.902482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe606b-215e-41f6-bb7f-2426f269438d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:32.904424 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe606b-215e-41f6-bb7f-2426f269438d admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:32.910272 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fe9ca-31f2-48e8-b215-87cc64657ef2 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:32.913881 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc3efb-5083-4779-97ff-ab59a7f24e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:32.914729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc3efb-5083-4779-97ff-ab59a7f24e81 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:32.914864 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc3efb-5083-4779-97ff-ab59a7f24e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:32.915025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc3efb-5083-4779-97ff-ab59a7f24e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:32.930930 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc3efb-5083-4779-97ff-ab59a7f24e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:32.932398 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc3efb-5083-4779-97ff-ab59a7f24e81 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:32.943243 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1278/2572] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:09:33.052276 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1295/2573] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:09:32 2022] POST /identity/v3/projects => generated 391 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:09:33.056543 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc3efb-5083-4779-97ff-ab59a7f24e81 service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:33.068025 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc3efb-5083-4779-97ff-ab59a7f24e81 service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:33.071709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:33.128748 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b0928-eee5-47f0-a331-8cd1452a056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:33.130742 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b0928-eee5-47f0-a331-8cd1452a056d admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:33.130742 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b0928-eee5-47f0-a331-8cd1452a056d admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:33.130742 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b0928-eee5-47f0-a331-8cd1452a056d admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:33.131152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b0928-eee5-47f0-a331-8cd1452a056d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:33.132779 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b0928-eee5-47f0-a331-8cd1452a056d admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:33.240151 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1279/2574] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:09:33 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:09:33.244545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe606b-215e-41f6-bb7f-2426f269438d admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:33.257667 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe606b-215e-41f6-bb7f-2426f269438d admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:33.263797 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ce984-5558-43e9-ab66-dd17ba27a238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:33.264450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ce984-5558-43e9-ab66-dd17ba27a238 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:33.264730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ce984-5558-43e9-ab66-dd17ba27a238 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:33.265008 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ce984-5558-43e9-ab66-dd17ba27a238 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:33.265716 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ce984-5558-43e9-ab66-dd17ba27a238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:33.267366 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ce984-5558-43e9-ab66-dd17ba27a238 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:33.282474 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1296/2575] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:33.283886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b0928-eee5-47f0-a331-8cd1452a056d admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:33.295971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b0928-eee5-47f0-a331-8cd1452a056d admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:33.301048 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528a8f5-2014-4217-b771-bc9ad80df6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:33.301683 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528a8f5-2014-4217-b771-bc9ad80df6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:33.301962 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528a8f5-2014-4217-b771-bc9ad80df6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:33.302235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528a8f5-2014-4217-b771-bc9ad80df6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:33.302988 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528a8f5-2014-4217-b771-bc9ad80df6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:33.304662 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528a8f5-2014-4217-b771-bc9ad80df6a5 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:33.316073 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1280/2576] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:33.320281 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ce984-5558-43e9-ab66-dd17ba27a238 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:33.331337 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ce984-5558-43e9-ab66-dd17ba27a238 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:33.335930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df82133-a112-47ed-b577-1b8c59c01785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:33.336592 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df82133-a112-47ed-b577-1b8c59c01785 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:33.339357 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df82133-a112-47ed-b577-1b8c59c01785 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:33.339357 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df82133-a112-47ed-b577-1b8c59c01785 admin admin] PATH_INFO: `/v3/projects/8c9d3e63831040a8a01e8378d597b022/users/4b4a8d4b399b4a87b9be53b362266e21/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:33.352771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df82133-a112-47ed-b577-1b8c59c01785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9d3e63831040a8a01e8378d597b022, user_id=4b4a8d4b399b4a87b9be53b362266e21, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:33.355938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df82133-a112-47ed-b577-1b8c59c01785 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:33.401335 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528a8f5-2014-4217-b771-bc9ad80df6a5 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:33.404855 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-3528a8f5-2014-4217-b771-bc9ad80df6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:33.425960 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528a8f5-2014-4217-b771-bc9ad80df6a5 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:33.433393 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1297/2577] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:33 2022] PUT /identity/v3/projects/8c9d3e63831040a8a01e8378d597b022/users/4b4a8d4b399b4a87b9be53b362266e21/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:09:33.447543 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb44072-9e33-4d02-a523-f043dec80c98 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:33.448061 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb44072-9e33-4d02-a523-f043dec80c98 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:33.448447 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb44072-9e33-4d02-a523-f043dec80c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:33.480716 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-bcb44072-9e33-4d02-a523-f043dec80c98 None None] MFA Rules not processed for user `4b4a8d4b399b4a87b9be53b362266e21`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:33.482130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-bcb44072-9e33-4d02-a523-f043dec80c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:33.510507 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6591fc9-ee58-4004-963c-95420c593064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:33.512241 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6591fc9-ee58-4004-963c-95420c593064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:33.512516 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6591fc9-ee58-4004-963c-95420c593064 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:33.512789 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6591fc9-ee58-4004-963c-95420c593064 admin admin] PATH_INFO: `/v3/projects/27d3bb30e5fb4e049d75f15714b8b57b` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:33.514063 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6591fc9-ee58-4004-963c-95420c593064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d3bb30e5fb4e049d75f15714b8b57b)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:33.516012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6591fc9-ee58-4004-963c-95420c593064 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:33.557335 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1298/2578] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:09:33.563126 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb44072-9e33-4d02-a523-f043dec80c98 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:33.574662 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb44072-9e33-4d02-a523-f043dec80c98 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:33.579422 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d83a7d-09db-49b9-844c-42bdf42d695d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:33.580047 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d83a7d-09db-49b9-844c-42bdf42d695d admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:33.580324 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d83a7d-09db-49b9-844c-42bdf42d695d admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:33.580593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d83a7d-09db-49b9-844c-42bdf42d695d admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:33.581260 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d83a7d-09db-49b9-844c-42bdf42d695d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:33.583180 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d83a7d-09db-49b9-844c-42bdf42d695d admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:33.670432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b6591fc9-ee58-4004-963c-95420c593064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d3bb30e5fb4e049d75f15714b8b57b', 'request_id': 'req-b6591fc9-ee58-4004-963c-95420c593064'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:33.677865 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b6591fc9-ee58-4004-963c-95420c593064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d3bb30e5fb4e049d75f15714b8b57b', 'request_id': 'req-b6591fc9-ee58-4004-963c-95420c593064'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:33.684958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b6591fc9-ee58-4004-963c-95420c593064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d3bb30e5fb4e049d75f15714b8b57b', 'request_id': 'req-b6591fc9-ee58-4004-963c-95420c593064'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:33.778706 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1299/2579] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:09:33 2022] POST /identity/v3/projects => generated 393 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:09:33.783122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d83a7d-09db-49b9-844c-42bdf42d695d admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:33.792898 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b6591fc9-ee58-4004-963c-95420c593064 admin admin] The token cache is being invalidate because project 27d3bb30e5fb4e049d75f15714b8b57b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:09:33.793806 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b6591fc9-ee58-4004-963c-95420c593064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:33.794491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b6591fc9-ee58-4004-963c-95420c593064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:33.796095 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1281/2580] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:09:33 2022] DELETE /identity/v3/projects/27d3bb30e5fb4e049d75f15714b8b57b => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:33.800233 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6591fc9-ee58-4004-963c-95420c593064 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:33.801623 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b6591fc9-ee58-4004-963c-95420c593064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:33.821143 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:33.839763 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:33.854353 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d83a7d-09db-49b9-844c-42bdf42d695d admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:33.859774 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6b12c-ec2d-47cf-a550-1f375481ed57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:33.860423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6b12c-ec2d-47cf-a550-1f375481ed57 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:33.860769 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6b12c-ec2d-47cf-a550-1f375481ed57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:33.861045 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6b12c-ec2d-47cf-a550-1f375481ed57 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:33.861816 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6b12c-ec2d-47cf-a550-1f375481ed57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:33.863776 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6b12c-ec2d-47cf-a550-1f375481ed57 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:33.870368 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6591fc9-ee58-4004-963c-95420c593064 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:33.875300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7212be0-d9f0-4fa6-a866-2bb6cfa6033b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:33.882691 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212be0-d9f0-4fa6-a866-2bb6cfa6033b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:33.882691 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212be0-d9f0-4fa6-a866-2bb6cfa6033b admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:33.882691 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212be0-d9f0-4fa6-a866-2bb6cfa6033b admin admin] PATH_INFO: `/v3/users/2739ac3da21949f489ea1a0a108b9607` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:33.882691 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7212be0-d9f0-4fa6-a866-2bb6cfa6033b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2739ac3da21949f489ea1a0a108b9607)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:33.882691 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7212be0-d9f0-4fa6-a866-2bb6cfa6033b admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:33.993992 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1300/2581] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:09:33 2022] POST /identity/v3/users => generated 303 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:09:33.998540 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6b12c-ec2d-47cf-a550-1f375481ed57 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:34.000242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-b5f6b12c-ec2d-47cf-a550-1f375481ed57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:34.014092 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6b12c-ec2d-47cf-a550-1f375481ed57 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:34.018859 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cc451-a589-4411-a7fe-9b18a7260a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:34.021089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cc451-a589-4411-a7fe-9b18a7260a2d admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:34.021089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cc451-a589-4411-a7fe-9b18a7260a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:34.021089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cc451-a589-4411-a7fe-9b18a7260a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:34.021089 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cc451-a589-4411-a7fe-9b18a7260a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:34.022336 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cc451-a589-4411-a7fe-9b18a7260a2d admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:34.034378 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1301/2582] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:09:34.039753 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cc451-a589-4411-a7fe-9b18a7260a2d admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:34.051601 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cc451-a589-4411-a7fe-9b18a7260a2d admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:34.056293 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320c7a4-dcb1-4e28-a827-eb6015a52750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:34.056957 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320c7a4-dcb1-4e28-a827-eb6015a52750 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:34.057237 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320c7a4-dcb1-4e28-a827-eb6015a52750 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:34.057511 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320c7a4-dcb1-4e28-a827-eb6015a52750 admin admin] PATH_INFO: `/v3/projects/4484021de0644f5f808c64e6d1910a1b/users/1fe74e069bdd4d2492c03740b717d25b/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:34.078751 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320c7a4-dcb1-4e28-a827-eb6015a52750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4484021de0644f5f808c64e6d1910a1b, user_id=1fe74e069bdd4d2492c03740b717d25b, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:34.081398 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320c7a4-dcb1-4e28-a827-eb6015a52750 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:34.163080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c7212be0-d9f0-4fa6-a866-2bb6cfa6033b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2739ac3da21949f489ea1a0a108b9607'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:34.163785 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c7212be0-d9f0-4fa6-a866-2bb6cfa6033b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2739ac3da21949f489ea1a0a108b9607'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:34.210753 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1302/2583] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:34 2022] PUT /identity/v3/projects/4484021de0644f5f808c64e6d1910a1b/users/1fe74e069bdd4d2492c03740b717d25b/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:09:34.214992 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320c7a4-dcb1-4e28-a827-eb6015a52750 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:34.216679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-5320c7a4-dcb1-4e28-a827-eb6015a52750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:34.262917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c7212be0-d9f0-4fa6-a866-2bb6cfa6033b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2739ac3da21949f489ea1a0a108b9607'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:34.271805 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c7212be0-d9f0-4fa6-a866-2bb6cfa6033b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2739ac3da21949f489ea1a0a108b9607'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:34.285758 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320c7a4-dcb1-4e28-a827-eb6015a52750 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:34.287393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c7212be0-d9f0-4fa6-a866-2bb6cfa6033b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2739ac3da21949f489ea1a0a108b9607'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:34.290981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9f02d-75f5-405a-ba8a-baec66d7d616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:34.291651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9f02d-75f5-405a-ba8a-baec66d7d616 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:34.291933 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9f02d-75f5-405a-ba8a-baec66d7d616 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:34.292858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9f02d-75f5-405a-ba8a-baec66d7d616 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:34.293615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9f02d-75f5-405a-ba8a-baec66d7d616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:34.295190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1282/2584] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:09:33 2022] DELETE /identity/v3/users/2739ac3da21949f489ea1a0a108b9607 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:09:34.295362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9f02d-75f5-405a-ba8a-baec66d7d616 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:34.306252 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1303/2585] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:09:34.313635 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7212be0-d9f0-4fa6-a866-2bb6cfa6033b admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:34.400172 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7212be0-d9f0-4fa6-a866-2bb6cfa6033b admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:34.406420 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc9035-deb1-4970-8994-13e1f0327420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:34.407177 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc9035-deb1-4970-8994-13e1f0327420 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:34.407498 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc9035-deb1-4970-8994-13e1f0327420 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:34.407776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc9035-deb1-4970-8994-13e1f0327420 admin admin] PATH_INFO: `/v3/projects/4484021de0644f5f808c64e6d1910a1b/users/1fe74e069bdd4d2492c03740b717d25b/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:34.409760 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc9035-deb1-4970-8994-13e1f0327420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4484021de0644f5f808c64e6d1910a1b, user_id=1fe74e069bdd4d2492c03740b717d25b, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:34.412489 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc9035-deb1-4970-8994-13e1f0327420 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:34.434719 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1283/2586] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:34 2022] PUT /identity/v3/projects/4484021de0644f5f808c64e6d1910a1b/users/1fe74e069bdd4d2492c03740b717d25b/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:34.447452 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265720a-b050-4f01-884a-2ac0246f1eb7 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:34.447738 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265720a-b050-4f01-884a-2ac0246f1eb7 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:34.448113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265720a-b050-4f01-884a-2ac0246f1eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:34.497616 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-9265720a-b050-4f01-884a-2ac0246f1eb7 None None] MFA Rules not processed for user `1fe74e069bdd4d2492c03740b717d25b`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:34.500051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9265720a-b050-4f01-884a-2ac0246f1eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:34.595977 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1304/2587] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:34.608252 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc9035-deb1-4970-8994-13e1f0327420 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:34.610204 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a1cc9035-deb1-4970-8994-13e1f0327420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:34.646815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:34.685164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc9035-deb1-4970-8994-13e1f0327420 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:34.690250 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18757acf-d27f-42c7-9d65-bde5e0e33cbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:34.690919 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18757acf-d27f-42c7-9d65-bde5e0e33cbe service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:34.691198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18757acf-d27f-42c7-9d65-bde5e0e33cbe service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:34.691527 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18757acf-d27f-42c7-9d65-bde5e0e33cbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:34.701695 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18757acf-d27f-42c7-9d65-bde5e0e33cbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:34.703143 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18757acf-d27f-42c7-9d65-bde5e0e33cbe service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:34.713237 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1284/2588] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:09:34.764691 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265720a-b050-4f01-884a-2ac0246f1eb7 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:34.766429 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9265720a-b050-4f01-884a-2ac0246f1eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:34.780603 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265720a-b050-4f01-884a-2ac0246f1eb7 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:34.784659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c356dc9-bf8a-4965-be21-9399a8f8f147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:34.785718 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c356dc9-bf8a-4965-be21-9399a8f8f147 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:34.788091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c356dc9-bf8a-4965-be21-9399a8f8f147 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:34.788091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c356dc9-bf8a-4965-be21-9399a8f8f147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:34.790411 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-7c356dc9-bf8a-4965-be21-9399a8f8f147 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:34.796327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18757acf-d27f-42c7-9d65-bde5e0e33cbe service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:34.798060 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-18757acf-d27f-42c7-9d65-bde5e0e33cbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:34.821503 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:34.878427 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c356dc9-bf8a-4965-be21-9399a8f8f147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:34.880563 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c356dc9-bf8a-4965-be21-9399a8f8f147 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:34.891301 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1305/2589] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:09:34.897535 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18757acf-d27f-42c7-9d65-bde5e0e33cbe service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:34.903936 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0569e-b650-400f-8ecc-d2f8e31ac405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:34.904652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0569e-b650-400f-8ecc-d2f8e31ac405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:34.904936 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0569e-b650-400f-8ecc-d2f8e31ac405 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:34.905212 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0569e-b650-400f-8ecc-d2f8e31ac405 admin admin] PATH_INFO: `/v3/projects/ccc291623df34e1ea52a9a069599143f` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:34.906441 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0569e-b650-400f-8ecc-d2f8e31ac405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc291623df34e1ea52a9a069599143f)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:34.908704 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0569e-b650-400f-8ecc-d2f8e31ac405 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:35.041307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-52f0569e-b650-400f-8ecc-d2f8e31ac405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc291623df34e1ea52a9a069599143f', 'request_id': 'req-52f0569e-b650-400f-8ecc-d2f8e31ac405'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:35.048776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-52f0569e-b650-400f-8ecc-d2f8e31ac405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc291623df34e1ea52a9a069599143f', 'request_id': 'req-52f0569e-b650-400f-8ecc-d2f8e31ac405'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:35.054878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-52f0569e-b650-400f-8ecc-d2f8e31ac405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc291623df34e1ea52a9a069599143f', 'request_id': 'req-52f0569e-b650-400f-8ecc-d2f8e31ac405'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:35.213880 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-52f0569e-b650-400f-8ecc-d2f8e31ac405 admin admin] The token cache is being invalidate because project ccc291623df34e1ea52a9a069599143f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:09:35.214805 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-52f0569e-b650-400f-8ecc-d2f8e31ac405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:35.215492 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-52f0569e-b650-400f-8ecc-d2f8e31ac405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:35.217288 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1285/2590] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:09:34 2022] DELETE /identity/v3/projects/ccc291623df34e1ea52a9a069599143f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:35.222204 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7465ce1-31b5-4eee-a5a7-4836bfcbee50 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:35.222430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7465ce1-31b5-4eee-a5a7-4836bfcbee50 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:35.222710 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7465ce1-31b5-4eee-a5a7-4836bfcbee50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:35.243063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-c7465ce1-31b5-4eee-a5a7-4836bfcbee50 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:35.244326 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c7465ce1-31b5-4eee-a5a7-4836bfcbee50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:35.318259 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1306/2591] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:35.327338 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461fab8-9e57-436a-9dfa-a2dd9c422fb9 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:35.327679 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461fab8-9e57-436a-9dfa-a2dd9c422fb9 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:35.327961 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461fab8-9e57-436a-9dfa-a2dd9c422fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:35.348817 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-1461fab8-9e57-436a-9dfa-a2dd9c422fb9 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:35.350065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-1461fab8-9e57-436a-9dfa-a2dd9c422fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:35.359395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1286/2592] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:35.363802 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7465ce1-31b5-4eee-a5a7-4836bfcbee50 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:35.374951 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7465ce1-31b5-4eee-a5a7-4836bfcbee50 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:35.380005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd11d61-4d7d-4c3c-8838-e48640328380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:35.380636 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd11d61-4d7d-4c3c-8838-e48640328380 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:35.380919 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd11d61-4d7d-4c3c-8838-e48640328380 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:35.381205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd11d61-4d7d-4c3c-8838-e48640328380 admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:35.381907 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd11d61-4d7d-4c3c-8838-e48640328380 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:09:35.382299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd11d61-4d7d-4c3c-8838-e48640328380 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:35.383906 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd11d61-4d7d-4c3c-8838-e48640328380 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:35.396936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1307/2593] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:09:35.401414 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461fab8-9e57-436a-9dfa-a2dd9c422fb9 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:35.411727 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461fab8-9e57-436a-9dfa-a2dd9c422fb9 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:35.416621 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24630ce2-d2c8-411b-862d-0dbf3e9043e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:35.417888 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24630ce2-d2c8-411b-862d-0dbf3e9043e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:35.418172 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24630ce2-d2c8-411b-862d-0dbf3e9043e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:35.418495 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24630ce2-d2c8-411b-862d-0dbf3e9043e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:35.419197 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24630ce2-d2c8-411b-862d-0dbf3e9043e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:35.421165 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24630ce2-d2c8-411b-862d-0dbf3e9043e3 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:35.579492 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1287/2594] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:09:35 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:09:35.580609 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd11d61-4d7d-4c3c-8838-e48640328380 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:35.590971 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd11d61-4d7d-4c3c-8838-e48640328380 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:35.651772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bd32d-9ea0-4286-a937-e3ca9cf05b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:35.652408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bd32d-9ea0-4286-a937-e3ca9cf05b04 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:35.652689 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bd32d-9ea0-4286-a937-e3ca9cf05b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:35.652962 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bd32d-9ea0-4286-a937-e3ca9cf05b04 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:35.653674 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bd32d-9ea0-4286-a937-e3ca9cf05b04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:35.655656 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bd32d-9ea0-4286-a937-e3ca9cf05b04 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:35.747754 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1308/2595] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:09:35 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:09:35.752594 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24630ce2-d2c8-411b-862d-0dbf3e9043e3 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:35.764349 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24630ce2-d2c8-411b-862d-0dbf3e9043e3 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:35.784928 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0ee96-e688-403d-b777-49f127e3b9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:35.785671 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0ee96-e688-403d-b777-49f127e3b9eb admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:35.786012 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0ee96-e688-403d-b777-49f127e3b9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:35.786351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0ee96-e688-403d-b777-49f127e3b9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:35.787283 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0ee96-e688-403d-b777-49f127e3b9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:35.790245 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0ee96-e688-403d-b777-49f127e3b9eb admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:35.803542 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1288/2596] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:35.809372 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bd32d-9ea0-4286-a937-e3ca9cf05b04 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:35.821824 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bd32d-9ea0-4286-a937-e3ca9cf05b04 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:35.828936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9314b-a102-4bdd-86f3-1d116db09c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:35.829663 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9314b-a102-4bdd-86f3-1d116db09c1d admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:35.830151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9314b-a102-4bdd-86f3-1d116db09c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:35.830496 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9314b-a102-4bdd-86f3-1d116db09c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:35.831297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9314b-a102-4bdd-86f3-1d116db09c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:35.833019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9314b-a102-4bdd-86f3-1d116db09c1d admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:35.845523 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1309/2597] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:35.849835 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0ee96-e688-403d-b777-49f127e3b9eb admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:35.860550 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0ee96-e688-403d-b777-49f127e3b9eb admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:35.865550 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f0cab-56b1-409a-a372-71459c9e1665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:35.866444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f0cab-56b1-409a-a372-71459c9e1665 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:35.866730 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f0cab-56b1-409a-a372-71459c9e1665 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:35.867007 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f0cab-56b1-409a-a372-71459c9e1665 admin admin] PATH_INFO: `/v3/projects/e46668f2f1d94afea02e50b64ee08d52/users/819307e5c1884ab0b38fb8d6b833c912/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:35.883276 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f0cab-56b1-409a-a372-71459c9e1665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e46668f2f1d94afea02e50b64ee08d52, user_id=819307e5c1884ab0b38fb8d6b833c912, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:35.886615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f0cab-56b1-409a-a372-71459c9e1665 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:35.987131 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:35.993204 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1289/2598] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:35 2022] PUT /identity/v3/projects/e46668f2f1d94afea02e50b64ee08d52/users/819307e5c1884ab0b38fb8d6b833c912/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:36.004118 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6449fe-7c67-4cf7-b43d-44f049bd2250 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:36.004677 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6449fe-7c67-4cf7-b43d-44f049bd2250 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:36.004955 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6449fe-7c67-4cf7-b43d-44f049bd2250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:36.040785 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-dc6449fe-7c67-4cf7-b43d-44f049bd2250 None None] MFA Rules not processed for user `819307e5c1884ab0b38fb8d6b833c912`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:36.042105 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-dc6449fe-7c67-4cf7-b43d-44f049bd2250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:36.057057 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:36.114303 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1310/2599] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:36.119617 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f0cab-56b1-409a-a372-71459c9e1665 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:36.187139 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f0cab-56b1-409a-a372-71459c9e1665 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:36.191850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f3ce2-30ab-4eec-897b-75f085ca6c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:36.192472 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f3ce2-30ab-4eec-897b-75f085ca6c86 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:36.192753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f3ce2-30ab-4eec-897b-75f085ca6c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:36.193026 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f3ce2-30ab-4eec-897b-75f085ca6c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:36.193718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f3ce2-30ab-4eec-897b-75f085ca6c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:36.195641 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f3ce2-30ab-4eec-897b-75f085ca6c86 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:36.313504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1290/2600] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:09:36 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:09:36.317543 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6449fe-7c67-4cf7-b43d-44f049bd2250 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:36.329880 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6449fe-7c67-4cf7-b43d-44f049bd2250 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:36.404339 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fb884-0982-4816-a7ce-01ecf9471c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:36.404888 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fb884-0982-4816-a7ce-01ecf9471c7e admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:36.405168 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fb884-0982-4816-a7ce-01ecf9471c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:36.405443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fb884-0982-4816-a7ce-01ecf9471c7e admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:36.406122 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5fb884-0982-4816-a7ce-01ecf9471c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:36.408118 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5fb884-0982-4816-a7ce-01ecf9471c7e admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:36.529547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1311/2601] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:09:36 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:09:36.534208 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f3ce2-30ab-4eec-897b-75f085ca6c86 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:36.553231 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f3ce2-30ab-4eec-897b-75f085ca6c86 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:36.561038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddc91e-8fa1-4af2-97c7-2c4273ff37f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:36.561687 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddc91e-8fa1-4af2-97c7-2c4273ff37f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:36.562078 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddc91e-8fa1-4af2-97c7-2c4273ff37f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:36.562447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddc91e-8fa1-4af2-97c7-2c4273ff37f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:36.563170 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddc91e-8fa1-4af2-97c7-2c4273ff37f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:36.564879 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddc91e-8fa1-4af2-97c7-2c4273ff37f7 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:36.577016 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1291/2602] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:36.581588 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fb884-0982-4816-a7ce-01ecf9471c7e admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:36.592898 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fb884-0982-4816-a7ce-01ecf9471c7e admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:36.597659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10310802-545d-46f9-8ebb-2ff84eb9d1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:36.598291 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10310802-545d-46f9-8ebb-2ff84eb9d1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:36.598574 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10310802-545d-46f9-8ebb-2ff84eb9d1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:36.598848 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10310802-545d-46f9-8ebb-2ff84eb9d1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:36.599580 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10310802-545d-46f9-8ebb-2ff84eb9d1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:36.601203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10310802-545d-46f9-8ebb-2ff84eb9d1f4 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:36.612528 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1312/2603] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:36.617583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddc91e-8fa1-4af2-97c7-2c4273ff37f7 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:36.628764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddc91e-8fa1-4af2-97c7-2c4273ff37f7 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:36.633874 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9acd74-c7b9-43af-a1a1-d14b101b1ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:36.634562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9acd74-c7b9-43af-a1a1-d14b101b1ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:36.634844 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9acd74-c7b9-43af-a1a1-d14b101b1ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:36.635121 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9acd74-c7b9-43af-a1a1-d14b101b1ad2 admin admin] PATH_INFO: `/v3/projects/ad3f679db1a24395ad2ac1acad64f291/users/48c32f90e92840f9a6b789210fda62b7/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:36.651065 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9acd74-c7b9-43af-a1a1-d14b101b1ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3f679db1a24395ad2ac1acad64f291, user_id=48c32f90e92840f9a6b789210fda62b7, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:36.653794 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9acd74-c7b9-43af-a1a1-d14b101b1ad2 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:36.757693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1292/2604] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:36 2022] PUT /identity/v3/projects/ad3f679db1a24395ad2ac1acad64f291/users/48c32f90e92840f9a6b789210fda62b7/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:36.768542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f32af-f741-4fea-9795-6fe8abc2fa38 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:36.768857 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f32af-f741-4fea-9795-6fe8abc2fa38 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:36.769144 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f32af-f741-4fea-9795-6fe8abc2fa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:36.805061 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-026f32af-f741-4fea-9795-6fe8abc2fa38 None None] MFA Rules not processed for user `48c32f90e92840f9a6b789210fda62b7`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:36.806301 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-026f32af-f741-4fea-9795-6fe8abc2fa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:36.888408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1313/2605] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:09:36.890277 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9acd74-c7b9-43af-a1a1-d14b101b1ad2 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:36.960454 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9acd74-c7b9-43af-a1a1-d14b101b1ad2 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:36.966322 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a484f8f-caeb-4ceb-8302-c95d5c6921a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:36.973123 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a484f8f-caeb-4ceb-8302-c95d5c6921a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:36.973123 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a484f8f-caeb-4ceb-8302-c95d5c6921a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:36.973123 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a484f8f-caeb-4ceb-8302-c95d5c6921a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:36.973123 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a484f8f-caeb-4ceb-8302-c95d5c6921a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:36.973123 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a484f8f-caeb-4ceb-8302-c95d5c6921a2 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:37.106769 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1293/2606] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:09:36 2022] POST /identity/v3/projects => generated 377 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:09:37.111003 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f32af-f741-4fea-9795-6fe8abc2fa38 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:37.122278 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f32af-f741-4fea-9795-6fe8abc2fa38 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:37.145676 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:37.190076 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f14ca-5241-4648-ae5b-f167065f4666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:37.190942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f14ca-5241-4648-ae5b-f167065f4666 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:37.191471 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f14ca-5241-4648-ae5b-f167065f4666 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:37.192098 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f14ca-5241-4648-ae5b-f167065f4666 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:37.193000 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f14ca-5241-4648-ae5b-f167065f4666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:37.195060 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f14ca-5241-4648-ae5b-f167065f4666 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:37.302836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1314/2607] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:09:37 2022] POST /identity/v3/users => generated 295 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:09:37.306689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a484f8f-caeb-4ceb-8302-c95d5c6921a2 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:37.318206 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a484f8f-caeb-4ceb-8302-c95d5c6921a2 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:37.323040 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3691e6-d5ab-4ec0-b7a0-2c96979d3e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:37.324481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3691e6-d5ab-4ec0-b7a0-2c96979d3e99 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:37.324773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3691e6-d5ab-4ec0-b7a0-2c96979d3e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:37.325053 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3691e6-d5ab-4ec0-b7a0-2c96979d3e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:37.325757 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3691e6-d5ab-4ec0-b7a0-2c96979d3e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:37.327363 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3691e6-d5ab-4ec0-b7a0-2c96979d3e99 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:37.345739 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1294/2608] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:37.353304 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f14ca-5241-4648-ae5b-f167065f4666 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:37.364100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f14ca-5241-4648-ae5b-f167065f4666 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:37.369376 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22750a6-8498-4819-ba50-347baf704122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:37.370177 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22750a6-8498-4819-ba50-347baf704122 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:37.370599 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22750a6-8498-4819-ba50-347baf704122 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:37.370943 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22750a6-8498-4819-ba50-347baf704122 admin admin] PATH_INFO: `/v3/projects/844741df351246239b17b7e216fcc29d/users/1a2c91db0d42497f9d0d0752a596f6cc/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:37.515971 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22750a6-8498-4819-ba50-347baf704122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=844741df351246239b17b7e216fcc29d, user_id=1a2c91db0d42497f9d0d0752a596f6cc, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:37.518702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22750a6-8498-4819-ba50-347baf704122 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:37.597303 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1315/2609] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:37 2022] PUT /identity/v3/projects/844741df351246239b17b7e216fcc29d/users/1a2c91db0d42497f9d0d0752a596f6cc/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:37.601325 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3691e6-d5ab-4ec0-b7a0-2c96979d3e99 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:37.612502 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3691e6-d5ab-4ec0-b7a0-2c96979d3e99 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:37.633061 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:37.675476 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde36ceb-5f8a-4c4d-8256-9a4ea82959be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:37.676290 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde36ceb-5f8a-4c4d-8256-9a4ea82959be admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:37.676645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde36ceb-5f8a-4c4d-8256-9a4ea82959be admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:37.677016 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde36ceb-5f8a-4c4d-8256-9a4ea82959be admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:37.678711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde36ceb-5f8a-4c4d-8256-9a4ea82959be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:37.679544 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde36ceb-5f8a-4c4d-8256-9a4ea82959be admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:37.690578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1295/2610] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:37.694825 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22750a6-8498-4819-ba50-347baf704122 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:37.706183 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22750a6-8498-4819-ba50-347baf704122 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:37.710744 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d192f-3b9d-444f-b963-1fbba1b54918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:37.711583 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d192f-3b9d-444f-b963-1fbba1b54918 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:37.712051 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d192f-3b9d-444f-b963-1fbba1b54918 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:37.712238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d192f-3b9d-444f-b963-1fbba1b54918 admin admin] PATH_INFO: `/v3/projects/844741df351246239b17b7e216fcc29d/users/1a2c91db0d42497f9d0d0752a596f6cc/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:37.714979 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d192f-3b9d-444f-b963-1fbba1b54918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=844741df351246239b17b7e216fcc29d, user_id=1a2c91db0d42497f9d0d0752a596f6cc, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:37.718154 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d192f-3b9d-444f-b963-1fbba1b54918 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:37.729256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1316/2611] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:37 2022] PUT /identity/v3/projects/844741df351246239b17b7e216fcc29d/users/1a2c91db0d42497f9d0d0752a596f6cc/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:37.741917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe30ce-8ca6-4e15-8ae8-2fcafd83f114 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:37.742208 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe30ce-8ca6-4e15-8ae8-2fcafd83f114 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:37.742598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe30ce-8ca6-4e15-8ae8-2fcafd83f114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:37.772079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-1bfe30ce-8ca6-4e15-8ae8-2fcafd83f114 None None] MFA Rules not processed for user `1a2c91db0d42497f9d0d0752a596f6cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:37.773305 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-1bfe30ce-8ca6-4e15-8ae8-2fcafd83f114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:37.851547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1296/2612] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:37.864693 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d192f-3b9d-444f-b963-1fbba1b54918 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:37.866374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-3d3d192f-3b9d-444f-b963-1fbba1b54918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:37.929138 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d192f-3b9d-444f-b963-1fbba1b54918 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:37.931392 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c298513-7969-4127-8ff3-0b3849473d4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:37.931555 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c298513-7969-4127-8ff3-0b3849473d4d service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:37.931750 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c298513-7969-4127-8ff3-0b3849473d4d service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:37.932022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c298513-7969-4127-8ff3-0b3849473d4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:37.990604 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c298513-7969-4127-8ff3-0b3849473d4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:37.992085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c298513-7969-4127-8ff3-0b3849473d4d service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:38.001581 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1317/2613] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:09:40.174908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe30ce-8ca6-4e15-8ae8-2fcafd83f114 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:40.185816 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe30ce-8ca6-4e15-8ae8-2fcafd83f114 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:40.189548 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602a7fa-d932-4c39-89b2-812eca4de259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:40.190150 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602a7fa-d932-4c39-89b2-812eca4de259 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:40.190432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602a7fa-d932-4c39-89b2-812eca4de259 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:40.190837 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602a7fa-d932-4c39-89b2-812eca4de259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:40.200540 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c298513-7969-4127-8ff3-0b3849473d4d service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:40.202094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-9c298513-7969-4127-8ff3-0b3849473d4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:40.237912 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:40.258111 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602a7fa-d932-4c39-89b2-812eca4de259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:40.259600 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602a7fa-d932-4c39-89b2-812eca4de259 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:40.269507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c298513-7969-4127-8ff3-0b3849473d4d service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:40.270055 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1297/2614] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:09:40.275711 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60607f21-ad69-481e-af86-837a877a6c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:40.276405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60607f21-ad69-481e-af86-837a877a6c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:40.276827 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60607f21-ad69-481e-af86-837a877a6c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:40.277084 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60607f21-ad69-481e-af86-837a877a6c6a admin admin] PATH_INFO: `/v3/users/4b4a8d4b399b4a87b9be53b362266e21` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:40.278282 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60607f21-ad69-481e-af86-837a877a6c6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b4a8d4b399b4a87b9be53b362266e21)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:40.287634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60607f21-ad69-481e-af86-837a877a6c6a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:40.494770 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-60607f21-ad69-481e-af86-837a877a6c6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b4a8d4b399b4a87b9be53b362266e21'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:40.495990 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-60607f21-ad69-481e-af86-837a877a6c6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b4a8d4b399b4a87b9be53b362266e21'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:40.564212 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-60607f21-ad69-481e-af86-837a877a6c6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b4a8d4b399b4a87b9be53b362266e21'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:40.577678 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-60607f21-ad69-481e-af86-837a877a6c6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b4a8d4b399b4a87b9be53b362266e21'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:40.584589 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-60607f21-ad69-481e-af86-837a877a6c6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b4a8d4b399b4a87b9be53b362266e21'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:40.590547 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1318/2615] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:09:40 2022] DELETE /identity/v3/users/4b4a8d4b399b4a87b9be53b362266e21 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:40.595150 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd7e79-36c0-4aed-9ef7-5ea953511c50 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:40.595495 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd7e79-36c0-4aed-9ef7-5ea953511c50 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:40.595809 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd7e79-36c0-4aed-9ef7-5ea953511c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:40.616047 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-60fd7e79-36c0-4aed-9ef7-5ea953511c50 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:40.617259 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-60fd7e79-36c0-4aed-9ef7-5ea953511c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:40.656969 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:40.678965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1298/2616] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:09:40.689182 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60607f21-ad69-481e-af86-837a877a6c6a admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:40.690578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-60607f21-ad69-481e-af86-837a877a6c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:40.754615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60607f21-ad69-481e-af86-837a877a6c6a admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:40.758469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6b939-7185-4a76-b695-bf08eeaf97af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:40.762880 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6b939-7185-4a76-b695-bf08eeaf97af service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:40.762880 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6b939-7185-4a76-b695-bf08eeaf97af service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:40.762880 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6b939-7185-4a76-b695-bf08eeaf97af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:40.769325 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6b939-7185-4a76-b695-bf08eeaf97af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:40.770777 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6b939-7185-4a76-b695-bf08eeaf97af service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:40.782616 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1319/2617] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:09:41.192974 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd7e79-36c0-4aed-9ef7-5ea953511c50 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:41.194459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-60fd7e79-36c0-4aed-9ef7-5ea953511c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:41.208225 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd7e79-36c0-4aed-9ef7-5ea953511c50 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:41.213313 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278c90e-0d15-406d-a6ac-7c440a523c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:41.214593 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278c90e-0d15-406d-a6ac-7c440a523c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:41.215029 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278c90e-0d15-406d-a6ac-7c440a523c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:41.215360 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278c90e-0d15-406d-a6ac-7c440a523c0e admin admin] PATH_INFO: `/v3/projects/8c9d3e63831040a8a01e8378d597b022` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:41.224400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278c90e-0d15-406d-a6ac-7c440a523c0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9d3e63831040a8a01e8378d597b022)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:41.226453 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278c90e-0d15-406d-a6ac-7c440a523c0e admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:41.356235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1278c90e-0d15-406d-a6ac-7c440a523c0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9d3e63831040a8a01e8378d597b022', 'request_id': 'req-1278c90e-0d15-406d-a6ac-7c440a523c0e'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:41.363153 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1278c90e-0d15-406d-a6ac-7c440a523c0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9d3e63831040a8a01e8378d597b022', 'request_id': 'req-1278c90e-0d15-406d-a6ac-7c440a523c0e'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:41.369003 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1278c90e-0d15-406d-a6ac-7c440a523c0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9d3e63831040a8a01e8378d597b022', 'request_id': 'req-1278c90e-0d15-406d-a6ac-7c440a523c0e'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:41.522211 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1278c90e-0d15-406d-a6ac-7c440a523c0e admin admin] The token cache is being invalidate because project 8c9d3e63831040a8a01e8378d597b022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:09:41.522617 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1278c90e-0d15-406d-a6ac-7c440a523c0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:41.523304 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1278c90e-0d15-406d-a6ac-7c440a523c0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:41.524886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1299/2618] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:09:41 2022] DELETE /identity/v3/projects/8c9d3e63831040a8a01e8378d597b022 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:41.530146 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6b939-7185-4a76-b695-bf08eeaf97af service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:41.540099 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6b939-7185-4a76-b695-bf08eeaf97af service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:41.588433 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:41.597591 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48633f7d-aaa2-4606-af96-ad0c3406f427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:41.598229 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48633f7d-aaa2-4606-af96-ad0c3406f427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:41.598507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48633f7d-aaa2-4606-af96-ad0c3406f427 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:41.598777 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48633f7d-aaa2-4606-af96-ad0c3406f427 admin admin] PATH_INFO: `/v3/users/1fe74e069bdd4d2492c03740b717d25b` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:41.599938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48633f7d-aaa2-4606-af96-ad0c3406f427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fe74e069bdd4d2492c03740b717d25b)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:41.601996 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48633f7d-aaa2-4606-af96-ad0c3406f427 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:41.764130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278c90e-0d15-406d-a6ac-7c440a523c0e admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:41.765542 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-1278c90e-0d15-406d-a6ac-7c440a523c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:41.827661 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278c90e-0d15-406d-a6ac-7c440a523c0e admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:41.831418 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bfa1d-dda8-4855-a818-5632dc27b376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:41.832059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bfa1d-dda8-4855-a818-5632dc27b376 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:41.832339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bfa1d-dda8-4855-a818-5632dc27b376 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:41.832612 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bfa1d-dda8-4855-a818-5632dc27b376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:41.834429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-844bfa1d-dda8-4855-a818-5632dc27b376 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:41.899255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bfa1d-dda8-4855-a818-5632dc27b376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:41.900711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bfa1d-dda8-4855-a818-5632dc27b376 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:41.911521 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1300/2619] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:09:41.936361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-48633f7d-aaa2-4606-af96-ad0c3406f427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fe74e069bdd4d2492c03740b717d25b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:41.937028 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-48633f7d-aaa2-4606-af96-ad0c3406f427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fe74e069bdd4d2492c03740b717d25b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:42.015845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-48633f7d-aaa2-4606-af96-ad0c3406f427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fe74e069bdd4d2492c03740b717d25b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:42.029045 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-48633f7d-aaa2-4606-af96-ad0c3406f427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fe74e069bdd4d2492c03740b717d25b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:42.036874 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-48633f7d-aaa2-4606-af96-ad0c3406f427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fe74e069bdd4d2492c03740b717d25b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:42.043042 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1320/2620] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:09:41 2022] DELETE /identity/v3/users/1fe74e069bdd4d2492c03740b717d25b => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:42.562150 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bfa1d-dda8-4855-a818-5632dc27b376 service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:42.562150 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-844bfa1d-dda8-4855-a818-5632dc27b376 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:42.576332 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bfa1d-dda8-4855-a818-5632dc27b376 service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:42.589823 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:42.639787 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075151fa-a4f4-46df-8a9f-2d656a19205d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:42.640438 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075151fa-a4f4-46df-8a9f-2d656a19205d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:42.640773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075151fa-a4f4-46df-8a9f-2d656a19205d admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:42.641152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075151fa-a4f4-46df-8a9f-2d656a19205d admin admin] PATH_INFO: `/v3/projects/4484021de0644f5f808c64e6d1910a1b` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:42.642353 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075151fa-a4f4-46df-8a9f-2d656a19205d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4484021de0644f5f808c64e6d1910a1b)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:42.644310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075151fa-a4f4-46df-8a9f-2d656a19205d admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:42.810646 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-075151fa-a4f4-46df-8a9f-2d656a19205d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4484021de0644f5f808c64e6d1910a1b', 'request_id': 'req-075151fa-a4f4-46df-8a9f-2d656a19205d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:42.816804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-075151fa-a4f4-46df-8a9f-2d656a19205d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4484021de0644f5f808c64e6d1910a1b', 'request_id': 'req-075151fa-a4f4-46df-8a9f-2d656a19205d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:42.822155 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-075151fa-a4f4-46df-8a9f-2d656a19205d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4484021de0644f5f808c64e6d1910a1b', 'request_id': 'req-075151fa-a4f4-46df-8a9f-2d656a19205d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:42.918222 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-075151fa-a4f4-46df-8a9f-2d656a19205d admin admin] The token cache is being invalidate because project 4484021de0644f5f808c64e6d1910a1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:09:42.918514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-075151fa-a4f4-46df-8a9f-2d656a19205d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:42.919146 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-075151fa-a4f4-46df-8a9f-2d656a19205d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:42.920698 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1301/2621] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:09:42 2022] DELETE /identity/v3/projects/4484021de0644f5f808c64e6d1910a1b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:09:42.926393 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d617b2-5df4-4751-bf15-6a75f0553014 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:42.931057 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d617b2-5df4-4751-bf15-6a75f0553014 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:42.931057 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d617b2-5df4-4751-bf15-6a75f0553014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:42.947679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-70d617b2-5df4-4751-bf15-6a75f0553014 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:42.949835 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-70d617b2-5df4-4751-bf15-6a75f0553014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:43.009098 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1321/2622] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:43.017630 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb459abe-c318-445d-9307-b07f9d6e1921 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:43.017917 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb459abe-c318-445d-9307-b07f9d6e1921 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:43.018193 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb459abe-c318-445d-9307-b07f9d6e1921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:43.038199 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-bb459abe-c318-445d-9307-b07f9d6e1921 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:43.039443 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-bb459abe-c318-445d-9307-b07f9d6e1921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:43.047718 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1302/2623] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:43.052291 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d617b2-5df4-4751-bf15-6a75f0553014 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:43.062781 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d617b2-5df4-4751-bf15-6a75f0553014 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:43.067459 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60278004-5060-4ae9-b298-53a89ffeb06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:43.068081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60278004-5060-4ae9-b298-53a89ffeb06c admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:43.068362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60278004-5060-4ae9-b298-53a89ffeb06c admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:43.068629 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60278004-5060-4ae9-b298-53a89ffeb06c admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:43.069328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60278004-5060-4ae9-b298-53a89ffeb06c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:09:43.069627 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60278004-5060-4ae9-b298-53a89ffeb06c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:43.071228 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60278004-5060-4ae9-b298-53a89ffeb06c admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:43.084276 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1322/2624] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:09:43.089142 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb459abe-c318-445d-9307-b07f9d6e1921 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:43.098696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb459abe-c318-445d-9307-b07f9d6e1921 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:43.103404 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5531fc-0f0b-4fef-a94e-26f25cb6ec59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:43.104016 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5531fc-0f0b-4fef-a94e-26f25cb6ec59 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:43.104299 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5531fc-0f0b-4fef-a94e-26f25cb6ec59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:43.104608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5531fc-0f0b-4fef-a94e-26f25cb6ec59 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:43.105537 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5531fc-0f0b-4fef-a94e-26f25cb6ec59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:43.107504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5531fc-0f0b-4fef-a94e-26f25cb6ec59 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:43.227683 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1303/2625] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:09:43 2022] POST /identity/v3/projects => generated 399 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:09:43.231837 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60278004-5060-4ae9-b298-53a89ffeb06c admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:43.242052 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60278004-5060-4ae9-b298-53a89ffeb06c admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:43.300729 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18919ad4-27e6-47ed-9850-3d23871b3518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:43.301348 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18919ad4-27e6-47ed-9850-3d23871b3518 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:43.301626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18919ad4-27e6-47ed-9850-3d23871b3518 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:43.301900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18919ad4-27e6-47ed-9850-3d23871b3518 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:43.302555 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18919ad4-27e6-47ed-9850-3d23871b3518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:43.304489 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18919ad4-27e6-47ed-9850-3d23871b3518 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:43.313703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:43.399437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1323/2626] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:09:43 2022] POST /identity/v3/users => generated 300 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:09:43.404116 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5531fc-0f0b-4fef-a94e-26f25cb6ec59 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:43.414451 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5531fc-0f0b-4fef-a94e-26f25cb6ec59 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:43.419790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578359a6-b5f8-4a12-b76e-60576ac4c916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:43.420398 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578359a6-b5f8-4a12-b76e-60576ac4c916 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:43.420678 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578359a6-b5f8-4a12-b76e-60576ac4c916 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:43.420978 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578359a6-b5f8-4a12-b76e-60576ac4c916 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:43.421670 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578359a6-b5f8-4a12-b76e-60576ac4c916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:43.423550 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578359a6-b5f8-4a12-b76e-60576ac4c916 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:43.435068 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1304/2627] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:43.439176 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18919ad4-27e6-47ed-9850-3d23871b3518 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:43.449283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18919ad4-27e6-47ed-9850-3d23871b3518 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:43.453916 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc001ec-364a-405f-b6df-20d286716fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:43.454560 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc001ec-364a-405f-b6df-20d286716fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:43.454838 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc001ec-364a-405f-b6df-20d286716fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:43.455110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc001ec-364a-405f-b6df-20d286716fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:43.455828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc001ec-364a-405f-b6df-20d286716fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:43.457419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc001ec-364a-405f-b6df-20d286716fd0 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:43.469472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1324/2628] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:43.473596 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578359a6-b5f8-4a12-b76e-60576ac4c916 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:43.484987 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578359a6-b5f8-4a12-b76e-60576ac4c916 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:43.490055 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225b29e-42e6-4663-996f-fd53562a072f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:43.490755 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225b29e-42e6-4663-996f-fd53562a072f admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:43.491037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225b29e-42e6-4663-996f-fd53562a072f admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:43.491313 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225b29e-42e6-4663-996f-fd53562a072f admin admin] PATH_INFO: `/v3/projects/26a01a9cfb344e98a31d8dc7cd587dbb/users/c415c12984a44c5d918ee3469df08438/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:43.507352 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225b29e-42e6-4663-996f-fd53562a072f admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a01a9cfb344e98a31d8dc7cd587dbb, user_id=c415c12984a44c5d918ee3469df08438, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:43.510132 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225b29e-42e6-4663-996f-fd53562a072f admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:43.588753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1305/2629] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:43 2022] PUT /identity/v3/projects/26a01a9cfb344e98a31d8dc7cd587dbb/users/c415c12984a44c5d918ee3469df08438/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:43.600669 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d35e3-f051-4e79-bfc6-4854744dd1d7 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:43.600830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d35e3-f051-4e79-bfc6-4854744dd1d7 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:43.601096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d35e3-f051-4e79-bfc6-4854744dd1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:43.634536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-a10d35e3-f051-4e79-bfc6-4854744dd1d7 None None] MFA Rules not processed for user `c415c12984a44c5d918ee3469df08438`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:43.635846 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a10d35e3-f051-4e79-bfc6-4854744dd1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:43.710508 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1325/2630] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:09:43.716719 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225b29e-42e6-4663-996f-fd53562a072f admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:43.778966 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:43.798944 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225b29e-42e6-4663-996f-fd53562a072f admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:43.803344 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602321c-21e4-4dd9-94b4-d127ff268fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:43.804331 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602321c-21e4-4dd9-94b4-d127ff268fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:43.804611 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602321c-21e4-4dd9-94b4-d127ff268fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:43.804891 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602321c-21e4-4dd9-94b4-d127ff268fc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:43.805579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602321c-21e4-4dd9-94b4-d127ff268fc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:43.807512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602321c-21e4-4dd9-94b4-d127ff268fc2 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:43.932379 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1306/2631] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:09:43 2022] POST /identity/v3/projects => generated 401 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:09:43.937231 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d35e3-f051-4e79-bfc6-4854744dd1d7 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:43.957115 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d35e3-f051-4e79-bfc6-4854744dd1d7 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:44.036408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9909a-a867-41f5-bbb1-b9a664e67005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:44.037043 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9909a-a867-41f5-bbb1-b9a664e67005 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:44.037324 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9909a-a867-41f5-bbb1-b9a664e67005 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:44.037613 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9909a-a867-41f5-bbb1-b9a664e67005 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:44.038284 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9909a-a867-41f5-bbb1-b9a664e67005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:44.040305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9909a-a867-41f5-bbb1-b9a664e67005 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:44.113202 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1326/2632] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:09:43 2022] POST /identity/v3/users => generated 307 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:09:44.117771 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602321c-21e4-4dd9-94b4-d127ff268fc2 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:44.130412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602321c-21e4-4dd9-94b4-d127ff268fc2 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:44.135243 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12da81-aed3-4f99-b833-51c8f431a8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:44.135988 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12da81-aed3-4f99-b833-51c8f431a8df admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:44.136269 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12da81-aed3-4f99-b833-51c8f431a8df admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:44.137168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12da81-aed3-4f99-b833-51c8f431a8df admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:44.137305 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12da81-aed3-4f99-b833-51c8f431a8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:44.138898 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12da81-aed3-4f99-b833-51c8f431a8df admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:44.150297 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1307/2633] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:44.154853 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9909a-a867-41f5-bbb1-b9a664e67005 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:44.165335 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9909a-a867-41f5-bbb1-b9a664e67005 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:44.171383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a0c00-e294-411a-9036-0d1d92192267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:44.172097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a0c00-e294-411a-9036-0d1d92192267 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:44.172396 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a0c00-e294-411a-9036-0d1d92192267 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:44.172655 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a0c00-e294-411a-9036-0d1d92192267 admin admin] PATH_INFO: `/v3/projects/b5a0aaab0c214b69a77d8811ed9f08e4/users/a3e69fe927ce40c196bc601bda4dbb0e/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:44.189919 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a0c00-e294-411a-9036-0d1d92192267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a0aaab0c214b69a77d8811ed9f08e4, user_id=a3e69fe927ce40c196bc601bda4dbb0e, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:44.193040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a0c00-e294-411a-9036-0d1d92192267 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:44.297802 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1327/2634] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:44 2022] PUT /identity/v3/projects/b5a0aaab0c214b69a77d8811ed9f08e4/users/a3e69fe927ce40c196bc601bda4dbb0e/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:44.302348 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12da81-aed3-4f99-b833-51c8f431a8df admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:44.314669 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12da81-aed3-4f99-b833-51c8f431a8df admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:44.388453 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad34c25-c2e0-4b66-9a66-7ef514f093fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:44.389252 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad34c25-c2e0-4b66-9a66-7ef514f093fa admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:44.389716 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad34c25-c2e0-4b66-9a66-7ef514f093fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:44.390006 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad34c25-c2e0-4b66-9a66-7ef514f093fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:44.390784 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad34c25-c2e0-4b66-9a66-7ef514f093fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:44.393132 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad34c25-c2e0-4b66-9a66-7ef514f093fa admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:44.407401 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1308/2635] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:44.409935 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a0c00-e294-411a-9036-0d1d92192267 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:44.421718 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a0c00-e294-411a-9036-0d1d92192267 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:44.426628 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4f09c-97dc-46b5-bf7c-52e124faa82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:44.427310 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4f09c-97dc-46b5-bf7c-52e124faa82f admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:44.427616 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4f09c-97dc-46b5-bf7c-52e124faa82f admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:44.427889 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4f09c-97dc-46b5-bf7c-52e124faa82f admin admin] PATH_INFO: `/v3/projects/b5a0aaab0c214b69a77d8811ed9f08e4/users/a3e69fe927ce40c196bc601bda4dbb0e/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:44.429900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4f09c-97dc-46b5-bf7c-52e124faa82f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a0aaab0c214b69a77d8811ed9f08e4, user_id=a3e69fe927ce40c196bc601bda4dbb0e, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:44.432885 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4f09c-97dc-46b5-bf7c-52e124faa82f admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:44.444763 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1328/2636] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:44 2022] PUT /identity/v3/projects/b5a0aaab0c214b69a77d8811ed9f08e4/users/a3e69fe927ce40c196bc601bda4dbb0e/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:09:44.456914 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72ee29-2c9d-4a30-99e4-fe4806f700bd None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:44.457204 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72ee29-2c9d-4a30-99e4-fe4806f700bd None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:44.457489 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72ee29-2c9d-4a30-99e4-fe4806f700bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:44.489034 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-da72ee29-2c9d-4a30-99e4-fe4806f700bd None None] MFA Rules not processed for user `a3e69fe927ce40c196bc601bda4dbb0e`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:44.490265 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-da72ee29-2c9d-4a30-99e4-fe4806f700bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:44.568408 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1309/2637] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:44 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:44.581068 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4f09c-97dc-46b5-bf7c-52e124faa82f admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:44.583003 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a5c4f09c-97dc-46b5-bf7c-52e124faa82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:44.609886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:44.661682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4f09c-97dc-46b5-bf7c-52e124faa82f admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:44.665464 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fffebe-c25c-4b11-88f8-e1eec24cee9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:44.666094 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fffebe-c25c-4b11-88f8-e1eec24cee9a service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:44.666367 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fffebe-c25c-4b11-88f8-e1eec24cee9a service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:44.666637 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fffebe-c25c-4b11-88f8-e1eec24cee9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:44.677092 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fffebe-c25c-4b11-88f8-e1eec24cee9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:44.678611 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fffebe-c25c-4b11-88f8-e1eec24cee9a service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:44.690214 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1329/2638] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:44 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:09:44.938330 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72ee29-2c9d-4a30-99e4-fe4806f700bd None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:44.949410 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72ee29-2c9d-4a30-99e4-fe4806f700bd None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:44.959543 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6b7cd-4f34-4bb9-9d30-1389b307e772 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:44.959543 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6b7cd-4f34-4bb9-9d30-1389b307e772 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:44.959543 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6b7cd-4f34-4bb9-9d30-1389b307e772 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:44.959543 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6b7cd-4f34-4bb9-9d30-1389b307e772 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:45.001042 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:45.026757 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6b7cd-4f34-4bb9-9d30-1389b307e772 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:45.028211 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6b7cd-4f34-4bb9-9d30-1389b307e772 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:45.040635 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1310/2639] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:09:46.713835 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fffebe-c25c-4b11-88f8-e1eec24cee9a service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:46.715347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c5fffebe-c25c-4b11-88f8-e1eec24cee9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:46.795882 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fffebe-c25c-4b11-88f8-e1eec24cee9a service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:46.800555 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4e74f-262c-44cd-9686-048f1bc30124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:46.801200 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4e74f-262c-44cd-9686-048f1bc30124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:46.801486 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4e74f-262c-44cd-9686-048f1bc30124 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:46.801886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4e74f-262c-44cd-9686-048f1bc30124 admin admin] PATH_INFO: `/v3/users/819307e5c1884ab0b38fb8d6b833c912` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:46.803071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4e74f-262c-44cd-9686-048f1bc30124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=819307e5c1884ab0b38fb8d6b833c912)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:46.805012 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4e74f-262c-44cd-9686-048f1bc30124 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:47.012548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-07a4e74f-262c-44cd-9686-048f1bc30124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '819307e5c1884ab0b38fb8d6b833c912'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:47.013097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-07a4e74f-262c-44cd-9686-048f1bc30124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '819307e5c1884ab0b38fb8d6b833c912'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:47.088367 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-07a4e74f-262c-44cd-9686-048f1bc30124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '819307e5c1884ab0b38fb8d6b833c912'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:47.104929 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-07a4e74f-262c-44cd-9686-048f1bc30124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '819307e5c1884ab0b38fb8d6b833c912'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:47.113213 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-07a4e74f-262c-44cd-9686-048f1bc30124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '819307e5c1884ab0b38fb8d6b833c912'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:47.120056 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1330/2640] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:09:46 2022] DELETE /identity/v3/users/819307e5c1884ab0b38fb8d6b833c912 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:47.125600 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e9b13-4158-45bb-9263-e62349fe4681 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:47.126192 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e9b13-4158-45bb-9263-e62349fe4681 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:47.126192 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e9b13-4158-45bb-9263-e62349fe4681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:47.146307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-7f6e9b13-4158-45bb-9263-e62349fe4681 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:47.147616 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-7f6e9b13-4158-45bb-9263-e62349fe4681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:47.206747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1311/2641] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:47.217644 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4e74f-262c-44cd-9686-048f1bc30124 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:47.219275 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-07a4e74f-262c-44cd-9686-048f1bc30124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:47.268603 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:47.281875 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4e74f-262c-44cd-9686-048f1bc30124 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:47.285467 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809000a-c100-4343-a4ef-3c8b06f6e446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:47.286088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809000a-c100-4343-a4ef-3c8b06f6e446 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:47.286370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809000a-c100-4343-a4ef-3c8b06f6e446 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:47.286646 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809000a-c100-4343-a4ef-3c8b06f6e446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:47.296237 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809000a-c100-4343-a4ef-3c8b06f6e446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:47.297626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809000a-c100-4343-a4ef-3c8b06f6e446 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:47.308442 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1331/2642] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:09:47.903831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e9b13-4158-45bb-9263-e62349fe4681 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:47.905476 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-7f6e9b13-4158-45bb-9263-e62349fe4681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:47.917992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e9b13-4158-45bb-9263-e62349fe4681 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:47.923959 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1c914-d062-4925-8460-bfc53416335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:47.924685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1c914-d062-4925-8460-bfc53416335c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:47.924969 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1c914-d062-4925-8460-bfc53416335c admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:47.925245 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1c914-d062-4925-8460-bfc53416335c admin admin] PATH_INFO: `/v3/projects/e46668f2f1d94afea02e50b64ee08d52` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:47.926488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1c914-d062-4925-8460-bfc53416335c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e46668f2f1d94afea02e50b64ee08d52)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:47.929445 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1c914-d062-4925-8460-bfc53416335c admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:48.098952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-a9f1c914-d062-4925-8460-bfc53416335c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e46668f2f1d94afea02e50b64ee08d52', 'request_id': 'req-a9f1c914-d062-4925-8460-bfc53416335c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:48.105366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-a9f1c914-d062-4925-8460-bfc53416335c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e46668f2f1d94afea02e50b64ee08d52', 'request_id': 'req-a9f1c914-d062-4925-8460-bfc53416335c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:48.112251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-a9f1c914-d062-4925-8460-bfc53416335c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e46668f2f1d94afea02e50b64ee08d52', 'request_id': 'req-a9f1c914-d062-4925-8460-bfc53416335c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:48.267729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-a9f1c914-d062-4925-8460-bfc53416335c admin admin] The token cache is being invalidate because project e46668f2f1d94afea02e50b64ee08d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:09:48.268391 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-a9f1c914-d062-4925-8460-bfc53416335c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:48.269155 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-a9f1c914-d062-4925-8460-bfc53416335c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:48.270749 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1312/2643] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:09:47 2022] DELETE /identity/v3/projects/e46668f2f1d94afea02e50b64ee08d52 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:48.275702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809000a-c100-4343-a4ef-3c8b06f6e446 service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:48.286446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809000a-c100-4343-a4ef-3c8b06f6e446 service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:48.355546 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d525329-427f-46f4-837f-a89eaa97b079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:48.358196 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d525329-427f-46f4-837f-a89eaa97b079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:48.358920 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d525329-427f-46f4-837f-a89eaa97b079 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:48.359414 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d525329-427f-46f4-837f-a89eaa97b079 admin admin] PATH_INFO: `/v3/users/48c32f90e92840f9a6b789210fda62b7` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:48.361548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d525329-427f-46f4-837f-a89eaa97b079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48c32f90e92840f9a6b789210fda62b7)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:48.364994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d525329-427f-46f4-837f-a89eaa97b079 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:48.603263 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-2d525329-427f-46f4-837f-a89eaa97b079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48c32f90e92840f9a6b789210fda62b7'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:48.603983 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-2d525329-427f-46f4-837f-a89eaa97b079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48c32f90e92840f9a6b789210fda62b7'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:48.684102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-2d525329-427f-46f4-837f-a89eaa97b079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48c32f90e92840f9a6b789210fda62b7'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:48.697876 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-2d525329-427f-46f4-837f-a89eaa97b079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48c32f90e92840f9a6b789210fda62b7'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:48.706506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-2d525329-427f-46f4-837f-a89eaa97b079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48c32f90e92840f9a6b789210fda62b7'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:48.714436 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1332/2644] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:09:48 2022] DELETE /identity/v3/users/48c32f90e92840f9a6b789210fda62b7 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:09:49.300580 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1c914-d062-4925-8460-bfc53416335c admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:49.304071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a9f1c914-d062-4925-8460-bfc53416335c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:49.338119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1c914-d062-4925-8460-bfc53416335c admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:49.404375 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ea269-7dbd-4199-9457-c0d4249346e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:49.404934 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ea269-7dbd-4199-9457-c0d4249346e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:49.405204 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ea269-7dbd-4199-9457-c0d4249346e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:49.405471 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ea269-7dbd-4199-9457-c0d4249346e0 admin admin] PATH_INFO: `/v3/projects/ad3f679db1a24395ad2ac1acad64f291` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:49.406705 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ea269-7dbd-4199-9457-c0d4249346e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad3f679db1a24395ad2ac1acad64f291)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:49.408661 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ea269-7dbd-4199-9457-c0d4249346e0 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:49.410425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:49.556111 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-620ea269-7dbd-4199-9457-c0d4249346e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad3f679db1a24395ad2ac1acad64f291', 'request_id': 'req-620ea269-7dbd-4199-9457-c0d4249346e0'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:49.559576 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-620ea269-7dbd-4199-9457-c0d4249346e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad3f679db1a24395ad2ac1acad64f291', 'request_id': 'req-620ea269-7dbd-4199-9457-c0d4249346e0'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:49.568277 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-620ea269-7dbd-4199-9457-c0d4249346e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad3f679db1a24395ad2ac1acad64f291', 'request_id': 'req-620ea269-7dbd-4199-9457-c0d4249346e0'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:49.690690 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-620ea269-7dbd-4199-9457-c0d4249346e0 admin admin] The token cache is being invalidate because project ad3f679db1a24395ad2ac1acad64f291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:09:49.691307 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-620ea269-7dbd-4199-9457-c0d4249346e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:49.692631 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-620ea269-7dbd-4199-9457-c0d4249346e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:49.695279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1313/2645] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:09:49 2022] DELETE /identity/v3/projects/ad3f679db1a24395ad2ac1acad64f291 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:49.700409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d525329-427f-46f4-837f-a89eaa97b079 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:49.704184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-2d525329-427f-46f4-837f-a89eaa97b079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:49.728930 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d525329-427f-46f4-837f-a89eaa97b079 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:49.826062 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8332f89-950e-4b6f-b3e9-a7857d8a66f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:49.826788 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8332f89-950e-4b6f-b3e9-a7857d8a66f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:49.827065 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8332f89-950e-4b6f-b3e9-a7857d8a66f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:49.827377 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8332f89-950e-4b6f-b3e9-a7857d8a66f3 admin admin] PATH_INFO: `/v3/users/1a2c91db0d42497f9d0d0752a596f6cc` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:49.828701 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8332f89-950e-4b6f-b3e9-a7857d8a66f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a2c91db0d42497f9d0d0752a596f6cc)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:49.830685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8332f89-950e-4b6f-b3e9-a7857d8a66f3 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:49.836297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:50.064047 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-c8332f89-950e-4b6f-b3e9-a7857d8a66f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a2c91db0d42497f9d0d0752a596f6cc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:50.064821 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-c8332f89-950e-4b6f-b3e9-a7857d8a66f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a2c91db0d42497f9d0d0752a596f6cc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:50.146383 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-c8332f89-950e-4b6f-b3e9-a7857d8a66f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a2c91db0d42497f9d0d0752a596f6cc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:50.165498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-c8332f89-950e-4b6f-b3e9-a7857d8a66f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a2c91db0d42497f9d0d0752a596f6cc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:50.176799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-c8332f89-950e-4b6f-b3e9-a7857d8a66f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a2c91db0d42497f9d0d0752a596f6cc'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:50.184006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1333/2646] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:09:49 2022] DELETE /identity/v3/users/1a2c91db0d42497f9d0d0752a596f6cc => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:50.770483 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ea269-7dbd-4199-9457-c0d4249346e0 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:50.772059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-620ea269-7dbd-4199-9457-c0d4249346e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:50.787923 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ea269-7dbd-4199-9457-c0d4249346e0 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:50.835408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8332f89-950e-4b6f-b3e9-a7857d8a66f3 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:50.837468 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c8332f89-950e-4b6f-b3e9-a7857d8a66f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:50.874504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4050483-c9b1-4ecd-a4ba-77f5a6d4eccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:50.875178 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4050483-c9b1-4ecd-a4ba-77f5a6d4eccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:50.875533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4050483-c9b1-4ecd-a4ba-77f5a6d4eccf admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:50.875895 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4050483-c9b1-4ecd-a4ba-77f5a6d4eccf admin admin] PATH_INFO: `/v3/users/c415c12984a44c5d918ee3469df08438` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:50.877186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4050483-c9b1-4ecd-a4ba-77f5a6d4eccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c415c12984a44c5d918ee3469df08438)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:50.879916 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4050483-c9b1-4ecd-a4ba-77f5a6d4eccf admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:50.924973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8332f89-950e-4b6f-b3e9-a7857d8a66f3 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:50.930440 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e0db4-248f-474c-9aec-32751fc7c16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:50.935830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e0db4-248f-474c-9aec-32751fc7c16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:50.937251 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e0db4-248f-474c-9aec-32751fc7c16e admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:50.937251 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e0db4-248f-474c-9aec-32751fc7c16e admin admin] PATH_INFO: `/v3/projects/844741df351246239b17b7e216fcc29d` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:50.938136 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e0db4-248f-474c-9aec-32751fc7c16e admin admin] RBAC: Authorizing `identity:delete_project(project_id=844741df351246239b17b7e216fcc29d)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:50.940164 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e0db4-248f-474c-9aec-32751fc7c16e admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:51.138486 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b81e0db4-248f-474c-9aec-32751fc7c16e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '844741df351246239b17b7e216fcc29d', 'request_id': 'req-b81e0db4-248f-474c-9aec-32751fc7c16e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:51.139308 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f4050483-c9b1-4ecd-a4ba-77f5a6d4eccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c415c12984a44c5d918ee3469df08438'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:51.140255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f4050483-c9b1-4ecd-a4ba-77f5a6d4eccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c415c12984a44c5d918ee3469df08438'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:51.225302 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b81e0db4-248f-474c-9aec-32751fc7c16e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '844741df351246239b17b7e216fcc29d', 'request_id': 'req-b81e0db4-248f-474c-9aec-32751fc7c16e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:51.235131 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b81e0db4-248f-474c-9aec-32751fc7c16e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '844741df351246239b17b7e216fcc29d', 'request_id': 'req-b81e0db4-248f-474c-9aec-32751fc7c16e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:51.249998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b81e0db4-248f-474c-9aec-32751fc7c16e admin admin] The token cache is being invalidate because project 844741df351246239b17b7e216fcc29d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:09:51.250484 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b81e0db4-248f-474c-9aec-32751fc7c16e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:51.251650 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b81e0db4-248f-474c-9aec-32751fc7c16e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:51.253648 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1334/2647] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:09:50 2022] DELETE /identity/v3/projects/844741df351246239b17b7e216fcc29d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:09:51.259832 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1ba62-4e3a-4ab2-ac3e-6ca46c18a88d None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:51.279624 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1ba62-4e3a-4ab2-ac3e-6ca46c18a88d None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:51.279624 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1ba62-4e3a-4ab2-ac3e-6ca46c18a88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:51.288148 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-7dc1ba62-4e3a-4ab2-ac3e-6ca46c18a88d None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:51.290211 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-7dc1ba62-4e3a-4ab2-ac3e-6ca46c18a88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:51.306401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:51.334112 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f4050483-c9b1-4ecd-a4ba-77f5a6d4eccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c415c12984a44c5d918ee3469df08438'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:51.349901 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f4050483-c9b1-4ecd-a4ba-77f5a6d4eccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c415c12984a44c5d918ee3469df08438'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:51.369649 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f4050483-c9b1-4ecd-a4ba-77f5a6d4eccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c415c12984a44c5d918ee3469df08438'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:51.380821 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1314/2648] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:09:50 2022] DELETE /identity/v3/users/c415c12984a44c5d918ee3469df08438 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:51.383470 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9381c2-5eda-4675-baf4-a6253c4a7d93 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:51.383950 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9381c2-5eda-4675-baf4-a6253c4a7d93 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:51.385085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9381c2-5eda-4675-baf4-a6253c4a7d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:51.404566 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1335/2649] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:09:51.412269 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-bd9381c2-5eda-4675-baf4-a6253c4a7d93 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:51.413054 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac208c7d-6796-46f6-af7b-e62010103e06 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:51.418297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac208c7d-6796-46f6-af7b-e62010103e06 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:51.418499 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-bd9381c2-5eda-4675-baf4-a6253c4a7d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:51.418657 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac208c7d-6796-46f6-af7b-e62010103e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:51.426539 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:51.435188 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-ac208c7d-6796-46f6-af7b-e62010103e06 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:51.436866 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ac208c7d-6796-46f6-af7b-e62010103e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:51.511385 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1315/2650] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:51.525925 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9381c2-5eda-4675-baf4-a6253c4a7d93 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:51.526118 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1336/2651] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:09:51.528679 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-bd9381c2-5eda-4675-baf4-a6253c4a7d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:51.531629 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac208c7d-6796-46f6-af7b-e62010103e06 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:51.542637 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac208c7d-6796-46f6-af7b-e62010103e06 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:51.553416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03740d1-5532-40b9-b950-ed537ba1b477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:51.554254 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03740d1-5532-40b9-b950-ed537ba1b477 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:51.554613 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03740d1-5532-40b9-b950-ed537ba1b477 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:51.554960 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03740d1-5532-40b9-b950-ed537ba1b477 admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:51.556716 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03740d1-5532-40b9-b950-ed537ba1b477 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:09:51.557147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03740d1-5532-40b9-b950-ed537ba1b477 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:51.559458 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03740d1-5532-40b9-b950-ed537ba1b477 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:51.577635 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1337/2652] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 04:09:51.582264 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03740d1-5532-40b9-b950-ed537ba1b477 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:51.597484 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03740d1-5532-40b9-b950-ed537ba1b477 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:51.602463 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079c908-9b09-4292-a8e2-8254937eb8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:51.603110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079c908-9b09-4292-a8e2-8254937eb8de admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:51.603311 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079c908-9b09-4292-a8e2-8254937eb8de admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:51.603621 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079c908-9b09-4292-a8e2-8254937eb8de admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:51.604296 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079c908-9b09-4292-a8e2-8254937eb8de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:51.606587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079c908-9b09-4292-a8e2-8254937eb8de admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:51.612386 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9381c2-5eda-4675-baf4-a6253c4a7d93 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:51.616607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0ae78-6de6-4f1e-8b45-61a3a4bcfd2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:51.617327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0ae78-6de6-4f1e-8b45-61a3a4bcfd2b service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:51.617677 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0ae78-6de6-4f1e-8b45-61a3a4bcfd2b service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:51.618016 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0ae78-6de6-4f1e-8b45-61a3a4bcfd2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:51.628584 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0ae78-6de6-4f1e-8b45-61a3a4bcfd2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:51.630360 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0ae78-6de6-4f1e-8b45-61a3a4bcfd2b service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:51.641172 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1316/2653] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:09:51.768231 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1338/2654] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:09:51 2022] POST /identity/v3/projects => generated 371 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:09:51.772760 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0ae78-6de6-4f1e-8b45-61a3a4bcfd2b service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:51.786734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0ae78-6de6-4f1e-8b45-61a3a4bcfd2b service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:51.865781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e1322-aeb1-46ea-a332-a7402bd695c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:51.870165 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e1322-aeb1-46ea-a332-a7402bd695c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:51.870165 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e1322-aeb1-46ea-a332-a7402bd695c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:51.870165 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e1322-aeb1-46ea-a332-a7402bd695c0 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:51.870165 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e1322-aeb1-46ea-a332-a7402bd695c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:51.870628 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e1322-aeb1-46ea-a332-a7402bd695c0 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:52.025300 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1317/2655] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:09:51 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:09:52.026626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079c908-9b09-4292-a8e2-8254937eb8de admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:52.039427 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079c908-9b09-4292-a8e2-8254937eb8de admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:52.044393 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35468fcd-791b-4f8e-a5bc-ac9bea4ed072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:52.045666 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35468fcd-791b-4f8e-a5bc-ac9bea4ed072 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:52.046099 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35468fcd-791b-4f8e-a5bc-ac9bea4ed072 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:52.046379 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35468fcd-791b-4f8e-a5bc-ac9bea4ed072 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:52.047107 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35468fcd-791b-4f8e-a5bc-ac9bea4ed072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:52.048839 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35468fcd-791b-4f8e-a5bc-ac9bea4ed072 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:52.061726 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1339/2656] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:09:52.069090 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e1322-aeb1-46ea-a332-a7402bd695c0 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:52.080090 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e1322-aeb1-46ea-a332-a7402bd695c0 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:52.085245 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6653df-3be5-42c0-b118-c16847c7e837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:52.085904 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6653df-3be5-42c0-b118-c16847c7e837 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:52.086187 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6653df-3be5-42c0-b118-c16847c7e837 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:52.086461 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6653df-3be5-42c0-b118-c16847c7e837 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:52.087196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6653df-3be5-42c0-b118-c16847c7e837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:52.089004 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6653df-3be5-42c0-b118-c16847c7e837 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:52.101386 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1318/2657] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:52.105634 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35468fcd-791b-4f8e-a5bc-ac9bea4ed072 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:52.117071 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35468fcd-791b-4f8e-a5bc-ac9bea4ed072 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:52.122021 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0cf5a9-9a57-4cd2-ad41-e6b595b90796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:52.122735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cf5a9-9a57-4cd2-ad41-e6b595b90796 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:52.123192 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cf5a9-9a57-4cd2-ad41-e6b595b90796 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:52.123784 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cf5a9-9a57-4cd2-ad41-e6b595b90796 admin admin] PATH_INFO: `/v3/projects/cc8c6b6cefd04be7b75cedec05a84b5d/users/f3858b39421d4d54adda729040da02d4/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:52.150238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6653df-3be5-42c0-b118-c16847c7e837 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:52.152545 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-aa6653df-3be5-42c0-b118-c16847c7e837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:52.158066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0cf5a9-9a57-4cd2-ad41-e6b595b90796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8c6b6cefd04be7b75cedec05a84b5d, user_id=f3858b39421d4d54adda729040da02d4, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:52.163083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0cf5a9-9a57-4cd2-ad41-e6b595b90796 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:52.178599 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6653df-3be5-42c0-b118-c16847c7e837 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:52.189698 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662f48d-51c0-4141-a670-b75d21200441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:52.189698 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662f48d-51c0-4141-a670-b75d21200441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:52.189698 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662f48d-51c0-4141-a670-b75d21200441 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:52.190470 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662f48d-51c0-4141-a670-b75d21200441 admin admin] PATH_INFO: `/v3/projects/26a01a9cfb344e98a31d8dc7cd587dbb` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:52.192145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662f48d-51c0-4141-a670-b75d21200441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26a01a9cfb344e98a31d8dc7cd587dbb)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:52.194152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662f48d-51c0-4141-a670-b75d21200441 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:52.268529 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1340/2658] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:52 2022] PUT /identity/v3/projects/cc8c6b6cefd04be7b75cedec05a84b5d/users/f3858b39421d4d54adda729040da02d4/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:52.269841 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d30b1-03cf-46f8-ae0b-499f7547e995 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:52.270110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d30b1-03cf-46f8-ae0b-499f7547e995 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:52.270381 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d30b1-03cf-46f8-ae0b-499f7547e995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:52.292510 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-8a2d30b1-03cf-46f8-ae0b-499f7547e995 None None] MFA Rules not processed for user `deba0a6ab39a4f33a509a09e875f852c`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:52.295297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-8a2d30b1-03cf-46f8-ae0b-499f7547e995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:52.360970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1662f48d-51c0-4141-a670-b75d21200441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26a01a9cfb344e98a31d8dc7cd587dbb', 'request_id': 'req-1662f48d-51c0-4141-a670-b75d21200441'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:52.361401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1341/2659] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:52.363641 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe44ebc-a198-49cd-9c49-0420ea65e3b0 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:52.364088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe44ebc-a198-49cd-9c49-0420ea65e3b0 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:52.364372 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe44ebc-a198-49cd-9c49-0420ea65e3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:52.384195 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1662f48d-51c0-4141-a670-b75d21200441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26a01a9cfb344e98a31d8dc7cd587dbb', 'request_id': 'req-1662f48d-51c0-4141-a670-b75d21200441'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:52.387978 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1662f48d-51c0-4141-a670-b75d21200441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26a01a9cfb344e98a31d8dc7cd587dbb', 'request_id': 'req-1662f48d-51c0-4141-a670-b75d21200441'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:52.397274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-cfe44ebc-a198-49cd-9c49-0420ea65e3b0 None None] MFA Rules not processed for user `f3858b39421d4d54adda729040da02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:52.398508 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-cfe44ebc-a198-49cd-9c49-0420ea65e3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:52.436228 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:52.473859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1662f48d-51c0-4141-a670-b75d21200441 admin admin] The token cache is being invalidate because project 26a01a9cfb344e98a31d8dc7cd587dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:09:52.474232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1662f48d-51c0-4141-a670-b75d21200441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:52.482068 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-1662f48d-51c0-4141-a670-b75d21200441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:52.482516 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1342/2660] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:52.483371 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1319/2661] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:09:52 2022] DELETE /identity/v3/projects/26a01a9cfb344e98a31d8dc7cd587dbb => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:52.484228 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe44ebc-a198-49cd-9c49-0420ea65e3b0 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:52.491215 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662f48d-51c0-4141-a670-b75d21200441 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:52.492692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-1662f48d-51c0-4141-a670-b75d21200441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:52.513164 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:52.570171 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe44ebc-a198-49cd-9c49-0420ea65e3b0 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:52.575584 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ab4aa-37f7-48f2-b02c-a82d075a5244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:52.576801 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ab4aa-37f7-48f2-b02c-a82d075a5244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:52.577081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ab4aa-37f7-48f2-b02c-a82d075a5244 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:52.577360 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ab4aa-37f7-48f2-b02c-a82d075a5244 admin admin] PATH_INFO: `/v3/users/a3e69fe927ce40c196bc601bda4dbb0e` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:52.577526 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662f48d-51c0-4141-a670-b75d21200441 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:52.578641 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ab4aa-37f7-48f2-b02c-a82d075a5244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3e69fe927ce40c196bc601bda4dbb0e)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:52.580668 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ab4aa-37f7-48f2-b02c-a82d075a5244 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:52.582131 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191b0ac-6da8-4ced-9246-4ebc3c5d5038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:52.582791 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191b0ac-6da8-4ced-9246-4ebc3c5d5038 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:52.583074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191b0ac-6da8-4ced-9246-4ebc3c5d5038 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:52.583379 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191b0ac-6da8-4ced-9246-4ebc3c5d5038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:52.585525 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e191b0ac-6da8-4ced-9246-4ebc3c5d5038 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:52.598663 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191b0ac-6da8-4ced-9246-4ebc3c5d5038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:52.600323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191b0ac-6da8-4ced-9246-4ebc3c5d5038 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:52.613313 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1320/2662] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:09:52.645713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191b0ac-6da8-4ced-9246-4ebc3c5d5038 service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:52.647240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e191b0ac-6da8-4ced-9246-4ebc3c5d5038 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:52.663843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191b0ac-6da8-4ced-9246-4ebc3c5d5038 service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:52.669863 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348a7f8-76d2-4144-b743-b74adc03ac6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:52.670618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348a7f8-76d2-4144-b743-b74adc03ac6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:52.670971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348a7f8-76d2-4144-b743-b74adc03ac6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:52.671473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348a7f8-76d2-4144-b743-b74adc03ac6b admin admin] PATH_INFO: `/v3/users/f3858b39421d4d54adda729040da02d4` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:52.672795 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348a7f8-76d2-4144-b743-b74adc03ac6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3858b39421d4d54adda729040da02d4)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:52.674841 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348a7f8-76d2-4144-b743-b74adc03ac6b admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:52.771966 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-be9ab4aa-37f7-48f2-b02c-a82d075a5244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3e69fe927ce40c196bc601bda4dbb0e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:52.773135 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-be9ab4aa-37f7-48f2-b02c-a82d075a5244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3e69fe927ce40c196bc601bda4dbb0e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:52.901558 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-be9ab4aa-37f7-48f2-b02c-a82d075a5244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3e69fe927ce40c196bc601bda4dbb0e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:52.918103 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-be9ab4aa-37f7-48f2-b02c-a82d075a5244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3e69fe927ce40c196bc601bda4dbb0e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:52.922813 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b348a7f8-76d2-4144-b743-b74adc03ac6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3858b39421d4d54adda729040da02d4'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:52.923798 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b348a7f8-76d2-4144-b743-b74adc03ac6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3858b39421d4d54adda729040da02d4'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:52.926325 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-be9ab4aa-37f7-48f2-b02c-a82d075a5244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3e69fe927ce40c196bc601bda4dbb0e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:52.928084 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:52.934951 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1343/2663] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:09:52 2022] DELETE /identity/v3/users/a3e69fe927ce40c196bc601bda4dbb0e => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:09:52.996612 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b348a7f8-76d2-4144-b743-b74adc03ac6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3858b39421d4d54adda729040da02d4'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:53.007172 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b348a7f8-76d2-4144-b743-b74adc03ac6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3858b39421d4d54adda729040da02d4'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:53.026209 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b348a7f8-76d2-4144-b743-b74adc03ac6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3858b39421d4d54adda729040da02d4'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:53.038720 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1321/2664] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:09:52 2022] DELETE /identity/v3/users/f3858b39421d4d54adda729040da02d4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:53.044192 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e72e0-e029-47aa-9056-de1231a5b745 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:53.045392 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e72e0-e029-47aa-9056-de1231a5b745 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:53.045655 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e72e0-e029-47aa-9056-de1231a5b745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:53.065333 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-3b8e72e0-e029-47aa-9056-de1231a5b745 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:53.066562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-3b8e72e0-e029-47aa-9056-de1231a5b745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:53.133299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1344/2665] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:53.144478 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348a7f8-76d2-4144-b743-b74adc03ac6b admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:53.152137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b348a7f8-76d2-4144-b743-b74adc03ac6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:53.210515 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:53.269523 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348a7f8-76d2-4144-b743-b74adc03ac6b admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:53.274647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff331e-6ab9-4e11-b785-5c2e6b88da00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:53.274647 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff331e-6ab9-4e11-b785-5c2e6b88da00 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:53.274998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff331e-6ab9-4e11-b785-5c2e6b88da00 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:53.274998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff331e-6ab9-4e11-b785-5c2e6b88da00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:53.289447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff331e-6ab9-4e11-b785-5c2e6b88da00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:53.291082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff331e-6ab9-4e11-b785-5c2e6b88da00 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:53.304951 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1322/2666] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:09:53.507660 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e72e0-e029-47aa-9056-de1231a5b745 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:53.509297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-3b8e72e0-e029-47aa-9056-de1231a5b745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:53.527124 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e72e0-e029-47aa-9056-de1231a5b745 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:53.534321 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaedbc3-1f3f-4ff9-b166-7f8ce07b1758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:53.535292 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaedbc3-1f3f-4ff9-b166-7f8ce07b1758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:53.535705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaedbc3-1f3f-4ff9-b166-7f8ce07b1758 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:53.536143 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaedbc3-1f3f-4ff9-b166-7f8ce07b1758 admin admin] PATH_INFO: `/v3/projects/b5a0aaab0c214b69a77d8811ed9f08e4` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:53.537816 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaedbc3-1f3f-4ff9-b166-7f8ce07b1758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a0aaab0c214b69a77d8811ed9f08e4)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:53.540076 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaedbc3-1f3f-4ff9-b166-7f8ce07b1758 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:53.717441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-deaedbc3-1f3f-4ff9-b166-7f8ce07b1758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a0aaab0c214b69a77d8811ed9f08e4', 'request_id': 'req-deaedbc3-1f3f-4ff9-b166-7f8ce07b1758'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:53.928269 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-deaedbc3-1f3f-4ff9-b166-7f8ce07b1758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a0aaab0c214b69a77d8811ed9f08e4', 'request_id': 'req-deaedbc3-1f3f-4ff9-b166-7f8ce07b1758'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:53.936168 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-deaedbc3-1f3f-4ff9-b166-7f8ce07b1758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a0aaab0c214b69a77d8811ed9f08e4', 'request_id': 'req-deaedbc3-1f3f-4ff9-b166-7f8ce07b1758'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:53.948589 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-deaedbc3-1f3f-4ff9-b166-7f8ce07b1758 admin admin] The token cache is being invalidate because project b5a0aaab0c214b69a77d8811ed9f08e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:09:53.948893 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-deaedbc3-1f3f-4ff9-b166-7f8ce07b1758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:53.949585 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-deaedbc3-1f3f-4ff9-b166-7f8ce07b1758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:53.951150 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1345/2667] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:09:53 2022] DELETE /identity/v3/projects/b5a0aaab0c214b69a77d8811ed9f08e4 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:53.956400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375a96a-16c7-4e7a-b4f3-e6f6e530b888 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:53.956921 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375a96a-16c7-4e7a-b4f3-e6f6e530b888 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:53.957712 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375a96a-16c7-4e7a-b4f3-e6f6e530b888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:53.977564 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaedbc3-1f3f-4ff9-b166-7f8ce07b1758 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:53.977950 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-b375a96a-16c7-4e7a-b4f3-e6f6e530b888 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:53.979165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-deaedbc3-1f3f-4ff9-b166-7f8ce07b1758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:53.979311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b375a96a-16c7-4e7a-b4f3-e6f6e530b888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:54.064096 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1323/2668] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:54.068770 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaedbc3-1f3f-4ff9-b166-7f8ce07b1758 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:54.071986 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720012b0-b1d3-4e41-ae58-91bb8d378007 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:54.072278 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720012b0-b1d3-4e41-ae58-91bb8d378007 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:54.072560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720012b0-b1d3-4e41-ae58-91bb8d378007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:54.072726 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c05ca-efbd-4209-a721-2e2e888fa150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:54.073397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c05ca-efbd-4209-a721-2e2e888fa150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:54.073714 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c05ca-efbd-4209-a721-2e2e888fa150 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:54.073984 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c05ca-efbd-4209-a721-2e2e888fa150 admin admin] PATH_INFO: `/v3/projects/cc8c6b6cefd04be7b75cedec05a84b5d` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:54.075253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c05ca-efbd-4209-a721-2e2e888fa150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc8c6b6cefd04be7b75cedec05a84b5d)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:54.077899 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c05ca-efbd-4209-a721-2e2e888fa150 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:54.094732 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-720012b0-b1d3-4e41-ae58-91bb8d378007 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:54.096356 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-720012b0-b1d3-4e41-ae58-91bb8d378007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:54.105962 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1324/2669] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:09:54.115793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:54.116030 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720012b0-b1d3-4e41-ae58-91bb8d378007 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:54.122675 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720012b0-b1d3-4e41-ae58-91bb8d378007 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:54.128050 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9619ee-5f8f-405a-8599-3331211808fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:54.128703 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9619ee-5f8f-405a-8599-3331211808fa admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:54.129239 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9619ee-5f8f-405a-8599-3331211808fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:54.129521 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9619ee-5f8f-405a-8599-3331211808fa admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:54.130222 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9619ee-5f8f-405a-8599-3331211808fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:09:54.130554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9619ee-5f8f-405a-8599-3331211808fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:54.132159 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9619ee-5f8f-405a-8599-3331211808fa admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:54.145440 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1325/2670] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 04:09:54.150157 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9619ee-5f8f-405a-8599-3331211808fa admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:54.162230 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9619ee-5f8f-405a-8599-3331211808fa admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:54.168901 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9862665-c987-4069-abde-8ddb61b240de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:54.168901 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9862665-c987-4069-abde-8ddb61b240de admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:54.168901 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9862665-c987-4069-abde-8ddb61b240de admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:54.168901 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9862665-c987-4069-abde-8ddb61b240de admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:54.176023 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9862665-c987-4069-abde-8ddb61b240de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:54.176023 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9862665-c987-4069-abde-8ddb61b240de admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:54.235451 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-e17c05ca-efbd-4209-a721-2e2e888fa150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc8c6b6cefd04be7b75cedec05a84b5d', 'request_id': 'req-e17c05ca-efbd-4209-a721-2e2e888fa150'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:54.345965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1326/2671] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:09:54 2022] POST /identity/v3/projects => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:09:54.350701 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9862665-c987-4069-abde-8ddb61b240de admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:54.364334 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-e17c05ca-efbd-4209-a721-2e2e888fa150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc8c6b6cefd04be7b75cedec05a84b5d', 'request_id': 'req-e17c05ca-efbd-4209-a721-2e2e888fa150'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:54.379556 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-e17c05ca-efbd-4209-a721-2e2e888fa150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc8c6b6cefd04be7b75cedec05a84b5d', 'request_id': 'req-e17c05ca-efbd-4209-a721-2e2e888fa150'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:54.387254 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-e17c05ca-efbd-4209-a721-2e2e888fa150 admin admin] The token cache is being invalidate because project cc8c6b6cefd04be7b75cedec05a84b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:09:54.388120 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-e17c05ca-efbd-4209-a721-2e2e888fa150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:54.390114 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-e17c05ca-efbd-4209-a721-2e2e888fa150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:09:54.392159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1346/2672] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:09:53 2022] DELETE /identity/v3/projects/cc8c6b6cefd04be7b75cedec05a84b5d => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:09:54.397208 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102e959-ebf2-4b66-8af4-c363a1971a3e None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:54.397485 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102e959-ebf2-4b66-8af4-c363a1971a3e None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:54.397643 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102e959-ebf2-4b66-8af4-c363a1971a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:54.422011 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-f102e959-ebf2-4b66-8af4-c363a1971a3e None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:54.423255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f102e959-ebf2-4b66-8af4-c363a1971a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:54.440557 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9862665-c987-4069-abde-8ddb61b240de admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:54.446491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07fafe-8d4c-491f-9896-e0ce50251e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:54.446491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07fafe-8d4c-491f-9896-e0ce50251e9d admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:54.446491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07fafe-8d4c-491f-9896-e0ce50251e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:54.447116 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07fafe-8d4c-491f-9896-e0ce50251e9d admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:54.447845 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07fafe-8d4c-491f-9896-e0ce50251e9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:54.449935 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07fafe-8d4c-491f-9896-e0ce50251e9d admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:54.495126 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1347/2673] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:09:54.503277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febcc70-3e66-4c2c-b880-a258ad8f69c1 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:54.503706 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febcc70-3e66-4c2c-b880-a258ad8f69c1 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:54.503919 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febcc70-3e66-4c2c-b880-a258ad8f69c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:54.525911 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-2febcc70-3e66-4c2c-b880-a258ad8f69c1 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:54.527175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-2febcc70-3e66-4c2c-b880-a258ad8f69c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:54.537895 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1348/2674] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:09:54.541618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febcc70-3e66-4c2c-b880-a258ad8f69c1 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:54.551911 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febcc70-3e66-4c2c-b880-a258ad8f69c1 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:54.556607 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe83de1-845f-47db-982a-2bbde7d0dad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:54.557328 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe83de1-845f-47db-982a-2bbde7d0dad7 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:54.557608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe83de1-845f-47db-982a-2bbde7d0dad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:54.558286 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe83de1-845f-47db-982a-2bbde7d0dad7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:54.558715 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe83de1-845f-47db-982a-2bbde7d0dad7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:09:54.559026 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe83de1-845f-47db-982a-2bbde7d0dad7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:54.560736 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe83de1-845f-47db-982a-2bbde7d0dad7 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:54.579104 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1349/2675] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 04:09:54.585015 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe83de1-845f-47db-982a-2bbde7d0dad7 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:54.596397 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe83de1-845f-47db-982a-2bbde7d0dad7 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:54.601368 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b5680-f6cf-420f-857d-85bb5d7d9933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:54.601996 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b5680-f6cf-420f-857d-85bb5d7d9933 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:54.602279 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b5680-f6cf-420f-857d-85bb5d7d9933 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:54.602625 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b5680-f6cf-420f-857d-85bb5d7d9933 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:54.603298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b5680-f6cf-420f-857d-85bb5d7d9933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:54.606104 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1327/2676] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:09:54 2022] POST /identity/v3/users => generated 284 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:09:54.606268 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b5680-f6cf-420f-857d-85bb5d7d9933 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:54.620163 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07fafe-8d4c-491f-9896-e0ce50251e9d admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:54.622000 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-6d07fafe-8d4c-491f-9896-e0ce50251e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:54.635635 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07fafe-8d4c-491f-9896-e0ce50251e9d admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:54.642021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778964ef-4aac-4952-8ad7-ef372a2d5327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:54.642668 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778964ef-4aac-4952-8ad7-ef372a2d5327 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:54.642958 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778964ef-4aac-4952-8ad7-ef372a2d5327 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:54.646965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778964ef-4aac-4952-8ad7-ef372a2d5327 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:54.646965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778964ef-4aac-4952-8ad7-ef372a2d5327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:54.646965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778964ef-4aac-4952-8ad7-ef372a2d5327 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:54.659259 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1328/2677] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:09:54.662067 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778964ef-4aac-4952-8ad7-ef372a2d5327 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:54.673472 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778964ef-4aac-4952-8ad7-ef372a2d5327 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:54.678536 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e9a69-4144-41fe-98e9-92accd0ef3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:54.679163 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e9a69-4144-41fe-98e9-92accd0ef3ae admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:54.679496 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e9a69-4144-41fe-98e9-92accd0ef3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:54.679769 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e9a69-4144-41fe-98e9-92accd0ef3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:54.680463 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e9a69-4144-41fe-98e9-92accd0ef3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:54.682315 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e9a69-4144-41fe-98e9-92accd0ef3ae admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:54.685048 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:54.695514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1329/2678] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:09:54.699058 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e9a69-4144-41fe-98e9-92accd0ef3ae admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:54.711646 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e9a69-4144-41fe-98e9-92accd0ef3ae admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:54.718600 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adc847-7c41-47a3-9429-eaa3b064d8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:54.719298 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adc847-7c41-47a3-9429-eaa3b064d8b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:54.719615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adc847-7c41-47a3-9429-eaa3b064d8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:54.719895 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adc847-7c41-47a3-9429-eaa3b064d8b2 admin admin] PATH_INFO: `/v3/projects/8292cfdf0ae84d7a994270852f61b1bd/users/66fc154292dd4883963bab794e93f917/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:54.735956 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adc847-7c41-47a3-9429-eaa3b064d8b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8292cfdf0ae84d7a994270852f61b1bd, user_id=66fc154292dd4883963bab794e93f917, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:54.738754 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adc847-7c41-47a3-9429-eaa3b064d8b2 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:54.784976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1350/2679] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:09:54 2022] POST /identity/v3/projects => generated 373 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:09:54.789615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b5680-f6cf-420f-857d-85bb5d7d9933 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:54.858054 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b5680-f6cf-420f-857d-85bb5d7d9933 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:54.867405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18bd51-7da3-4e38-beeb-8a4dd052e9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:54.867405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18bd51-7da3-4e38-beeb-8a4dd052e9d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:54.867405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18bd51-7da3-4e38-beeb-8a4dd052e9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:54.867405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18bd51-7da3-4e38-beeb-8a4dd052e9d1 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:54.868219 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18bd51-7da3-4e38-beeb-8a4dd052e9d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:54.869971 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18bd51-7da3-4e38-beeb-8a4dd052e9d1 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:54.891003 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1330/2680] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:54 2022] PUT /identity/v3/projects/8292cfdf0ae84d7a994270852f61b1bd/users/66fc154292dd4883963bab794e93f917/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:09:54.903624 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0eeda-3d83-4b56-983b-e9fbff947432 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:54.904063 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0eeda-3d83-4b56-983b-e9fbff947432 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:54.904687 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0eeda-3d83-4b56-983b-e9fbff947432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:54.939536 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-36f0eeda-3d83-4b56-983b-e9fbff947432 None None] MFA Rules not processed for user `66fc154292dd4883963bab794e93f917`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:54.941269 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-36f0eeda-3d83-4b56-983b-e9fbff947432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:54.971201 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:54.978169 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1351/2681] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:09:54 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:09:54.984250 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18bd51-7da3-4e38-beeb-8a4dd052e9d1 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:55.000333 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18bd51-7da3-4e38-beeb-8a4dd052e9d1 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:55.030327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1331/2682] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:09:55.037877 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0eeda-3d83-4b56-983b-e9fbff947432 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:55.086843 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fca74b-bb74-44b7-8703-c84c42c64b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:55.087573 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fca74b-bb74-44b7-8703-c84c42c64b66 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:55.087881 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fca74b-bb74-44b7-8703-c84c42c64b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:55.089808 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fca74b-bb74-44b7-8703-c84c42c64b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:55.089808 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fca74b-bb74-44b7-8703-c84c42c64b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:55.090509 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fca74b-bb74-44b7-8703-c84c42c64b66 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:55.107670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1352/2683] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:09:55.112946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fca74b-bb74-44b7-8703-c84c42c64b66 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:55.124974 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fca74b-bb74-44b7-8703-c84c42c64b66 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:55.130361 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a1d1b-9fb9-431c-9b3b-406a985d390f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:55.131874 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a1d1b-9fb9-431c-9b3b-406a985d390f admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:55.131874 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a1d1b-9fb9-431c-9b3b-406a985d390f admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:55.131874 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a1d1b-9fb9-431c-9b3b-406a985d390f admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:55.132413 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a1d1b-9fb9-431c-9b3b-406a985d390f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:55.133902 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a1d1b-9fb9-431c-9b3b-406a985d390f admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:55.139037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0eeda-3d83-4b56-983b-e9fbff947432 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:55.144423 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd641aa2-c4f8-4ce2-885e-c2ffa66796a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:55.145066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd641aa2-c4f8-4ce2-885e-c2ffa66796a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:55.145348 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd641aa2-c4f8-4ce2-885e-c2ffa66796a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:55.145625 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd641aa2-c4f8-4ce2-885e-c2ffa66796a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:55.146302 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd641aa2-c4f8-4ce2-885e-c2ffa66796a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:55.146517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1353/2684] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:09:55.148401 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd641aa2-c4f8-4ce2-885e-c2ffa66796a6 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:55.150937 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a1d1b-9fb9-431c-9b3b-406a985d390f admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:55.161480 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a1d1b-9fb9-431c-9b3b-406a985d390f admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:55.167238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb3c2d-7464-4fce-8ecf-84430087fe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:55.170273 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb3c2d-7464-4fce-8ecf-84430087fe38 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:55.170273 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb3c2d-7464-4fce-8ecf-84430087fe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:55.170273 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb3c2d-7464-4fce-8ecf-84430087fe38 admin admin] PATH_INFO: `/v3/projects/48c47397b2f54097ab60ee29b920423a/users/03e559bd986248e395b7b0f0f8676887/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:55.186487 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb3c2d-7464-4fce-8ecf-84430087fe38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c47397b2f54097ab60ee29b920423a, user_id=03e559bd986248e395b7b0f0f8676887, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:55.189273 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb3c2d-7464-4fce-8ecf-84430087fe38 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:55.326156 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1354/2685] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:55 2022] PUT /identity/v3/projects/48c47397b2f54097ab60ee29b920423a/users/03e559bd986248e395b7b0f0f8676887/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:55.330926 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1332/2686] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:09:55 2022] POST /identity/v3/projects => generated 367 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:09:55.333913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb3c2d-7464-4fce-8ecf-84430087fe38 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:55.344374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2486e5c-0c60-4516-a902-79b2a9d20191 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:55.344626 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2486e5c-0c60-4516-a902-79b2a9d20191 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:55.345081 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2486e5c-0c60-4516-a902-79b2a9d20191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:55.381780 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-d2486e5c-0c60-4516-a902-79b2a9d20191 None None] MFA Rules not processed for user `03e559bd986248e395b7b0f0f8676887`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:55.383128 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-d2486e5c-0c60-4516-a902-79b2a9d20191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:55.428862 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb3c2d-7464-4fce-8ecf-84430087fe38 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:55.464213 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:55.527346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1333/2687] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:09:55.548408 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2486e5c-0c60-4516-a902-79b2a9d20191 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:55.550752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-d2486e5c-0c60-4516-a902-79b2a9d20191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:55.559709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87928bb-94b7-448c-a565-39c13fc590c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:55.560941 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87928bb-94b7-448c-a565-39c13fc590c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:55.561706 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87928bb-94b7-448c-a565-39c13fc590c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:55.561706 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87928bb-94b7-448c-a565-39c13fc590c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:55.562733 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87928bb-94b7-448c-a565-39c13fc590c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:55.564775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87928bb-94b7-448c-a565-39c13fc590c7 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:55.620788 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2486e5c-0c60-4516-a902-79b2a9d20191 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:55.625088 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4b41c-29eb-4132-af83-c29d2fa587e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:55.625809 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4b41c-29eb-4132-af83-c29d2fa587e6 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:55.626071 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4b41c-29eb-4132-af83-c29d2fa587e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:55.626347 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4b41c-29eb-4132-af83-c29d2fa587e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:55.636119 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4b41c-29eb-4132-af83-c29d2fa587e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:55.637575 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4b41c-29eb-4132-af83-c29d2fa587e6 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:55.647996 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1334/2688] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:09:55.689183 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:55.695595 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1355/2689] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:09:55 2022] POST /identity/v3/users => generated 290 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:09:55.700663 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4b41c-29eb-4132-af83-c29d2fa587e6 service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:55.727622 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4b41c-29eb-4132-af83-c29d2fa587e6 service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:55.737403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c3e7a-050e-42a3-80d9-9df0f15f9e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:55.739454 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c3e7a-050e-42a3-80d9-9df0f15f9e04 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:55.740007 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c3e7a-050e-42a3-80d9-9df0f15f9e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:55.740693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c3e7a-050e-42a3-80d9-9df0f15f9e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:55.741826 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c3e7a-050e-42a3-80d9-9df0f15f9e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:55.745045 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c3e7a-050e-42a3-80d9-9df0f15f9e04 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:55.760623 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1335/2690] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:55.767520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87928bb-94b7-448c-a565-39c13fc590c7 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:55.778693 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87928bb-94b7-448c-a565-39c13fc590c7 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:55.785040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422a486-f38e-4c52-935b-1736c3337215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:55.785840 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422a486-f38e-4c52-935b-1736c3337215 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:55.786220 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422a486-f38e-4c52-935b-1736c3337215 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:55.786578 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422a486-f38e-4c52-935b-1736c3337215 admin admin] PATH_INFO: `/v3/projects/105f5e2e8dd945718043c0fa3b95ac7b/users/236c50b3ed6d4bc1a6f4d44b55423f11/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:55.811208 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422a486-f38e-4c52-935b-1736c3337215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=105f5e2e8dd945718043c0fa3b95ac7b, user_id=236c50b3ed6d4bc1a6f4d44b55423f11, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:55.814949 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422a486-f38e-4c52-935b-1736c3337215 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:55.956487 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1356/2691] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:55 2022] PUT /identity/v3/projects/105f5e2e8dd945718043c0fa3b95ac7b/users/236c50b3ed6d4bc1a6f4d44b55423f11/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:09:55.961479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c3e7a-050e-42a3-80d9-9df0f15f9e04 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:55.977862 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c3e7a-050e-42a3-80d9-9df0f15f9e04 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:56.090586 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ddb3e-8de2-4be1-b7a2-670b3ea50a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:56.092109 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ddb3e-8de2-4be1-b7a2-670b3ea50a21 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:56.092545 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ddb3e-8de2-4be1-b7a2-670b3ea50a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:56.093016 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ddb3e-8de2-4be1-b7a2-670b3ea50a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:56.093975 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ddb3e-8de2-4be1-b7a2-670b3ea50a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:56.095914 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ddb3e-8de2-4be1-b7a2-670b3ea50a21 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:56.108029 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1336/2692] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:09:56.112589 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422a486-f38e-4c52-935b-1736c3337215 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:56.124375 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422a486-f38e-4c52-935b-1736c3337215 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:56.129673 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db952194-bdef-42e3-aa2c-9cb0ca3650bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:56.130388 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db952194-bdef-42e3-aa2c-9cb0ca3650bc admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:56.130659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db952194-bdef-42e3-aa2c-9cb0ca3650bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:56.130934 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db952194-bdef-42e3-aa2c-9cb0ca3650bc admin admin] PATH_INFO: `/v3/projects/105f5e2e8dd945718043c0fa3b95ac7b/users/236c50b3ed6d4bc1a6f4d44b55423f11/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:56.133059 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db952194-bdef-42e3-aa2c-9cb0ca3650bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=105f5e2e8dd945718043c0fa3b95ac7b, user_id=236c50b3ed6d4bc1a6f4d44b55423f11, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:56.135837 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db952194-bdef-42e3-aa2c-9cb0ca3650bc admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:56.164656 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1357/2693] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:09:56 2022] PUT /identity/v3/projects/105f5e2e8dd945718043c0fa3b95ac7b/users/236c50b3ed6d4bc1a6f4d44b55423f11/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:09:56.176803 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d497f-7fd8-4962-9bc4-472c796fe18e None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:56.177366 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d497f-7fd8-4962-9bc4-472c796fe18e None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:56.177818 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d497f-7fd8-4962-9bc4-472c796fe18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:56.226595 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-3d6d497f-7fd8-4962-9bc4-472c796fe18e None None] MFA Rules not processed for user `236c50b3ed6d4bc1a6f4d44b55423f11`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:09:56.228894 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-3d6d497f-7fd8-4962-9bc4-472c796fe18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:56.298244 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:56.320630 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1337/2694] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:09:56 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:09:56.335573 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db952194-bdef-42e3-aa2c-9cb0ca3650bc admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:56.417435 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db952194-bdef-42e3-aa2c-9cb0ca3650bc admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:56.422205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8586f-a2f3-49cd-928f-928d95118148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:56.422869 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8586f-a2f3-49cd-928f-928d95118148 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:56.423145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8586f-a2f3-49cd-928f-928d95118148 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:56.423445 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8586f-a2f3-49cd-928f-928d95118148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:56.434510 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8586f-a2f3-49cd-928f-928d95118148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:56.436644 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8586f-a2f3-49cd-928f-928d95118148 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:56.452763 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1358/2695] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:56 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:09:56.737567 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d497f-7fd8-4962-9bc4-472c796fe18e None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:09:56.739925 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-3d6d497f-7fd8-4962-9bc4-472c796fe18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:09:56.757701 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d497f-7fd8-4962-9bc4-472c796fe18e None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:09:56.764213 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812c658-9191-4dfa-a93e-869e0ad2e554 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:09:56.764907 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812c658-9191-4dfa-a93e-869e0ad2e554 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:09:56.765347 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812c658-9191-4dfa-a93e-869e0ad2e554 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:09:56.765630 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812c658-9191-4dfa-a93e-869e0ad2e554 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:09:56.855973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812c658-9191-4dfa-a93e-869e0ad2e554 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:09:56.858583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812c658-9191-4dfa-a93e-869e0ad2e554 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:09:56.868867 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1338/2696] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:09:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:10:04.452739 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8586f-a2f3-49cd-928f-928d95118148 service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:04.581510 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8586f-a2f3-49cd-928f-928d95118148 service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:04.588779 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb27422-99ca-429e-a2bd-6d5295bdd81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:04.589755 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb27422-99ca-429e-a2bd-6d5295bdd81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:04.590103 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb27422-99ca-429e-a2bd-6d5295bdd81d admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:04.590575 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb27422-99ca-429e-a2bd-6d5295bdd81d admin admin] PATH_INFO: `/v3/users/66fc154292dd4883963bab794e93f917` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:04.593846 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb27422-99ca-429e-a2bd-6d5295bdd81d admin admin] RBAC: Authorizing `identity:delete_user(user_id=66fc154292dd4883963bab794e93f917)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:04.597974 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb27422-99ca-429e-a2bd-6d5295bdd81d admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:04.624249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:04.842324 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1cb27422-99ca-429e-a2bd-6d5295bdd81d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66fc154292dd4883963bab794e93f917'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:04.842324 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1cb27422-99ca-429e-a2bd-6d5295bdd81d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66fc154292dd4883963bab794e93f917'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:04.936263 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1cb27422-99ca-429e-a2bd-6d5295bdd81d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66fc154292dd4883963bab794e93f917'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:04.953475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1cb27422-99ca-429e-a2bd-6d5295bdd81d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66fc154292dd4883963bab794e93f917'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:04.961160 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1cb27422-99ca-429e-a2bd-6d5295bdd81d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66fc154292dd4883963bab794e93f917'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:04.967446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1359/2697] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:10:04 2022] DELETE /identity/v3/users/66fc154292dd4883963bab794e93f917 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:10:04.972031 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57091c-1799-4a1b-9943-8a44a706b768 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:04.978963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57091c-1799-4a1b-9943-8a44a706b768 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:04.978963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57091c-1799-4a1b-9943-8a44a706b768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:05.028177 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-2a57091c-1799-4a1b-9943-8a44a706b768 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:05.030266 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-2a57091c-1799-4a1b-9943-8a44a706b768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:05.106344 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1339/2698] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:10:05.117443 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb27422-99ca-429e-a2bd-6d5295bdd81d admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:05.118920 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-1cb27422-99ca-429e-a2bd-6d5295bdd81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:05.211745 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb27422-99ca-429e-a2bd-6d5295bdd81d admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:05.217031 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6268193-6610-4b4b-9670-f6fd57e29c51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:05.218153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6268193-6610-4b4b-9670-f6fd57e29c51 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:05.218627 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6268193-6610-4b4b-9670-f6fd57e29c51 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:05.219088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6268193-6610-4b4b-9670-f6fd57e29c51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:05.233853 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6268193-6610-4b4b-9670-f6fd57e29c51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:05.235809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6268193-6610-4b4b-9670-f6fd57e29c51 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:05.246885 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1360/2699] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:10:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:10:05.845657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57091c-1799-4a1b-9943-8a44a706b768 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:05.847134 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-2a57091c-1799-4a1b-9943-8a44a706b768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:05.867694 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57091c-1799-4a1b-9943-8a44a706b768 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:05.873359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258e5ae-c789-40c5-af01-42de25cce721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:05.874010 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258e5ae-c789-40c5-af01-42de25cce721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:05.874291 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258e5ae-c789-40c5-af01-42de25cce721 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:05.874580 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258e5ae-c789-40c5-af01-42de25cce721 admin admin] PATH_INFO: `/v3/projects/8292cfdf0ae84d7a994270852f61b1bd` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:05.875961 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258e5ae-c789-40c5-af01-42de25cce721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8292cfdf0ae84d7a994270852f61b1bd)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:05.881247 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258e5ae-c789-40c5-af01-42de25cce721 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:06.036827 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f258e5ae-c789-40c5-af01-42de25cce721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8292cfdf0ae84d7a994270852f61b1bd', 'request_id': 'req-f258e5ae-c789-40c5-af01-42de25cce721'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:06.043709 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f258e5ae-c789-40c5-af01-42de25cce721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8292cfdf0ae84d7a994270852f61b1bd', 'request_id': 'req-f258e5ae-c789-40c5-af01-42de25cce721'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:06.052689 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:06.057675 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f258e5ae-c789-40c5-af01-42de25cce721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8292cfdf0ae84d7a994270852f61b1bd', 'request_id': 'req-f258e5ae-c789-40c5-af01-42de25cce721'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:06.204605 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f258e5ae-c789-40c5-af01-42de25cce721 admin admin] The token cache is being invalidate because project 8292cfdf0ae84d7a994270852f61b1bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:10:06.204883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f258e5ae-c789-40c5-af01-42de25cce721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:06.205659 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-f258e5ae-c789-40c5-af01-42de25cce721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:06.207372 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1340/2700] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:10:05 2022] DELETE /identity/v3/projects/8292cfdf0ae84d7a994270852f61b1bd => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:10:06.211839 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6268193-6610-4b4b-9670-f6fd57e29c51 service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:06.224507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6268193-6610-4b4b-9670-f6fd57e29c51 service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:06.288343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c233d5a-14ea-4ea2-a6c0-46334de12680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:06.289003 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c233d5a-14ea-4ea2-a6c0-46334de12680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:06.289283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c233d5a-14ea-4ea2-a6c0-46334de12680 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:06.289559 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c233d5a-14ea-4ea2-a6c0-46334de12680 admin admin] PATH_INFO: `/v3/users/236c50b3ed6d4bc1a6f4d44b55423f11` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:06.290748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c233d5a-14ea-4ea2-a6c0-46334de12680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=236c50b3ed6d4bc1a6f4d44b55423f11)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:06.292708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c233d5a-14ea-4ea2-a6c0-46334de12680 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:06.519505 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:06.534976 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1c233d5a-14ea-4ea2-a6c0-46334de12680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236c50b3ed6d4bc1a6f4d44b55423f11'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:06.535808 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1c233d5a-14ea-4ea2-a6c0-46334de12680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236c50b3ed6d4bc1a6f4d44b55423f11'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:06.724085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1c233d5a-14ea-4ea2-a6c0-46334de12680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236c50b3ed6d4bc1a6f4d44b55423f11'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:06.738088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1c233d5a-14ea-4ea2-a6c0-46334de12680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236c50b3ed6d4bc1a6f4d44b55423f11'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:06.747168 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-1c233d5a-14ea-4ea2-a6c0-46334de12680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236c50b3ed6d4bc1a6f4d44b55423f11'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:06.754527 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1361/2701] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:10:06 2022] DELETE /identity/v3/users/236c50b3ed6d4bc1a6f4d44b55423f11 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:10:07.412603 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258e5ae-c789-40c5-af01-42de25cce721 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:07.417731 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f258e5ae-c789-40c5-af01-42de25cce721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:07.432458 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258e5ae-c789-40c5-af01-42de25cce721 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:07.496314 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e336fc-83b5-4e1f-a847-dbdee5f8db0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:07.505866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e336fc-83b5-4e1f-a847-dbdee5f8db0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:07.505866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e336fc-83b5-4e1f-a847-dbdee5f8db0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:07.505866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e336fc-83b5-4e1f-a847-dbdee5f8db0e admin admin] PATH_INFO: `/v3/projects/105f5e2e8dd945718043c0fa3b95ac7b` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:07.505866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e336fc-83b5-4e1f-a847-dbdee5f8db0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=105f5e2e8dd945718043c0fa3b95ac7b)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:07.505866 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e336fc-83b5-4e1f-a847-dbdee5f8db0e admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:07.723642 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-90e336fc-83b5-4e1f-a847-dbdee5f8db0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105f5e2e8dd945718043c0fa3b95ac7b', 'request_id': 'req-90e336fc-83b5-4e1f-a847-dbdee5f8db0e'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:07.732692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-90e336fc-83b5-4e1f-a847-dbdee5f8db0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105f5e2e8dd945718043c0fa3b95ac7b', 'request_id': 'req-90e336fc-83b5-4e1f-a847-dbdee5f8db0e'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:07.739111 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-90e336fc-83b5-4e1f-a847-dbdee5f8db0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105f5e2e8dd945718043c0fa3b95ac7b', 'request_id': 'req-90e336fc-83b5-4e1f-a847-dbdee5f8db0e'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:07.870542 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-90e336fc-83b5-4e1f-a847-dbdee5f8db0e admin admin] The token cache is being invalidate because project 105f5e2e8dd945718043c0fa3b95ac7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:10:07.871027 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-90e336fc-83b5-4e1f-a847-dbdee5f8db0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:07.872039 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-90e336fc-83b5-4e1f-a847-dbdee5f8db0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:07.875640 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1341/2702] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:10:07 2022] DELETE /identity/v3/projects/105f5e2e8dd945718043c0fa3b95ac7b => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:10:07.882492 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a093f-6a22-416b-9aa9-a31a5af91227 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:07.883289 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a093f-6a22-416b-9aa9-a31a5af91227 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:07.883880 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a093f-6a22-416b-9aa9-a31a5af91227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:07.946055 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-229a093f-6a22-416b-9aa9-a31a5af91227 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:07.947220 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-229a093f-6a22-416b-9aa9-a31a5af91227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:08.014985 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1362/2703] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:10:08.023611 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85bacf-fc4a-4299-a6a2-f8c1678dc882 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:08.023896 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85bacf-fc4a-4299-a6a2-f8c1678dc882 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:08.024175 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85bacf-fc4a-4299-a6a2-f8c1678dc882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:08.046066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-ac85bacf-fc4a-4299-a6a2-f8c1678dc882 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:08.047309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-ac85bacf-fc4a-4299-a6a2-f8c1678dc882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:08.057610 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1342/2704] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:10:08.064489 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a093f-6a22-416b-9aa9-a31a5af91227 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:08.083404 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a093f-6a22-416b-9aa9-a31a5af91227 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:08.090620 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00843a-d968-44d8-89bc-a0a06ed2a7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:08.091638 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00843a-d968-44d8-89bc-a0a06ed2a7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:08.092196 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00843a-d968-44d8-89bc-a0a06ed2a7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:08.092767 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00843a-d968-44d8-89bc-a0a06ed2a7d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:08.093759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00843a-d968-44d8-89bc-a0a06ed2a7d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86895) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:10:08.094174 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00843a-d968-44d8-89bc-a0a06ed2a7d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:08.096027 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00843a-d968-44d8-89bc-a0a06ed2a7d0 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:08.110503 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1363/2705] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:10:08.116900 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85bacf-fc4a-4299-a6a2-f8c1678dc882 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:08.128301 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85bacf-fc4a-4299-a6a2-f8c1678dc882 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:08.134254 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a171da9-c933-40a7-a96a-7e22d2c3d366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:08.134878 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a171da9-c933-40a7-a96a-7e22d2c3d366 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:08.135161 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a171da9-c933-40a7-a96a-7e22d2c3d366 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:08.135463 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a171da9-c933-40a7-a96a-7e22d2c3d366 admin admin] PATH_INFO: `/v3/projects` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:08.136144 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a171da9-c933-40a7-a96a-7e22d2c3d366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:08.138133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a171da9-c933-40a7-a96a-7e22d2c3d366 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:08.264543 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1343/2706] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:10:08 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:10:08.265761 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00843a-d968-44d8-89bc-a0a06ed2a7d0 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:08.276969 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00843a-d968-44d8-89bc-a0a06ed2a7d0 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:08.357473 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18377cbf-475d-4403-bfb5-a9749f321244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:08.357961 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18377cbf-475d-4403-bfb5-a9749f321244 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:08.358240 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18377cbf-475d-4403-bfb5-a9749f321244 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:08.358517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18377cbf-475d-4403-bfb5-a9749f321244 admin admin] PATH_INFO: `/v3/users` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:08.359197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18377cbf-475d-4403-bfb5-a9749f321244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:08.361197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18377cbf-475d-4403-bfb5-a9749f321244 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:08.457053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:08.463534 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1364/2707] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:10:08 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:10:08.470860 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a171da9-c933-40a7-a96a-7e22d2c3d366 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:08.489496 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a171da9-c933-40a7-a96a-7e22d2c3d366 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:08.496636 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f56c88-b332-4404-9b47-3d84b1a1e5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:08.497330 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f56c88-b332-4404-9b47-3d84b1a1e5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:08.497617 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f56c88-b332-4404-9b47-3d84b1a1e5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:08.497895 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f56c88-b332-4404-9b47-3d84b1a1e5e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:08.499053 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f56c88-b332-4404-9b47-3d84b1a1e5e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:08.500040 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18377cbf-475d-4403-bfb5-a9749f321244 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:08.500767 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f56c88-b332-4404-9b47-3d84b1a1e5e4 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:08.501842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-18377cbf-475d-4403-bfb5-a9749f321244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:08.512512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1344/2708] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:10:08.517145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18377cbf-475d-4403-bfb5-a9749f321244 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:08.517346 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f56c88-b332-4404-9b47-3d84b1a1e5e4 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:08.522253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60210ce5-637d-4282-aae4-b1e80370017a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:08.523185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60210ce5-637d-4282-aae4-b1e80370017a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:08.523506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60210ce5-637d-4282-aae4-b1e80370017a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:08.524441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60210ce5-637d-4282-aae4-b1e80370017a admin admin] PATH_INFO: `/v3/users/03e559bd986248e395b7b0f0f8676887` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:08.525771 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60210ce5-637d-4282-aae4-b1e80370017a admin admin] RBAC: Authorizing `identity:delete_user(user_id=03e559bd986248e395b7b0f0f8676887)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:08.527767 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60210ce5-637d-4282-aae4-b1e80370017a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:08.527943 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f56c88-b332-4404-9b47-3d84b1a1e5e4 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:08.533680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbbaef-c6b7-42e4-88b4-1b6b6903b96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:08.534318 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbbaef-c6b7-42e4-88b4-1b6b6903b96f admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:08.534725 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbbaef-c6b7-42e4-88b4-1b6b6903b96f admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:08.534877 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbbaef-c6b7-42e4-88b4-1b6b6903b96f admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:08.535694 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbbaef-c6b7-42e4-88b4-1b6b6903b96f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:08.537322 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbbaef-c6b7-42e4-88b4-1b6b6903b96f admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:08.552550 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1345/2709] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:10:08.557408 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbbaef-c6b7-42e4-88b4-1b6b6903b96f admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:08.575515 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbbaef-c6b7-42e4-88b4-1b6b6903b96f admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:08.582856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d303dbe-3af5-42cb-b32b-a0555b856e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:08.584241 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d303dbe-3af5-42cb-b32b-a0555b856e6d admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:08.584803 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d303dbe-3af5-42cb-b32b-a0555b856e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:08.585312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d303dbe-3af5-42cb-b32b-a0555b856e6d admin admin] PATH_INFO: `/v3/projects/9cacd4ddabab4676b49c197e41d1df43/users/0c43a6081cc140c5800665e338069572/roles/43f173da338d498382fba44911238254` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:08.603500 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d303dbe-3af5-42cb-b32b-a0555b856e6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cacd4ddabab4676b49c197e41d1df43, user_id=0c43a6081cc140c5800665e338069572, role_id=43f173da338d498382fba44911238254)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:08.606312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d303dbe-3af5-42cb-b32b-a0555b856e6d admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:08.696169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1346/2710] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:10:08 2022] PUT /identity/v3/projects/9cacd4ddabab4676b49c197e41d1df43/users/0c43a6081cc140c5800665e338069572/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:10:08.708453 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4469033-edc4-4efa-a5ae-9e155275e95d None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:08.708753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4469033-edc4-4efa-a5ae-9e155275e95d None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:08.709068 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4469033-edc4-4efa-a5ae-9e155275e95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:08.717459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:08.741404 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-f4469033-edc4-4efa-a5ae-9e155275e95d None None] MFA Rules not processed for user `0c43a6081cc140c5800665e338069572`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:08.742822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f4469033-edc4-4efa-a5ae-9e155275e95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:08.773335 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-60210ce5-637d-4282-aae4-b1e80370017a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03e559bd986248e395b7b0f0f8676887'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:08.774018 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-60210ce5-637d-4282-aae4-b1e80370017a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03e559bd986248e395b7b0f0f8676887'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:08.820819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1347/2711] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:10:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:10:08.837437 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4469033-edc4-4efa-a5ae-9e155275e95d None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:08.839403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f4469033-edc4-4efa-a5ae-9e155275e95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:08.855687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-60210ce5-637d-4282-aae4-b1e80370017a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03e559bd986248e395b7b0f0f8676887'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:08.876831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-60210ce5-637d-4282-aae4-b1e80370017a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03e559bd986248e395b7b0f0f8676887'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:08.885494 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-60210ce5-637d-4282-aae4-b1e80370017a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03e559bd986248e395b7b0f0f8676887'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:08.895009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1365/2712] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:10:08 2022] DELETE /identity/v3/users/03e559bd986248e395b7b0f0f8676887 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:10:08.899603 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3bf51-e65e-4741-9d58-e029ef147bf3 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:08.899926 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3bf51-e65e-4741-9d58-e029ef147bf3 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:08.900190 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3bf51-e65e-4741-9d58-e029ef147bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:08.921799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-f3e3bf51-e65e-4741-9d58-e029ef147bf3 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:08.923048 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f3e3bf51-e65e-4741-9d58-e029ef147bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:08.964537 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4469033-edc4-4efa-a5ae-9e155275e95d None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:09.035370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1366/2713] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:10:09.043899 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3bf51-e65e-4741-9d58-e029ef147bf3 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:09.045694 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f3e3bf51-e65e-4741-9d58-e029ef147bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:09.062327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1437a-d178-4e81-b8c7-6fcccbc93f2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:09.063267 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1437a-d178-4e81-b8c7-6fcccbc93f2b service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:09.063818 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1437a-d178-4e81-b8c7-6fcccbc93f2b service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:09.064289 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1437a-d178-4e81-b8c7-6fcccbc93f2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:09.067066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0ee1437a-d178-4e81-b8c7-6fcccbc93f2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:09.123866 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3bf51-e65e-4741-9d58-e029ef147bf3 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:09.128004 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cf353-04ff-4dc1-92e7-b059ce5d673e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:09.128671 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cf353-04ff-4dc1-92e7-b059ce5d673e service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:09.129222 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cf353-04ff-4dc1-92e7-b059ce5d673e service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:09.129498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cf353-04ff-4dc1-92e7-b059ce5d673e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:09.143747 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cf353-04ff-4dc1-92e7-b059ce5d673e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:09.146102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cf353-04ff-4dc1-92e7-b059ce5d673e service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:09.162175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1367/2714] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:10:09.173318 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1437a-d178-4e81-b8c7-6fcccbc93f2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:09.175111 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1437a-d178-4e81-b8c7-6fcccbc93f2b service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:09.188822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1348/2715] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:10:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 04:10:09.778270 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cf353-04ff-4dc1-92e7-b059ce5d673e service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:09.780274 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c72cf353-04ff-4dc1-92e7-b059ce5d673e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:09.804942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cf353-04ff-4dc1-92e7-b059ce5d673e service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:09.814877 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495449e-0e56-409f-8ec9-e3ed8328b9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:09.816021 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495449e-0e56-409f-8ec9-e3ed8328b9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:09.816626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495449e-0e56-409f-8ec9-e3ed8328b9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:09.817327 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495449e-0e56-409f-8ec9-e3ed8328b9b3 admin admin] PATH_INFO: `/v3/projects/48c47397b2f54097ab60ee29b920423a` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:09.819837 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495449e-0e56-409f-8ec9-e3ed8328b9b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48c47397b2f54097ab60ee29b920423a)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:09.824045 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495449e-0e56-409f-8ec9-e3ed8328b9b3 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:09.839531 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:09.979942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-3495449e-0e56-409f-8ec9-e3ed8328b9b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48c47397b2f54097ab60ee29b920423a', 'request_id': 'req-3495449e-0e56-409f-8ec9-e3ed8328b9b3'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:10.049881 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-3495449e-0e56-409f-8ec9-e3ed8328b9b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48c47397b2f54097ab60ee29b920423a', 'request_id': 'req-3495449e-0e56-409f-8ec9-e3ed8328b9b3'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:10.063114 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-3495449e-0e56-409f-8ec9-e3ed8328b9b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48c47397b2f54097ab60ee29b920423a', 'request_id': 'req-3495449e-0e56-409f-8ec9-e3ed8328b9b3'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:10.076682 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-3495449e-0e56-409f-8ec9-e3ed8328b9b3 admin admin] The token cache is being invalidate because project 48c47397b2f54097ab60ee29b920423a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:10:10.076928 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-3495449e-0e56-409f-8ec9-e3ed8328b9b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:10.077640 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-3495449e-0e56-409f-8ec9-e3ed8328b9b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:10.079242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1368/2716] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:10:09 2022] DELETE /identity/v3/projects/48c47397b2f54097ab60ee29b920423a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:10:16.753684 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1437a-d178-4e81-b8c7-6fcccbc93f2b service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:16.756359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-0ee1437a-d178-4e81-b8c7-6fcccbc93f2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:16.768193 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=100 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:16.780323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1437a-d178-4e81-b8c7-6fcccbc93f2b service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:16.859900 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f04c8-0a23-4922-9830-a5bab4c17ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:16.860959 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f04c8-0a23-4922-9830-a5bab4c17ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:16.861443 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f04c8-0a23-4922-9830-a5bab4c17ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:16.862993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f04c8-0a23-4922-9830-a5bab4c17ab5 admin admin] PATH_INFO: `/v3/users/0c43a6081cc140c5800665e338069572` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:16.867044 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f04c8-0a23-4922-9830-a5bab4c17ab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c43a6081cc140c5800665e338069572)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:16.871039 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f04c8-0a23-4922-9830-a5bab4c17ab5 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:17.083457 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-312f04c8-0a23-4922-9830-a5bab4c17ab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c43a6081cc140c5800665e338069572'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:17.084220 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-312f04c8-0a23-4922-9830-a5bab4c17ab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c43a6081cc140c5800665e338069572'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:17.164074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-312f04c8-0a23-4922-9830-a5bab4c17ab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c43a6081cc140c5800665e338069572'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:17.172757 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-312f04c8-0a23-4922-9830-a5bab4c17ab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c43a6081cc140c5800665e338069572'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:17.186911 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-312f04c8-0a23-4922-9830-a5bab4c17ab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c43a6081cc140c5800665e338069572'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:17.193509 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1349/2717] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:10:16 2022] DELETE /identity/v3/users/0c43a6081cc140c5800665e338069572 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:10:17.198319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9a804-0c35-490e-a68d-a532dcd65756 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:17.199216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9a804-0c35-490e-a68d-a532dcd65756 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:17.199216 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9a804-0c35-490e-a68d-a532dcd65756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:17.223814 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-56b9a804-0c35-490e-a68d-a532dcd65756 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:17.225033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-56b9a804-0c35-490e-a68d-a532dcd65756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:17.301996 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1369/2718] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:10:17.312444 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f04c8-0a23-4922-9830-a5bab4c17ab5 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:17.316793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-312f04c8-0a23-4922-9830-a5bab4c17ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:17.386143 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f04c8-0a23-4922-9830-a5bab4c17ab5 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:17.391895 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e0b98-cef6-4999-91c4-bb239e9a9cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:17.392616 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e0b98-cef6-4999-91c4-bb239e9a9cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:17.393079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e0b98-cef6-4999-91c4-bb239e9a9cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:17.393457 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e0b98-cef6-4999-91c4-bb239e9a9cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:17.404719 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e0b98-cef6-4999-91c4-bb239e9a9cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:17.406295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e0b98-cef6-4999-91c4-bb239e9a9cf2 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:17.417403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1350/2719] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:10:17.850346 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9a804-0c35-490e-a68d-a532dcd65756 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:17.851972 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-56b9a804-0c35-490e-a68d-a532dcd65756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:17.867917 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9a804-0c35-490e-a68d-a532dcd65756 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:17.874899 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856519b-bc70-463e-ba13-dd002d8f9648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:17.875872 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856519b-bc70-463e-ba13-dd002d8f9648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:17.876191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856519b-bc70-463e-ba13-dd002d8f9648 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:17.876531 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856519b-bc70-463e-ba13-dd002d8f9648 admin admin] PATH_INFO: `/v3/projects/9cacd4ddabab4676b49c197e41d1df43` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:17.877699 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856519b-bc70-463e-ba13-dd002d8f9648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cacd4ddabab4676b49c197e41d1df43)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:17.879936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856519b-bc70-463e-ba13-dd002d8f9648 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:17.995210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6856519b-bc70-463e-ba13-dd002d8f9648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cacd4ddabab4676b49c197e41d1df43', 'request_id': 'req-6856519b-bc70-463e-ba13-dd002d8f9648'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:18.064913 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6856519b-bc70-463e-ba13-dd002d8f9648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cacd4ddabab4676b49c197e41d1df43', 'request_id': 'req-6856519b-bc70-463e-ba13-dd002d8f9648'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:18.071807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6856519b-bc70-463e-ba13-dd002d8f9648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cacd4ddabab4676b49c197e41d1df43', 'request_id': 'req-6856519b-bc70-463e-ba13-dd002d8f9648'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:18.084735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6856519b-bc70-463e-ba13-dd002d8f9648 admin admin] The token cache is being invalidate because project 9cacd4ddabab4676b49c197e41d1df43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:10:18.084985 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6856519b-bc70-463e-ba13-dd002d8f9648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:18.085839 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-6856519b-bc70-463e-ba13-dd002d8f9648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:18.088467 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1370/2720] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:10:17 2022] DELETE /identity/v3/projects/9cacd4ddabab4676b49c197e41d1df43 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:10:18.094619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573cb69-4c96-48a5-8ba3-24486972744c None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:18.095163 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573cb69-4c96-48a5-8ba3-24486972744c None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:18.095163 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573cb69-4c96-48a5-8ba3-24486972744c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:18.116792 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-f573cb69-4c96-48a5-8ba3-24486972744c None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:18.118037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-f573cb69-4c96-48a5-8ba3-24486972744c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:18.139630 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:18.183790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1351/2721] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:10:18.192571 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f12a74-359f-4f1c-a436-c8f7f5d0be84 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:18.192861 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f12a74-359f-4f1c-a436-c8f7f5d0be84 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:18.193144 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f12a74-359f-4f1c-a436-c8f7f5d0be84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:18.214313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-e2f12a74-359f-4f1c-a436-c8f7f5d0be84 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:18.215599 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e2f12a74-359f-4f1c-a436-c8f7f5d0be84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:18.223872 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1371/2722] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:10:18.228235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573cb69-4c96-48a5-8ba3-24486972744c None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:18.238772 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573cb69-4c96-48a5-8ba3-24486972744c None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:18.243528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d86aa8-73bd-4824-9b96-6d674c9ef6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:18.244151 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d86aa8-73bd-4824-9b96-6d674c9ef6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:18.244441 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d86aa8-73bd-4824-9b96-6d674c9ef6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:18.244721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d86aa8-73bd-4824-9b96-6d674c9ef6e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:18.245429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d86aa8-73bd-4824-9b96-6d674c9ef6e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:10:18.245735 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d86aa8-73bd-4824-9b96-6d674c9ef6e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:18.248044 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d86aa8-73bd-4824-9b96-6d674c9ef6e8 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:18.260687 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1352/2723] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:10:18.265949 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f12a74-359f-4f1c-a436-c8f7f5d0be84 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:18.276181 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f12a74-359f-4f1c-a436-c8f7f5d0be84 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:18.282086 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91001f93-9a2d-4fab-8990-683b67e1d59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:18.282836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91001f93-9a2d-4fab-8990-683b67e1d59b admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:18.283155 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91001f93-9a2d-4fab-8990-683b67e1d59b admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:18.283604 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91001f93-9a2d-4fab-8990-683b67e1d59b admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:18.284320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91001f93-9a2d-4fab-8990-683b67e1d59b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:18.287157 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91001f93-9a2d-4fab-8990-683b67e1d59b admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:18.304868 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:18.393266 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1372/2724] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:10:18 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:10:18.397790 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d86aa8-73bd-4824-9b96-6d674c9ef6e8 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:18.409080 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d86aa8-73bd-4824-9b96-6d674c9ef6e8 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:18.479747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95676e70-f238-45d8-9389-5feab561e3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:18.480294 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95676e70-f238-45d8-9389-5feab561e3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:18.480575 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95676e70-f238-45d8-9389-5feab561e3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:18.480847 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95676e70-f238-45d8-9389-5feab561e3c5 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:18.482095 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95676e70-f238-45d8-9389-5feab561e3c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:18.485079 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95676e70-f238-45d8-9389-5feab561e3c5 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:18.604512 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1353/2725] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:10:18 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:10:18.609729 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91001f93-9a2d-4fab-8990-683b67e1d59b admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:18.620319 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91001f93-9a2d-4fab-8990-683b67e1d59b admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:18.627675 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b33c7-ca51-4b46-b22b-4ebeb2897cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:18.628302 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b33c7-ca51-4b46-b22b-4ebeb2897cde admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:18.628577 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b33c7-ca51-4b46-b22b-4ebeb2897cde admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:18.629108 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b33c7-ca51-4b46-b22b-4ebeb2897cde admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:18.629804 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b33c7-ca51-4b46-b22b-4ebeb2897cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:18.631437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b33c7-ca51-4b46-b22b-4ebeb2897cde admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:18.642420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1373/2726] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:10:18.646504 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95676e70-f238-45d8-9389-5feab561e3c5 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:18.658148 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95676e70-f238-45d8-9389-5feab561e3c5 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:18.662919 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb4cc6-0c4b-4b10-ab81-52c41411b74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:18.663595 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb4cc6-0c4b-4b10-ab81-52c41411b74c admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:18.663885 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb4cc6-0c4b-4b10-ab81-52c41411b74c admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:18.664167 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb4cc6-0c4b-4b10-ab81-52c41411b74c admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:18.664888 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb4cc6-0c4b-4b10-ab81-52c41411b74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:18.666535 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb4cc6-0c4b-4b10-ab81-52c41411b74c admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:18.681446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1354/2727] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:10:18.687179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b33c7-ca51-4b46-b22b-4ebeb2897cde admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:18.699748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b33c7-ca51-4b46-b22b-4ebeb2897cde admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:18.703705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e529c0-5e11-4cbc-9cf1-eb73bb16d6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:18.704395 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e529c0-5e11-4cbc-9cf1-eb73bb16d6d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:18.704679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e529c0-5e11-4cbc-9cf1-eb73bb16d6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:18.704954 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e529c0-5e11-4cbc-9cf1-eb73bb16d6d1 admin admin] PATH_INFO: `/v3/projects/828c3994e0774fe78a1209d29055cec0/users/fdc4c03b85e742bfbb1b20080f8d7a60/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:18.720883 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e529c0-5e11-4cbc-9cf1-eb73bb16d6d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=828c3994e0774fe78a1209d29055cec0, user_id=fdc4c03b85e742bfbb1b20080f8d7a60, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:18.724076 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e529c0-5e11-4cbc-9cf1-eb73bb16d6d1 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:18.821408 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1374/2728] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:10:18 2022] PUT /identity/v3/projects/828c3994e0774fe78a1209d29055cec0/users/fdc4c03b85e742bfbb1b20080f8d7a60/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:10:18.833448 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080934fc-812d-449f-838c-46e83af7d643 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:18.833762 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080934fc-812d-449f-838c-46e83af7d643 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:18.833981 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080934fc-812d-449f-838c-46e83af7d643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:18.870480 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-080934fc-812d-449f-838c-46e83af7d643 None None] MFA Rules not processed for user `fdc4c03b85e742bfbb1b20080f8d7a60`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:18.871764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-080934fc-812d-449f-838c-46e83af7d643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:18.941172 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1355/2729] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:10:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:10:18.954044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e529c0-5e11-4cbc-9cf1-eb73bb16d6d1 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:18.955923 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c7e529c0-5e11-4cbc-9cf1-eb73bb16d6d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:19.019996 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e529c0-5e11-4cbc-9cf1-eb73bb16d6d1 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:19.023710 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56973a84-9222-47d4-bf0c-c595c1d4921e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:19.024365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56973a84-9222-47d4-bf0c-c595c1d4921e service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:19.024644 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56973a84-9222-47d4-bf0c-c595c1d4921e service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:19.024916 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56973a84-9222-47d4-bf0c-c595c1d4921e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:19.035466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56973a84-9222-47d4-bf0c-c595c1d4921e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:19.036987 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56973a84-9222-47d4-bf0c-c595c1d4921e service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:19.047227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1375/2730] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:10:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:10:28.937950 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:29.042254 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:INSERT=2,keystone:SELECT=43 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:34.756316 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080934fc-812d-449f-838c-46e83af7d643 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:34.820060 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080934fc-812d-449f-838c-46e83af7d643 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:34.824537 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ec0d9-bd5e-4c74-ac83-6b08daac4a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:34.825208 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ec0d9-bd5e-4c74-ac83-6b08daac4a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:34.825492 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ec0d9-bd5e-4c74-ac83-6b08daac4a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:34.825769 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ec0d9-bd5e-4c74-ac83-6b08daac4a05 admin admin] PATH_INFO: `/v3/users/fdc4c03b85e742bfbb1b20080f8d7a60` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:34.827615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ec0d9-bd5e-4c74-ac83-6b08daac4a05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc4c03b85e742bfbb1b20080f8d7a60)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:34.829547 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ec0d9-bd5e-4c74-ac83-6b08daac4a05 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:35.001133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-888ec0d9-bd5e-4c74-ac83-6b08daac4a05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc4c03b85e742bfbb1b20080f8d7a60'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:35.001751 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-888ec0d9-bd5e-4c74-ac83-6b08daac4a05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc4c03b85e742bfbb1b20080f8d7a60'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:35.083560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-888ec0d9-bd5e-4c74-ac83-6b08daac4a05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc4c03b85e742bfbb1b20080f8d7a60'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:35.091221 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-888ec0d9-bd5e-4c74-ac83-6b08daac4a05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc4c03b85e742bfbb1b20080f8d7a60'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:35.103741 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-888ec0d9-bd5e-4c74-ac83-6b08daac4a05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc4c03b85e742bfbb1b20080f8d7a60'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:35.110762 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1356/2731] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:10:34 2022] DELETE /identity/v3/users/fdc4c03b85e742bfbb1b20080f8d7a60 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:10:35.115851 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177999e-b6e6-4bdc-ad8e-f941dcc05637 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:35.116370 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177999e-b6e6-4bdc-ad8e-f941dcc05637 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:35.116482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177999e-b6e6-4bdc-ad8e-f941dcc05637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:35.136596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-6177999e-b6e6-4bdc-ad8e-f941dcc05637 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:35.137823 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-6177999e-b6e6-4bdc-ad8e-f941dcc05637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:35.197193 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1376/2732] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:10:35.208184 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ec0d9-bd5e-4c74-ac83-6b08daac4a05 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:35.209873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-888ec0d9-bd5e-4c74-ac83-6b08daac4a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:35.295922 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ec0d9-bd5e-4c74-ac83-6b08daac4a05 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:35.300232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc02d6e-da7a-404d-a9f3-d84d727deb62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:35.300232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc02d6e-da7a-404d-a9f3-d84d727deb62 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:35.300992 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc02d6e-da7a-404d-a9f3-d84d727deb62 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:35.301379 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc02d6e-da7a-404d-a9f3-d84d727deb62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:35.316095 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc02d6e-da7a-404d-a9f3-d84d727deb62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:35.317554 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc02d6e-da7a-404d-a9f3-d84d727deb62 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:35.329733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1357/2733] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:10:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:10:35.753897 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177999e-b6e6-4bdc-ad8e-f941dcc05637 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:35.757812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-6177999e-b6e6-4bdc-ad8e-f941dcc05637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:35.769090 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177999e-b6e6-4bdc-ad8e-f941dcc05637 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:35.774620 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36c674-9104-4612-8829-43d00821622a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:35.776680 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36c674-9104-4612-8829-43d00821622a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:35.777033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36c674-9104-4612-8829-43d00821622a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:35.777271 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36c674-9104-4612-8829-43d00821622a admin admin] PATH_INFO: `/v3/projects/828c3994e0774fe78a1209d29055cec0` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:35.778628 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36c674-9104-4612-8829-43d00821622a admin admin] RBAC: Authorizing `identity:delete_project(project_id=828c3994e0774fe78a1209d29055cec0)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:35.781591 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36c674-9104-4612-8829-43d00821622a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:35.891030 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ef36c674-9104-4612-8829-43d00821622a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '828c3994e0774fe78a1209d29055cec0', 'request_id': 'req-ef36c674-9104-4612-8829-43d00821622a'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:35.952233 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ef36c674-9104-4612-8829-43d00821622a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '828c3994e0774fe78a1209d29055cec0', 'request_id': 'req-ef36c674-9104-4612-8829-43d00821622a'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:35.958324 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ef36c674-9104-4612-8829-43d00821622a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '828c3994e0774fe78a1209d29055cec0', 'request_id': 'req-ef36c674-9104-4612-8829-43d00821622a'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:35.970839 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ef36c674-9104-4612-8829-43d00821622a admin admin] The token cache is being invalidate because project 828c3994e0774fe78a1209d29055cec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:10:35.971127 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ef36c674-9104-4612-8829-43d00821622a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:35.971887 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ef36c674-9104-4612-8829-43d00821622a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:35.973407 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1377/2734] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:10:35 2022] DELETE /identity/v3/projects/828c3994e0774fe78a1209d29055cec0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:10:35.978370 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c43f3-b9d6-4ed8-9e0b-5a6ffb5b102b None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:35.978848 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c43f3-b9d6-4ed8-9e0b-5a6ffb5b102b None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:35.978972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c43f3-b9d6-4ed8-9e0b-5a6ffb5b102b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:35.987015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:35.999099 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-437c43f3-b9d6-4ed8-9e0b-5a6ffb5b102b None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:36.000367 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-437c43f3-b9d6-4ed8-9e0b-5a6ffb5b102b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:36.064618 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1358/2735] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:10:36.072362 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b80ad-3551-4599-8e43-e1e7a36c0ca0 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:36.072650 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b80ad-3551-4599-8e43-e1e7a36c0ca0 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:36.072931 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b80ad-3551-4599-8e43-e1e7a36c0ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:36.093536 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-bd6b80ad-3551-4599-8e43-e1e7a36c0ca0 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:36.094763 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-bd6b80ad-3551-4599-8e43-e1e7a36c0ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:36.102872 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1378/2736] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:10:36.107232 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c43f3-b9d6-4ed8-9e0b-5a6ffb5b102b None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:36.117906 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c43f3-b9d6-4ed8-9e0b-5a6ffb5b102b None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:36.122537 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c8ef8-7e29-4b95-8a4b-a7a489ad79f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:36.123670 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c8ef8-7e29-4b95-8a4b-a7a489ad79f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:36.123983 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c8ef8-7e29-4b95-8a4b-a7a489ad79f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:36.124211 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c8ef8-7e29-4b95-8a4b-a7a489ad79f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:36.124898 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c8ef8-7e29-4b95-8a4b-a7a489ad79f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:10:36.125201 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c8ef8-7e29-4b95-8a4b-a7a489ad79f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:36.126795 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c8ef8-7e29-4b95-8a4b-a7a489ad79f4 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:36.139106 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1359/2737] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 04:10:36.143730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b80ad-3551-4599-8e43-e1e7a36c0ca0 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:36.152901 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b80ad-3551-4599-8e43-e1e7a36c0ca0 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:36.157845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a32f2b-8c6b-42d0-8a49-0fb0bb4c76de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:36.158458 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a32f2b-8c6b-42d0-8a49-0fb0bb4c76de admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:36.158739 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a32f2b-8c6b-42d0-8a49-0fb0bb4c76de admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:36.159014 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a32f2b-8c6b-42d0-8a49-0fb0bb4c76de admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:36.159714 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a32f2b-8c6b-42d0-8a49-0fb0bb4c76de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:36.161617 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a32f2b-8c6b-42d0-8a49-0fb0bb4c76de admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:36.296828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1379/2738] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:10:36 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:10:36.301373 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c8ef8-7e29-4b95-8a4b-a7a489ad79f4 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:36.312794 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c8ef8-7e29-4b95-8a4b-a7a489ad79f4 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:36.371191 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87453cd2-67a1-4289-82f5-2b3f8697b210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:36.371850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87453cd2-67a1-4289-82f5-2b3f8697b210 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:36.372125 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87453cd2-67a1-4289-82f5-2b3f8697b210 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:36.372406 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87453cd2-67a1-4289-82f5-2b3f8697b210 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:36.373731 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87453cd2-67a1-4289-82f5-2b3f8697b210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:36.375712 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87453cd2-67a1-4289-82f5-2b3f8697b210 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:36.460842 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1360/2739] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:10:36 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:10:36.465679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a32f2b-8c6b-42d0-8a49-0fb0bb4c76de admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:36.476497 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a32f2b-8c6b-42d0-8a49-0fb0bb4c76de admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:36.481278 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4eb019-d343-4a4c-a708-38bd290f6290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:36.481906 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eb019-d343-4a4c-a708-38bd290f6290 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:36.482187 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eb019-d343-4a4c-a708-38bd290f6290 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:36.483073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eb019-d343-4a4c-a708-38bd290f6290 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:36.483819 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4eb019-d343-4a4c-a708-38bd290f6290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:36.485431 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4eb019-d343-4a4c-a708-38bd290f6290 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:36.495978 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1380/2740] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:10:36.500907 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87453cd2-67a1-4289-82f5-2b3f8697b210 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:36.512137 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87453cd2-67a1-4289-82f5-2b3f8697b210 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:36.517341 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d8c98-19e6-41ca-8be7-51736e764b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:36.522289 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d8c98-19e6-41ca-8be7-51736e764b5c admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:36.522289 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d8c98-19e6-41ca-8be7-51736e764b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:36.522289 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d8c98-19e6-41ca-8be7-51736e764b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:36.522289 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d8c98-19e6-41ca-8be7-51736e764b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:36.522289 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d8c98-19e6-41ca-8be7-51736e764b5c admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:36.534429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1361/2741] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:10:36.538668 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4eb019-d343-4a4c-a708-38bd290f6290 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:36.554961 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4eb019-d343-4a4c-a708-38bd290f6290 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:36.559773 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227fb84-3290-487b-ba44-597e6771d30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:36.561295 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227fb84-3290-487b-ba44-597e6771d30c admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:36.561806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227fb84-3290-487b-ba44-597e6771d30c admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:36.562136 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227fb84-3290-487b-ba44-597e6771d30c admin admin] PATH_INFO: `/v3/projects/17ea47ee2baf48bba79a314bb798d9fc/users/7a7e5c8a260244308ca12d5789652bc8/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:36.578579 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227fb84-3290-487b-ba44-597e6771d30c admin admin] RBAC: Authorizing `identity:create_grant(project_id=17ea47ee2baf48bba79a314bb798d9fc, user_id=7a7e5c8a260244308ca12d5789652bc8, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:36.581305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227fb84-3290-487b-ba44-597e6771d30c admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:36.666627 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1381/2742] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:10:36 2022] PUT /identity/v3/projects/17ea47ee2baf48bba79a314bb798d9fc/users/7a7e5c8a260244308ca12d5789652bc8/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:10:36.677700 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a72f58-118f-45ad-9438-e971dc24928f None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:36.677990 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a72f58-118f-45ad-9438-e971dc24928f None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:36.678265 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a72f58-118f-45ad-9438-e971dc24928f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:36.707294 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-80a72f58-118f-45ad-9438-e971dc24928f None None] MFA Rules not processed for user `7a7e5c8a260244308ca12d5789652bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:36.708529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-80a72f58-118f-45ad-9438-e971dc24928f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:36.769641 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:36.775682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1362/2743] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:10:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:10:36.784886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227fb84-3290-487b-ba44-597e6771d30c admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:36.803113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:36.843941 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227fb84-3290-487b-ba44-597e6771d30c admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:36.848572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e3e29-2a04-47f7-99d2-e8eae79e7177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:36.849187 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e3e29-2a04-47f7-99d2-e8eae79e7177 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:36.849471 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e3e29-2a04-47f7-99d2-e8eae79e7177 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:36.849741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e3e29-2a04-47f7-99d2-e8eae79e7177 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:36.850393 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e3e29-2a04-47f7-99d2-e8eae79e7177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:36.852313 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e3e29-2a04-47f7-99d2-e8eae79e7177 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:36.945720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1382/2744] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:10:36 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:10:36.949909 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a72f58-118f-45ad-9438-e971dc24928f None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:36.960856 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a72f58-118f-45ad-9438-e971dc24928f None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:37.017546 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b597605-f99e-4360-b1bd-344dccfda7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:37.018259 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b597605-f99e-4360-b1bd-344dccfda7da admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:37.018439 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b597605-f99e-4360-b1bd-344dccfda7da admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:37.018713 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b597605-f99e-4360-b1bd-344dccfda7da admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:37.019416 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b597605-f99e-4360-b1bd-344dccfda7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:37.021384 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b597605-f99e-4360-b1bd-344dccfda7da admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:37.129996 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1363/2745] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:10:36 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:10:37.134176 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e3e29-2a04-47f7-99d2-e8eae79e7177 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:37.144702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e3e29-2a04-47f7-99d2-e8eae79e7177 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:37.149308 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366fe98-bbae-432d-a18a-a0b8ced99c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:37.149919 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366fe98-bbae-432d-a18a-a0b8ced99c56 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:37.150197 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366fe98-bbae-432d-a18a-a0b8ced99c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:37.150469 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366fe98-bbae-432d-a18a-a0b8ced99c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:37.151153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366fe98-bbae-432d-a18a-a0b8ced99c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:37.152782 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366fe98-bbae-432d-a18a-a0b8ced99c56 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:37.164061 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1383/2746] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:10:37.168160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b597605-f99e-4360-b1bd-344dccfda7da admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:37.179474 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b597605-f99e-4360-b1bd-344dccfda7da admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:37.184132 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fbd06-2fac-45d5-b426-df2f0283082d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:37.184761 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fbd06-2fac-45d5-b426-df2f0283082d admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:37.185044 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fbd06-2fac-45d5-b426-df2f0283082d admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:37.185322 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fbd06-2fac-45d5-b426-df2f0283082d admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:37.186282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fbd06-2fac-45d5-b426-df2f0283082d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:37.187915 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fbd06-2fac-45d5-b426-df2f0283082d admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:37.198341 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1364/2747] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:10:37.203296 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366fe98-bbae-432d-a18a-a0b8ced99c56 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:37.213651 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366fe98-bbae-432d-a18a-a0b8ced99c56 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:37.219046 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fa8ba-9fd8-4073-b761-ae3c167a0761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:37.219742 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fa8ba-9fd8-4073-b761-ae3c167a0761 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:37.220022 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fa8ba-9fd8-4073-b761-ae3c167a0761 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:37.220296 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fa8ba-9fd8-4073-b761-ae3c167a0761 admin admin] PATH_INFO: `/v3/projects/cc14b4b353ab42c59d795392375bfc1e/users/a5d474d54eb643b3abc5b1d663c3f1f1/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:37.235158 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fa8ba-9fd8-4073-b761-ae3c167a0761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc14b4b353ab42c59d795392375bfc1e, user_id=a5d474d54eb643b3abc5b1d663c3f1f1, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:37.237936 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fa8ba-9fd8-4073-b761-ae3c167a0761 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:37.306895 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1384/2748] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:10:37 2022] PUT /identity/v3/projects/cc14b4b353ab42c59d795392375bfc1e/users/a5d474d54eb643b3abc5b1d663c3f1f1/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:10:37.318783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ce5fa-d9f5-4268-a053-5bb1de89f00f None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:37.319074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ce5fa-d9f5-4268-a053-5bb1de89f00f None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:37.319388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ce5fa-d9f5-4268-a053-5bb1de89f00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:37.349312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-434ce5fa-d9f5-4268-a053-5bb1de89f00f None None] MFA Rules not processed for user `a5d474d54eb643b3abc5b1d663c3f1f1`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:37.350562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-434ce5fa-d9f5-4268-a053-5bb1de89f00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:37.418367 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1365/2749] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:10:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:10:37.422945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fa8ba-9fd8-4073-b761-ae3c167a0761 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:37.487151 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fa8ba-9fd8-4073-b761-ae3c167a0761 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:37.492184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32985da4-44a1-43bb-a527-7720f4c374fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:37.493416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32985da4-44a1-43bb-a527-7720f4c374fb admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:37.493416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32985da4-44a1-43bb-a527-7720f4c374fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:37.493416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32985da4-44a1-43bb-a527-7720f4c374fb admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:37.494099 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32985da4-44a1-43bb-a527-7720f4c374fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:37.496084 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32985da4-44a1-43bb-a527-7720f4c374fb admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:37.598234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1385/2750] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:10:37 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:10:37.602764 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ce5fa-d9f5-4268-a053-5bb1de89f00f None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:37.614306 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ce5fa-d9f5-4268-a053-5bb1de89f00f None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:37.672262 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3357f52-80ae-411d-a957-43afe13fdc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:37.672889 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3357f52-80ae-411d-a957-43afe13fdc24 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:37.673251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3357f52-80ae-411d-a957-43afe13fdc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:37.673608 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3357f52-80ae-411d-a957-43afe13fdc24 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:37.674327 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3357f52-80ae-411d-a957-43afe13fdc24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:37.676463 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3357f52-80ae-411d-a957-43afe13fdc24 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:37.687660 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:37.802692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1366/2751] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:10:37 2022] POST /identity/v3/users => generated 298 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:10:37.806920 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32985da4-44a1-43bb-a527-7720f4c374fb admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:37.817283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32985da4-44a1-43bb-a527-7720f4c374fb admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:37.821923 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41ecf8-14a0-4b1f-ac9b-7197277d7601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:37.822541 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41ecf8-14a0-4b1f-ac9b-7197277d7601 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:37.822867 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41ecf8-14a0-4b1f-ac9b-7197277d7601 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:37.823140 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41ecf8-14a0-4b1f-ac9b-7197277d7601 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:37.823869 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41ecf8-14a0-4b1f-ac9b-7197277d7601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:37.825481 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41ecf8-14a0-4b1f-ac9b-7197277d7601 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:37.836593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1386/2752] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:10:37.840869 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3357f52-80ae-411d-a957-43afe13fdc24 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:37.851783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3357f52-80ae-411d-a957-43afe13fdc24 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:37.856228 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a77f9e-f5dc-4890-ac96-88719d5701ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:37.856896 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a77f9e-f5dc-4890-ac96-88719d5701ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:37.857190 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a77f9e-f5dc-4890-ac96-88719d5701ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:37.857607 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a77f9e-f5dc-4890-ac96-88719d5701ca admin admin] PATH_INFO: `/v3/projects/e8680d12d6f347c4991f0be1fca90bb8/users/3bb21464a6734752bc6dbc8e38085e4d/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:37.874203 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a77f9e-f5dc-4890-ac96-88719d5701ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8680d12d6f347c4991f0be1fca90bb8, user_id=3bb21464a6734752bc6dbc8e38085e4d, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:37.876919 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a77f9e-f5dc-4890-ac96-88719d5701ca admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:37.968667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1367/2753] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:10:37 2022] PUT /identity/v3/projects/e8680d12d6f347c4991f0be1fca90bb8/users/3bb21464a6734752bc6dbc8e38085e4d/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:10:37.972862 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41ecf8-14a0-4b1f-ac9b-7197277d7601 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:37.984154 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41ecf8-14a0-4b1f-ac9b-7197277d7601 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:38.027824 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:38.042999 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908c3d9-feaf-4c99-a491-2db04ea187b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:38.046138 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908c3d9-feaf-4c99-a491-2db04ea187b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:38.046138 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908c3d9-feaf-4c99-a491-2db04ea187b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:38.046138 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908c3d9-feaf-4c99-a491-2db04ea187b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:38.046138 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908c3d9-feaf-4c99-a491-2db04ea187b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:38.046619 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908c3d9-feaf-4c99-a491-2db04ea187b5 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:38.056427 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1387/2754] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:10:38.060682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a77f9e-f5dc-4890-ac96-88719d5701ca admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:38.072887 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a77f9e-f5dc-4890-ac96-88719d5701ca admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:38.078706 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a7708-a97b-491e-8a78-336657f99914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:38.079443 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a7708-a97b-491e-8a78-336657f99914 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:38.079741 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a7708-a97b-491e-8a78-336657f99914 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:38.080010 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a7708-a97b-491e-8a78-336657f99914 admin admin] PATH_INFO: `/v3/projects/e8680d12d6f347c4991f0be1fca90bb8/users/3bb21464a6734752bc6dbc8e38085e4d/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:38.082015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a7708-a97b-491e-8a78-336657f99914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8680d12d6f347c4991f0be1fca90bb8, user_id=3bb21464a6734752bc6dbc8e38085e4d, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:38.084727 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a7708-a97b-491e-8a78-336657f99914 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:38.096572 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1368/2755] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:10:38 2022] PUT /identity/v3/projects/e8680d12d6f347c4991f0be1fca90bb8/users/3bb21464a6734752bc6dbc8e38085e4d/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:10:38.106919 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afbc5e-5f89-4445-8f9d-6a541a21e704 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:38.107228 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afbc5e-5f89-4445-8f9d-6a541a21e704 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:38.107575 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afbc5e-5f89-4445-8f9d-6a541a21e704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:38.135798 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-d4afbc5e-5f89-4445-8f9d-6a541a21e704 None None] MFA Rules not processed for user `3bb21464a6734752bc6dbc8e38085e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:38.137085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d4afbc5e-5f89-4445-8f9d-6a541a21e704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:38.205411 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1388/2756] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:10:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:10:38.217294 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a7708-a97b-491e-8a78-336657f99914 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:38.219066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-124a7708-a97b-491e-8a78-336657f99914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:38.297604 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a7708-a97b-491e-8a78-336657f99914 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:38.301257 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e1b9c-d79e-49a3-913d-9a9af5f44f80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:38.301875 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e1b9c-d79e-49a3-913d-9a9af5f44f80 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:38.302155 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e1b9c-d79e-49a3-913d-9a9af5f44f80 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:38.302430 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e1b9c-d79e-49a3-913d-9a9af5f44f80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:38.359667 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e1b9c-d79e-49a3-913d-9a9af5f44f80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:38.361038 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e1b9c-d79e-49a3-913d-9a9af5f44f80 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:38.369850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1369/2757] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:10:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:10:40.279452 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afbc5e-5f89-4445-8f9d-6a541a21e704 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:40.281518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-d4afbc5e-5f89-4445-8f9d-6a541a21e704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:40.293574 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afbc5e-5f89-4445-8f9d-6a541a21e704 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:40.297369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042c65e-7576-4718-8672-f60efe72d910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:40.297958 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042c65e-7576-4718-8672-f60efe72d910 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:40.298272 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042c65e-7576-4718-8672-f60efe72d910 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:40.298505 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042c65e-7576-4718-8672-f60efe72d910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:40.354450 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042c65e-7576-4718-8672-f60efe72d910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:40.355836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042c65e-7576-4718-8672-f60efe72d910 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:40.364734 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1389/2758] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:10:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:10:41.684948 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e1b9c-d79e-49a3-913d-9a9af5f44f80 service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:41.694220 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e1b9c-d79e-49a3-913d-9a9af5f44f80 service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:41.697803 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6332d05-dab1-4da0-85d1-b2bb82441999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:41.698413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6332d05-dab1-4da0-85d1-b2bb82441999 service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:41.698712 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6332d05-dab1-4da0-85d1-b2bb82441999 service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:41.698985 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6332d05-dab1-4da0-85d1-b2bb82441999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:41.708130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6332d05-dab1-4da0-85d1-b2bb82441999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:41.709542 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6332d05-dab1-4da0-85d1-b2bb82441999 service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:41.719020 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1370/2759] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:10:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:10:46.365660 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042c65e-7576-4718-8672-f60efe72d910 service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:46.435780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042c65e-7576-4718-8672-f60efe72d910 service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:46.441865 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d84d6f-dc31-4df0-9eac-66bc7c5a6cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:46.442019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d84d6f-dc31-4df0-9eac-66bc7c5a6cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:46.442345 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d84d6f-dc31-4df0-9eac-66bc7c5a6cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:46.442620 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d84d6f-dc31-4df0-9eac-66bc7c5a6cbf admin admin] PATH_INFO: `/v3/users/7a7e5c8a260244308ca12d5789652bc8` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:46.443844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d84d6f-dc31-4df0-9eac-66bc7c5a6cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a7e5c8a260244308ca12d5789652bc8)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:46.445786 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d84d6f-dc31-4df0-9eac-66bc7c5a6cbf admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:46.452416 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:46.633141 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-43d84d6f-dc31-4df0-9eac-66bc7c5a6cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a7e5c8a260244308ca12d5789652bc8'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:46.633816 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-43d84d6f-dc31-4df0-9eac-66bc7c5a6cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a7e5c8a260244308ca12d5789652bc8'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:46.715801 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-43d84d6f-dc31-4df0-9eac-66bc7c5a6cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a7e5c8a260244308ca12d5789652bc8'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:46.729581 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-43d84d6f-dc31-4df0-9eac-66bc7c5a6cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a7e5c8a260244308ca12d5789652bc8'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:46.737452 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-43d84d6f-dc31-4df0-9eac-66bc7c5a6cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a7e5c8a260244308ca12d5789652bc8'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:46.743972 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1390/2760] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:10:46 2022] DELETE /identity/v3/users/7a7e5c8a260244308ca12d5789652bc8 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:10:46.749063 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8668cf-a6c4-42e4-9bbf-670684e10845 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:46.752868 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8668cf-a6c4-42e4-9bbf-670684e10845 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:46.752868 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8668cf-a6c4-42e4-9bbf-670684e10845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:46.769692 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-cb8668cf-a6c4-42e4-9bbf-670684e10845 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:10:46.770931 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-cb8668cf-a6c4-42e4-9bbf-670684e10845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:46.807731 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:46.834809 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1371/2761] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:10:46.851189 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d84d6f-dc31-4df0-9eac-66bc7c5a6cbf admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:46.852652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-43d84d6f-dc31-4df0-9eac-66bc7c5a6cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:46.918748 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d84d6f-dc31-4df0-9eac-66bc7c5a6cbf admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:46.922717 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561235f3-24db-4c27-970b-503c2aa1b5c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:46.923519 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561235f3-24db-4c27-970b-503c2aa1b5c9 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:46.923802 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561235f3-24db-4c27-970b-503c2aa1b5c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:46.924075 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561235f3-24db-4c27-970b-503c2aa1b5c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:46.934258 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561235f3-24db-4c27-970b-503c2aa1b5c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:46.935765 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561235f3-24db-4c27-970b-503c2aa1b5c9 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:46.946600 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1391/2762] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:10:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:10:47.597750 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8668cf-a6c4-42e4-9bbf-670684e10845 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:47.597750 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-cb8668cf-a6c4-42e4-9bbf-670684e10845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:47.618380 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8668cf-a6c4-42e4-9bbf-670684e10845 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:47.624395 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca41e2-03b4-4df7-8546-3273a5dd1004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:47.628609 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca41e2-03b4-4df7-8546-3273a5dd1004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:47.628609 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca41e2-03b4-4df7-8546-3273a5dd1004 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:47.628609 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca41e2-03b4-4df7-8546-3273a5dd1004 admin admin] PATH_INFO: `/v3/projects/17ea47ee2baf48bba79a314bb798d9fc` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:47.629488 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca41e2-03b4-4df7-8546-3273a5dd1004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17ea47ee2baf48bba79a314bb798d9fc)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:47.632072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca41e2-03b4-4df7-8546-3273a5dd1004 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:47.808158 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c3ca41e2-03b4-4df7-8546-3273a5dd1004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17ea47ee2baf48bba79a314bb798d9fc', 'request_id': 'req-c3ca41e2-03b4-4df7-8546-3273a5dd1004'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:47.823693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c3ca41e2-03b4-4df7-8546-3273a5dd1004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17ea47ee2baf48bba79a314bb798d9fc', 'request_id': 'req-c3ca41e2-03b4-4df7-8546-3273a5dd1004'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:47.828965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c3ca41e2-03b4-4df7-8546-3273a5dd1004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17ea47ee2baf48bba79a314bb798d9fc', 'request_id': 'req-c3ca41e2-03b4-4df7-8546-3273a5dd1004'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:47.939903 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c3ca41e2-03b4-4df7-8546-3273a5dd1004 admin admin] The token cache is being invalidate because project 17ea47ee2baf48bba79a314bb798d9fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86894) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:10:47.940339 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c3ca41e2-03b4-4df7-8546-3273a5dd1004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:47.941549 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c3ca41e2-03b4-4df7-8546-3273a5dd1004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:47.944240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1372/2763] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:10:47 2022] DELETE /identity/v3/projects/17ea47ee2baf48bba79a314bb798d9fc => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:10:47.954712 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561235f3-24db-4c27-970b-503c2aa1b5c9 service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:47.966426 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561235f3-24db-4c27-970b-503c2aa1b5c9 service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:48.097615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2401d53-4fe4-4ee6-afa0-abd8fa5a493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:48.098761 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401d53-4fe4-4ee6-afa0-abd8fa5a493a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:48.099253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401d53-4fe4-4ee6-afa0-abd8fa5a493a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:48.099785 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401d53-4fe4-4ee6-afa0-abd8fa5a493a admin admin] PATH_INFO: `/v3/users/a5d474d54eb643b3abc5b1d663c3f1f1` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:48.104659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2401d53-4fe4-4ee6-afa0-abd8fa5a493a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5d474d54eb643b3abc5b1d663c3f1f1)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:48.121601 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2401d53-4fe4-4ee6-afa0-abd8fa5a493a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:48.273588 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:48.398720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-f2401d53-4fe4-4ee6-afa0-abd8fa5a493a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5d474d54eb643b3abc5b1d663c3f1f1'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:48.399916 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-f2401d53-4fe4-4ee6-afa0-abd8fa5a493a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5d474d54eb643b3abc5b1d663c3f1f1'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:48.489184 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-f2401d53-4fe4-4ee6-afa0-abd8fa5a493a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5d474d54eb643b3abc5b1d663c3f1f1'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:48.505752 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-f2401d53-4fe4-4ee6-afa0-abd8fa5a493a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5d474d54eb643b3abc5b1d663c3f1f1'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:48.513343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-f2401d53-4fe4-4ee6-afa0-abd8fa5a493a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5d474d54eb643b3abc5b1d663c3f1f1'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:48.521409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1392/2764] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:10:47 2022] DELETE /identity/v3/users/a5d474d54eb643b3abc5b1d663c3f1f1 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:10:48.598388 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca41e2-03b4-4df7-8546-3273a5dd1004 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:48.599944 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c3ca41e2-03b4-4df7-8546-3273a5dd1004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:48.710946 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca41e2-03b4-4df7-8546-3273a5dd1004 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:48.773902 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:48.791942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c85215-9366-42b3-a720-575245790161 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f2584622a48bba21e1bf31c1aef30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:48.797151 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c85215-9366-42b3-a720-575245790161 service placement] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:48.797151 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c85215-9366-42b3-a720-575245790161 service placement] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:48.797151 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c85215-9366-42b3-a720-575245790161 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:48.797151 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-e9c85215-9366-42b3-a720-575245790161 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:48.809811 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c85215-9366-42b3-a720-575245790161 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:48.811459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c85215-9366-42b3-a720-575245790161 service placement] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:48.824363 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1373/2765] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:10:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:10:49.017382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2401d53-4fe4-4ee6-afa0-abd8fa5a493a admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:49.019169 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f2401d53-4fe4-4ee6-afa0-abd8fa5a493a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:49.101614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2401d53-4fe4-4ee6-afa0-abd8fa5a493a admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:49.107227 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec890ca-19f8-4b5c-81a1-2aa757ed5bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:49.107948 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec890ca-19f8-4b5c-81a1-2aa757ed5bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:49.108224 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec890ca-19f8-4b5c-81a1-2aa757ed5bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:49.108494 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec890ca-19f8-4b5c-81a1-2aa757ed5bd1 admin admin] PATH_INFO: `/v3/projects/cc14b4b353ab42c59d795392375bfc1e` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:49.110459 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec890ca-19f8-4b5c-81a1-2aa757ed5bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc14b4b353ab42c59d795392375bfc1e)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:49.112698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec890ca-19f8-4b5c-81a1-2aa757ed5bd1 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:49.307618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-aec890ca-19f8-4b5c-81a1-2aa757ed5bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc14b4b353ab42c59d795392375bfc1e', 'request_id': 'req-aec890ca-19f8-4b5c-81a1-2aa757ed5bd1'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:49.414522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-aec890ca-19f8-4b5c-81a1-2aa757ed5bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc14b4b353ab42c59d795392375bfc1e', 'request_id': 'req-aec890ca-19f8-4b5c-81a1-2aa757ed5bd1'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:49.425757 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-aec890ca-19f8-4b5c-81a1-2aa757ed5bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc14b4b353ab42c59d795392375bfc1e', 'request_id': 'req-aec890ca-19f8-4b5c-81a1-2aa757ed5bd1'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:49.434376 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-aec890ca-19f8-4b5c-81a1-2aa757ed5bd1 admin admin] The token cache is being invalidate because project cc14b4b353ab42c59d795392375bfc1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:10:49.434703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-aec890ca-19f8-4b5c-81a1-2aa757ed5bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:49.435348 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-aec890ca-19f8-4b5c-81a1-2aa757ed5bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:49.437087 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1393/2766] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:10:49 2022] DELETE /identity/v3/projects/cc14b4b353ab42c59d795392375bfc1e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:10:49.444249 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c85215-9366-42b3-a720-575245790161 service placement] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:49.460854 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c85215-9366-42b3-a720-575245790161 service placement] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:49.552062 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c65574-43d4-4bc1-b35e-0212707f18b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:49.552714 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c65574-43d4-4bc1-b35e-0212707f18b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:49.553009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c65574-43d4-4bc1-b35e-0212707f18b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:49.553255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c65574-43d4-4bc1-b35e-0212707f18b9 admin admin] PATH_INFO: `/v3/users/3bb21464a6734752bc6dbc8e38085e4d` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:49.554429 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c65574-43d4-4bc1-b35e-0212707f18b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bb21464a6734752bc6dbc8e38085e4d)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:49.556469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c65574-43d4-4bc1-b35e-0212707f18b9 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:49.785509 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-84c65574-43d4-4bc1-b35e-0212707f18b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bb21464a6734752bc6dbc8e38085e4d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:49.786196 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-84c65574-43d4-4bc1-b35e-0212707f18b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bb21464a6734752bc6dbc8e38085e4d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:49.863808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-84c65574-43d4-4bc1-b35e-0212707f18b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bb21464a6734752bc6dbc8e38085e4d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:49.871311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-84c65574-43d4-4bc1-b35e-0212707f18b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bb21464a6734752bc6dbc8e38085e4d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:49.883726 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-84c65574-43d4-4bc1-b35e-0212707f18b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bb21464a6734752bc6dbc8e38085e4d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:49.889651 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1374/2767] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:10:49 2022] DELETE /identity/v3/users/3bb21464a6734752bc6dbc8e38085e4d => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:10:50.323791 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec890ca-19f8-4b5c-81a1-2aa757ed5bd1 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:10:50.326108 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-aec890ca-19f8-4b5c-81a1-2aa757ed5bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:10:50.341476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec890ca-19f8-4b5c-81a1-2aa757ed5bd1 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:10:50.377627 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:50.407021 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245a53c-9a85-41e9-8e96-8a9393bdd368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:10:50.407715 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245a53c-9a85-41e9-8e96-8a9393bdd368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:10:50.408013 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245a53c-9a85-41e9-8e96-8a9393bdd368 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:10:50.408295 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245a53c-9a85-41e9-8e96-8a9393bdd368 admin admin] PATH_INFO: `/v3/projects/e8680d12d6f347c4991f0be1fca90bb8` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:10:50.410396 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245a53c-9a85-41e9-8e96-8a9393bdd368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8680d12d6f347c4991f0be1fca90bb8)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:10:50.412394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245a53c-9a85-41e9-8e96-8a9393bdd368 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:10:50.517042 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-5245a53c-9a85-41e9-8e96-8a9393bdd368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8680d12d6f347c4991f0be1fca90bb8', 'request_id': 'req-5245a53c-9a85-41e9-8e96-8a9393bdd368'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:50.643985 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-5245a53c-9a85-41e9-8e96-8a9393bdd368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8680d12d6f347c4991f0be1fca90bb8', 'request_id': 'req-5245a53c-9a85-41e9-8e96-8a9393bdd368'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:50.651599 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-5245a53c-9a85-41e9-8e96-8a9393bdd368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8680d12d6f347c4991f0be1fca90bb8', 'request_id': 'req-5245a53c-9a85-41e9-8e96-8a9393bdd368'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:50.664090 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-5245a53c-9a85-41e9-8e96-8a9393bdd368 admin admin] The token cache is being invalidate because project e8680d12d6f347c4991f0be1fca90bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:10:50.664521 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-5245a53c-9a85-41e9-8e96-8a9393bdd368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:50.665233 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-5245a53c-9a85-41e9-8e96-8a9393bdd368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:10:50.667086 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1394/2768] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:10:50 2022] DELETE /identity/v3/projects/e8680d12d6f347c4991f0be1fca90bb8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:10:59.886134 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=64,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:01.050047 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=35,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:01.148040 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ce750-bfa3-4b5c-bd6c-d26d0dc66cb4 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:11:01.148513 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ce750-bfa3-4b5c-bd6c-d26d0dc66cb4 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:11:01.148652 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ce750-bfa3-4b5c-bd6c-d26d0dc66cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:11:01.169133 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-9d0ce750-bfa3-4b5c-bd6c-d26d0dc66cb4 None None] MFA Rules not processed for user `deba0a6ab39a4f33a509a09e875f852c`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:11:01.170345 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-9d0ce750-bfa3-4b5c-bd6c-d26d0dc66cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:11:01.225678 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1375/2769] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:11:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:11:02.299093 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245a53c-9a85-41e9-8e96-8a9393bdd368 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:11:02.300560 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-5245a53c-9a85-41e9-8e96-8a9393bdd368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:11:02.362117 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245a53c-9a85-41e9-8e96-8a9393bdd368 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:11:02.366417 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93660667-05fa-4b4c-b2d7-8affe37776f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:11:02.367044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93660667-05fa-4b4c-b2d7-8affe37776f7 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:11:02.367343 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93660667-05fa-4b4c-b2d7-8affe37776f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:11:02.367614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93660667-05fa-4b4c-b2d7-8affe37776f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:11:02.369374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-93660667-05fa-4b4c-b2d7-8affe37776f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:11:02.380507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93660667-05fa-4b4c-b2d7-8affe37776f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:11:02.382047 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93660667-05fa-4b4c-b2d7-8affe37776f7 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:11:02.390246 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1395/2770] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:11:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:11:02.463605 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ce750-bfa3-4b5c-bd6c-d26d0dc66cb4 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:11:02.474072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ce750-bfa3-4b5c-bd6c-d26d0dc66cb4 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:11:02.477882 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48988b6a-e53d-463c-8e52-ecd4b4c546b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:11:02.478508 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48988b6a-e53d-463c-8e52-ecd4b4c546b2 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:11:02.478787 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48988b6a-e53d-463c-8e52-ecd4b4c546b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:11:02.479060 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48988b6a-e53d-463c-8e52-ecd4b4c546b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:11:02.480837 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-48988b6a-e53d-463c-8e52-ecd4b4c546b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:11:02.576330 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48988b6a-e53d-463c-8e52-ecd4b4c546b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:11:02.577781 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48988b6a-e53d-463c-8e52-ecd4b4c546b2 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:11:02.600039 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1376/2771] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:11:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:11:12.386584 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=26 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:12.597245 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=71 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:05.796705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5eb24-74ac-490d-be9d-e9ae9fce315a None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:05.797221 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5eb24-74ac-490d-be9d-e9ae9fce315a None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:05.797365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5eb24-74ac-490d-be9d-e9ae9fce315a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:05.817953 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-ccf5eb24-74ac-490d-be9d-e9ae9fce315a None None] MFA Rules not processed for user `deba0a6ab39a4f33a509a09e875f852c`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:12:05.819205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ccf5eb24-74ac-490d-be9d-e9ae9fce315a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:05.827242 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1396/2772] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:12:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:12:15.812099 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:31.109676 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48988b6a-e53d-463c-8e52-ecd4b4c546b2 service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:31.114788 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-48988b6a-e53d-463c-8e52-ecd4b4c546b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:31.122069 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48988b6a-e53d-463c-8e52-ecd4b4c546b2 service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:31.125978 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba493e8-7abb-4399-add0-c6eb03a1de41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:31.127074 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba493e8-7abb-4399-add0-c6eb03a1de41 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:31.127387 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba493e8-7abb-4399-add0-c6eb03a1de41 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:31.129045 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba493e8-7abb-4399-add0-c6eb03a1de41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:31.130970 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-fba493e8-7abb-4399-add0-c6eb03a1de41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:31.147493 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba493e8-7abb-4399-add0-c6eb03a1de41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:31.148949 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba493e8-7abb-4399-add0-c6eb03a1de41 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:31.161879 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1377/2773] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:12:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:32.348885 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5eb24-74ac-490d-be9d-e9ae9fce315a None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:32.358664 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5eb24-74ac-490d-be9d-e9ae9fce315a None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:32.362527 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013abcb6-47f6-4261-a81f-33687763d618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:32.363137 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013abcb6-47f6-4261-a81f-33687763d618 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:32.363445 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013abcb6-47f6-4261-a81f-33687763d618 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:32.363719 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013abcb6-47f6-4261-a81f-33687763d618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:32.365790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-013abcb6-47f6-4261-a81f-33687763d618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:32.381399 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013abcb6-47f6-4261-a81f-33687763d618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:32.382881 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013abcb6-47f6-4261-a81f-33687763d618 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:32.395279 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1397/2774] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:12:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:37.671531 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba493e8-7abb-4399-add0-c6eb03a1de41 service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:37.680290 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba493e8-7abb-4399-add0-c6eb03a1de41 service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:37.683896 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a73ce0-f55c-479b-8f73-62930e27ed05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:37.684507 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a73ce0-f55c-479b-8f73-62930e27ed05 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:37.685398 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a73ce0-f55c-479b-8f73-62930e27ed05 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:37.685727 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a73ce0-f55c-479b-8f73-62930e27ed05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:37.687582 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c4a73ce0-f55c-479b-8f73-62930e27ed05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:37.751078 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a73ce0-f55c-479b-8f73-62930e27ed05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:37.752724 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a73ce0-f55c-479b-8f73-62930e27ed05 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:37.762236 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1378/2775] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:38.679945 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013abcb6-47f6-4261-a81f-33687763d618 service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:38.681401 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-013abcb6-47f6-4261-a81f-33687763d618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:38.750681 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013abcb6-47f6-4261-a81f-33687763d618 service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:38.755984 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1610d61-7d2c-4386-924a-ead18e9943dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f2584622a48bba21e1bf31c1aef30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:38.756655 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1610d61-7d2c-4386-924a-ead18e9943dd service placement] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:38.756931 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1610d61-7d2c-4386-924a-ead18e9943dd service placement] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:38.757203 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1610d61-7d2c-4386-924a-ead18e9943dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:38.758962 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f1610d61-7d2c-4386-924a-ead18e9943dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:38.771619 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1610d61-7d2c-4386-924a-ead18e9943dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:38.777518 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1610d61-7d2c-4386-924a-ead18e9943dd service placement] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:38.784662 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1398/2776] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:12:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:12:42.737576 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a73ce0-f55c-479b-8f73-62930e27ed05 service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:42.739160 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c4a73ce0-f55c-479b-8f73-62930e27ed05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:42.753591 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a73ce0-f55c-479b-8f73-62930e27ed05 service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:42.756870 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954802eb-2685-47af-b9f3-6e0ceeb84469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:42.757514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954802eb-2685-47af-b9f3-6e0ceeb84469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:42.757795 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954802eb-2685-47af-b9f3-6e0ceeb84469 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:42.758072 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954802eb-2685-47af-b9f3-6e0ceeb84469 admin admin] PATH_INFO: `/v3/users/3f0a175f41e74f9bb73303ce748a88dc` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:42.759222 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954802eb-2685-47af-b9f3-6e0ceeb84469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f0a175f41e74f9bb73303ce748a88dc)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:42.761169 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954802eb-2685-47af-b9f3-6e0ceeb84469 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:42.989952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-954802eb-2685-47af-b9f3-6e0ceeb84469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f0a175f41e74f9bb73303ce748a88dc'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:42.990535 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-954802eb-2685-47af-b9f3-6e0ceeb84469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f0a175f41e74f9bb73303ce748a88dc'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:43.057636 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-954802eb-2685-47af-b9f3-6e0ceeb84469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f0a175f41e74f9bb73303ce748a88dc'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:43.066377 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-954802eb-2685-47af-b9f3-6e0ceeb84469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f0a175f41e74f9bb73303ce748a88dc'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:43.079812 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-954802eb-2685-47af-b9f3-6e0ceeb84469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f0a175f41e74f9bb73303ce748a88dc'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:43.085825 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1379/2777] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:12:42 2022] DELETE /identity/v3/users/3f0a175f41e74f9bb73303ce748a88dc => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:43.321694 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1610d61-7d2c-4386-924a-ead18e9943dd service placement] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:43.339108 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1610d61-7d2c-4386-924a-ead18e9943dd service placement] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:43.398669 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93415dee-cdb5-437b-9e77-d38d995605f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:43.399305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93415dee-cdb5-437b-9e77-d38d995605f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:43.399608 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93415dee-cdb5-437b-9e77-d38d995605f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:43.399880 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93415dee-cdb5-437b-9e77-d38d995605f5 admin admin] PATH_INFO: `/v3/projects/86f431550b9542219b6ef4437c98acbb` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:43.401021 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93415dee-cdb5-437b-9e77-d38d995605f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86f431550b9542219b6ef4437c98acbb)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:43.402908 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93415dee-cdb5-437b-9e77-d38d995605f5 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:43.492723 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-93415dee-cdb5-437b-9e77-d38d995605f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86f431550b9542219b6ef4437c98acbb', 'request_id': 'req-93415dee-cdb5-437b-9e77-d38d995605f5'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:43.555252 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-93415dee-cdb5-437b-9e77-d38d995605f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86f431550b9542219b6ef4437c98acbb', 'request_id': 'req-93415dee-cdb5-437b-9e77-d38d995605f5'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:43.561812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-93415dee-cdb5-437b-9e77-d38d995605f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86f431550b9542219b6ef4437c98acbb', 'request_id': 'req-93415dee-cdb5-437b-9e77-d38d995605f5'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:43.575287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-93415dee-cdb5-437b-9e77-d38d995605f5 admin admin] The token cache is being invalidate because project 86f431550b9542219b6ef4437c98acbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:12:43.575287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-93415dee-cdb5-437b-9e77-d38d995605f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:43.575287 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-93415dee-cdb5-437b-9e77-d38d995605f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:43.575858 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1399/2778] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:12:43 2022] DELETE /identity/v3/projects/86f431550b9542219b6ef4437c98acbb => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:43.579899 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954802eb-2685-47af-b9f3-6e0ceeb84469 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:43.581309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-954802eb-2685-47af-b9f3-6e0ceeb84469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:43.595250 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954802eb-2685-47af-b9f3-6e0ceeb84469 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:43.643963 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:43.652496 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c2cfc-39eb-48a9-9c15-df6f19c18a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:43.653146 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c2cfc-39eb-48a9-9c15-df6f19c18a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:43.654028 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c2cfc-39eb-48a9-9c15-df6f19c18a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:43.654361 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c2cfc-39eb-48a9-9c15-df6f19c18a3d admin admin] PATH_INFO: `/v3/users/d3fc96474c594767898faa46cd366110` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:43.655609 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c2cfc-39eb-48a9-9c15-df6f19c18a3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3fc96474c594767898faa46cd366110)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:43.657529 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c2cfc-39eb-48a9-9c15-df6f19c18a3d admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:43.815698 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5d5c2cfc-39eb-48a9-9c15-df6f19c18a3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3fc96474c594767898faa46cd366110'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:43.816574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5d5c2cfc-39eb-48a9-9c15-df6f19c18a3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3fc96474c594767898faa46cd366110'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:43.884405 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5d5c2cfc-39eb-48a9-9c15-df6f19c18a3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3fc96474c594767898faa46cd366110'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:43.893319 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5d5c2cfc-39eb-48a9-9c15-df6f19c18a3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3fc96474c594767898faa46cd366110'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:43.906430 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5d5c2cfc-39eb-48a9-9c15-df6f19c18a3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3fc96474c594767898faa46cd366110'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:43.912453 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1380/2779] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:12:43 2022] DELETE /identity/v3/users/d3fc96474c594767898faa46cd366110 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:44.179507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93415dee-cdb5-437b-9e77-d38d995605f5 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:12:44.181859 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-93415dee-cdb5-437b-9e77-d38d995605f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:12:44.194349 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93415dee-cdb5-437b-9e77-d38d995605f5 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:12:44.198112 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:44.256574 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10794ccc-2be1-45d0-8ef1-25992eae479b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:12:44.257220 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10794ccc-2be1-45d0-8ef1-25992eae479b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:12:44.257498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10794ccc-2be1-45d0-8ef1-25992eae479b admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:12:44.257770 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10794ccc-2be1-45d0-8ef1-25992eae479b admin admin] PATH_INFO: `/v3/projects/b92a662811f14f1499245363a3957f6b` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:12:44.258915 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10794ccc-2be1-45d0-8ef1-25992eae479b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b92a662811f14f1499245363a3957f6b)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:12:44.260849 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10794ccc-2be1-45d0-8ef1-25992eae479b admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:12:44.355528 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-10794ccc-2be1-45d0-8ef1-25992eae479b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b92a662811f14f1499245363a3957f6b', 'request_id': 'req-10794ccc-2be1-45d0-8ef1-25992eae479b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:44.441100 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-10794ccc-2be1-45d0-8ef1-25992eae479b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b92a662811f14f1499245363a3957f6b', 'request_id': 'req-10794ccc-2be1-45d0-8ef1-25992eae479b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:44.447018 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-10794ccc-2be1-45d0-8ef1-25992eae479b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b92a662811f14f1499245363a3957f6b', 'request_id': 'req-10794ccc-2be1-45d0-8ef1-25992eae479b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:44.458034 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-10794ccc-2be1-45d0-8ef1-25992eae479b admin admin] The token cache is being invalidate because project b92a662811f14f1499245363a3957f6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:12:44.462466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-10794ccc-2be1-45d0-8ef1-25992eae479b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:44.462466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-10794ccc-2be1-45d0-8ef1-25992eae479b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:12:44.462466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1400/2780] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:12:44 2022] DELETE /identity/v3/projects/b92a662811f14f1499245363a3957f6b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:12:53.908922 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:54.455066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:13.752238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c2cfc-39eb-48a9-9c15-df6f19c18a3d admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:13.753706 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-5d5c2cfc-39eb-48a9-9c15-df6f19c18a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:13.768881 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c2cfc-39eb-48a9-9c15-df6f19c18a3d admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:13.835340 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74382334-152d-4c96-a7f4-04fac07e2e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:13.836009 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74382334-152d-4c96-a7f4-04fac07e2e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:13.836394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74382334-152d-4c96-a7f4-04fac07e2e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:13.836921 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74382334-152d-4c96-a7f4-04fac07e2e77 admin admin] PATH_INFO: `/v3/users/deba0a6ab39a4f33a509a09e875f852c` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:13.838152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74382334-152d-4c96-a7f4-04fac07e2e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deba0a6ab39a4f33a509a09e875f852c)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:13.840118 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74382334-152d-4c96-a7f4-04fac07e2e77 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:14.057337 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-74382334-152d-4c96-a7f4-04fac07e2e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deba0a6ab39a4f33a509a09e875f852c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:14.058045 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-74382334-152d-4c96-a7f4-04fac07e2e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deba0a6ab39a4f33a509a09e875f852c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:14.120089 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-74382334-152d-4c96-a7f4-04fac07e2e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deba0a6ab39a4f33a509a09e875f852c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:14.128236 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-74382334-152d-4c96-a7f4-04fac07e2e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deba0a6ab39a4f33a509a09e875f852c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:14.140819 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-74382334-152d-4c96-a7f4-04fac07e2e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deba0a6ab39a4f33a509a09e875f852c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:14.146908 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1381/2781] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:13:13 2022] DELETE /identity/v3/users/deba0a6ab39a4f33a509a09e875f852c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:14.453493 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10794ccc-2be1-45d0-8ef1-25992eae479b admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:14.455452 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-10794ccc-2be1-45d0-8ef1-25992eae479b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:14.470127 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10794ccc-2be1-45d0-8ef1-25992eae479b admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:14.531354 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e2437-9bd2-4b79-8ecf-06034f3b0b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:14.532014 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e2437-9bd2-4b79-8ecf-06034f3b0b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:14.532300 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e2437-9bd2-4b79-8ecf-06034f3b0b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:14.532577 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e2437-9bd2-4b79-8ecf-06034f3b0b7b admin admin] PATH_INFO: `/v3/projects/bb91363ae0f2423fbf1858ec807229d9` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:14.533777 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e2437-9bd2-4b79-8ecf-06034f3b0b7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb91363ae0f2423fbf1858ec807229d9)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:14.535732 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e2437-9bd2-4b79-8ecf-06034f3b0b7b admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:14.690017 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-dd7e2437-9bd2-4b79-8ecf-06034f3b0b7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb91363ae0f2423fbf1858ec807229d9', 'request_id': 'req-dd7e2437-9bd2-4b79-8ecf-06034f3b0b7b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:14.803708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-dd7e2437-9bd2-4b79-8ecf-06034f3b0b7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb91363ae0f2423fbf1858ec807229d9', 'request_id': 'req-dd7e2437-9bd2-4b79-8ecf-06034f3b0b7b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:14.810526 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-dd7e2437-9bd2-4b79-8ecf-06034f3b0b7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb91363ae0f2423fbf1858ec807229d9', 'request_id': 'req-dd7e2437-9bd2-4b79-8ecf-06034f3b0b7b'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:14.822939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-dd7e2437-9bd2-4b79-8ecf-06034f3b0b7b admin admin] The token cache is being invalidate because project bb91363ae0f2423fbf1858ec807229d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:13:14.823228 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-dd7e2437-9bd2-4b79-8ecf-06034f3b0b7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:14.823975 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-dd7e2437-9bd2-4b79-8ecf-06034f3b0b7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:14.825558 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1401/2782] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:13:14 2022] DELETE /identity/v3/projects/bb91363ae0f2423fbf1858ec807229d9 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:13:14.830728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a40e7-0219-4b19-9383-a056608eb2f4 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:14.831189 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a40e7-0219-4b19-9383-a056608eb2f4 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:14.831297 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a40e7-0219-4b19-9383-a056608eb2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:14.852793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-6a0a40e7-0219-4b19-9383-a056608eb2f4 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:14.854269 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-6a0a40e7-0219-4b19-9383-a056608eb2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:14.917627 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1382/2783] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:14.925709 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c35d3-95c7-471c-adf3-3433c303f48a None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:14.925989 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c35d3-95c7-471c-adf3-3433c303f48a None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:14.926260 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c35d3-95c7-471c-adf3-3433c303f48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:14.947897 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-779c35d3-95c7-471c-adf3-3433c303f48a None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:14.949102 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-779c35d3-95c7-471c-adf3-3433c303f48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:14.957745 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1402/2784] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:13:14.962656 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a40e7-0219-4b19-9383-a056608eb2f4 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:14.972792 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a40e7-0219-4b19-9383-a056608eb2f4 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:14.978315 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18696131-597e-4456-9001-e1eb33b4bd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:14.978940 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18696131-597e-4456-9001-e1eb33b4bd2f admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:14.979225 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18696131-597e-4456-9001-e1eb33b4bd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:14.979546 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18696131-597e-4456-9001-e1eb33b4bd2f admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:14.980250 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18696131-597e-4456-9001-e1eb33b4bd2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:13:14.980558 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18696131-597e-4456-9001-e1eb33b4bd2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:14.982217 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18696131-597e-4456-9001-e1eb33b4bd2f admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:14.995193 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1383/2785] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:13:14.999351 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c35d3-95c7-471c-adf3-3433c303f48a None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:15.009705 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c35d3-95c7-471c-adf3-3433c303f48a None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:15.014346 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e4e83-cc24-4f17-b3c1-a3376288cbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:15.014955 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e4e83-cc24-4f17-b3c1-a3376288cbc3 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:15.015234 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e4e83-cc24-4f17-b3c1-a3376288cbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:15.015537 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e4e83-cc24-4f17-b3c1-a3376288cbc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:15.016207 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e4e83-cc24-4f17-b3c1-a3376288cbc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:15.018127 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e4e83-cc24-4f17-b3c1-a3376288cbc3 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:15.122822 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1403/2786] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:13:14 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:15.127386 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18696131-597e-4456-9001-e1eb33b4bd2f admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:15.137948 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18696131-597e-4456-9001-e1eb33b4bd2f admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:15.141588 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:15.196755 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88def93-9316-4bfc-89c6-ff27d3c21046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:15.197367 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88def93-9316-4bfc-89c6-ff27d3c21046 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:15.197650 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88def93-9316-4bfc-89c6-ff27d3c21046 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:15.197972 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88def93-9316-4bfc-89c6-ff27d3c21046 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:15.198666 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88def93-9316-4bfc-89c6-ff27d3c21046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:15.201021 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88def93-9316-4bfc-89c6-ff27d3c21046 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:15.257254 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1384/2787] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:13:15 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:15.261539 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e4e83-cc24-4f17-b3c1-a3376288cbc3 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:15.271919 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e4e83-cc24-4f17-b3c1-a3376288cbc3 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:15.277603 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721a038-25cf-47d8-a4a0-f75e6aedee06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:15.278217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721a038-25cf-47d8-a4a0-f75e6aedee06 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:15.278493 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721a038-25cf-47d8-a4a0-f75e6aedee06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:15.278767 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721a038-25cf-47d8-a4a0-f75e6aedee06 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:15.279488 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721a038-25cf-47d8-a4a0-f75e6aedee06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:15.281082 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6721a038-25cf-47d8-a4a0-f75e6aedee06 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:15.292101 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1404/2788] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:15.296305 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88def93-9316-4bfc-89c6-ff27d3c21046 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:15.306832 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88def93-9316-4bfc-89c6-ff27d3c21046 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:15.311553 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40467883-2227-4652-bbea-ff5d8035174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:15.312170 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40467883-2227-4652-bbea-ff5d8035174d admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:15.312456 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40467883-2227-4652-bbea-ff5d8035174d admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:15.312734 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40467883-2227-4652-bbea-ff5d8035174d admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:15.313432 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40467883-2227-4652-bbea-ff5d8035174d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:15.315039 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40467883-2227-4652-bbea-ff5d8035174d admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:15.326532 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1385/2789] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:15.330610 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721a038-25cf-47d8-a4a0-f75e6aedee06 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:15.341230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721a038-25cf-47d8-a4a0-f75e6aedee06 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:15.345805 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afaa94-ad40-4522-a83e-d787ef374635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:15.346487 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afaa94-ad40-4522-a83e-d787ef374635 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:15.346762 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afaa94-ad40-4522-a83e-d787ef374635 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:15.347036 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afaa94-ad40-4522-a83e-d787ef374635 admin admin] PATH_INFO: `/v3/projects/b97071a6268c43dca1cd52de1bbb8695/users/397df4aa890d470c8f9d3c939dc45468/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:15.361820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afaa94-ad40-4522-a83e-d787ef374635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97071a6268c43dca1cd52de1bbb8695, user_id=397df4aa890d470c8f9d3c939dc45468, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:15.364488 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afaa94-ad40-4522-a83e-d787ef374635 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:15.439596 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1405/2790] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:13:15 2022] PUT /identity/v3/projects/b97071a6268c43dca1cd52de1bbb8695/users/397df4aa890d470c8f9d3c939dc45468/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:15.451883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6a973-c61b-45a9-a779-2966a2cff533 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:15.452200 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6a973-c61b-45a9-a779-2966a2cff533 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:15.454218 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6a973-c61b-45a9-a779-2966a2cff533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:15.482031 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-08d6a973-c61b-45a9-a779-2966a2cff533 None None] MFA Rules not processed for user `397df4aa890d470c8f9d3c939dc45468`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:15.483472 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-08d6a973-c61b-45a9-a779-2966a2cff533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:15.565241 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1386/2791] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:13:15.578145 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afaa94-ad40-4522-a83e-d787ef374635 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:15.579990 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-90afaa94-ad40-4522-a83e-d787ef374635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:15.601605 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:15.656516 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afaa94-ad40-4522-a83e-d787ef374635 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:15.662306 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857f95c-a959-48a3-beac-ba3341ad398f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:15.662944 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857f95c-a959-48a3-beac-ba3341ad398f service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:15.663220 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857f95c-a959-48a3-beac-ba3341ad398f service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:15.663521 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857f95c-a959-48a3-beac-ba3341ad398f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:15.676726 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857f95c-a959-48a3-beac-ba3341ad398f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:15.678506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857f95c-a959-48a3-beac-ba3341ad398f service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:15.689520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1406/2792] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:13:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:21.777394 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6a973-c61b-45a9-a779-2966a2cff533 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:21.847606 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6a973-c61b-45a9-a779-2966a2cff533 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:21.852452 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c6601-e33c-4724-9675-af0699039a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:21.853223 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c6601-e33c-4724-9675-af0699039a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:21.853508 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c6601-e33c-4724-9675-af0699039a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:21.853784 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c6601-e33c-4724-9675-af0699039a5a admin admin] PATH_INFO: `/v3/users/397df4aa890d470c8f9d3c939dc45468` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:21.854993 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c6601-e33c-4724-9675-af0699039a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=397df4aa890d470c8f9d3c939dc45468)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:21.856989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c6601-e33c-4724-9675-af0699039a5a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:21.874839 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:22.031475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-298c6601-e33c-4724-9675-af0699039a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '397df4aa890d470c8f9d3c939dc45468'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:22.032387 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-298c6601-e33c-4724-9675-af0699039a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '397df4aa890d470c8f9d3c939dc45468'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:22.091066 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-298c6601-e33c-4724-9675-af0699039a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '397df4aa890d470c8f9d3c939dc45468'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:22.098801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-298c6601-e33c-4724-9675-af0699039a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '397df4aa890d470c8f9d3c939dc45468'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:22.111460 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-298c6601-e33c-4724-9675-af0699039a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '397df4aa890d470c8f9d3c939dc45468'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:22.117507 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1387/2793] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:13:21 2022] DELETE /identity/v3/users/397df4aa890d470c8f9d3c939dc45468 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:22.122262 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc807f69-9cf7-4110-af79-f37003c4a41c None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:22.122752 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc807f69-9cf7-4110-af79-f37003c4a41c None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:22.122860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc807f69-9cf7-4110-af79-f37003c4a41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:22.142981 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-dc807f69-9cf7-4110-af79-f37003c4a41c None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:22.144229 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-dc807f69-9cf7-4110-af79-f37003c4a41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:22.205864 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1407/2794] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:22.217243 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c6601-e33c-4724-9675-af0699039a5a admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:22.218762 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-298c6601-e33c-4724-9675-af0699039a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:22.279536 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c6601-e33c-4724-9675-af0699039a5a admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:22.283309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc71ac-a865-4e01-baf8-993c0203638b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:22.283929 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc71ac-a865-4e01-baf8-993c0203638b service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:22.284201 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc71ac-a865-4e01-baf8-993c0203638b service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:22.284482 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc71ac-a865-4e01-baf8-993c0203638b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:22.295019 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc71ac-a865-4e01-baf8-993c0203638b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:22.296562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc71ac-a865-4e01-baf8-993c0203638b service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:22.308053 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1388/2795] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:13:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:22.755767 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc807f69-9cf7-4110-af79-f37003c4a41c None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:22.757736 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-dc807f69-9cf7-4110-af79-f37003c4a41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:22.772763 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc807f69-9cf7-4110-af79-f37003c4a41c None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:22.790695 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b95485-52bf-4f78-9338-4d0bae67d89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:22.791448 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b95485-52bf-4f78-9338-4d0bae67d89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:22.791729 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b95485-52bf-4f78-9338-4d0bae67d89c admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:22.791985 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b95485-52bf-4f78-9338-4d0bae67d89c admin admin] PATH_INFO: `/v3/projects/b97071a6268c43dca1cd52de1bbb8695` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:22.793245 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b95485-52bf-4f78-9338-4d0bae67d89c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97071a6268c43dca1cd52de1bbb8695)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:22.795249 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b95485-52bf-4f78-9338-4d0bae67d89c admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:22.917495 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-22b95485-52bf-4f78-9338-4d0bae67d89c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97071a6268c43dca1cd52de1bbb8695', 'request_id': 'req-22b95485-52bf-4f78-9338-4d0bae67d89c'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:22.994169 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-22b95485-52bf-4f78-9338-4d0bae67d89c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97071a6268c43dca1cd52de1bbb8695', 'request_id': 'req-22b95485-52bf-4f78-9338-4d0bae67d89c'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:23.000508 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-22b95485-52bf-4f78-9338-4d0bae67d89c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97071a6268c43dca1cd52de1bbb8695', 'request_id': 'req-22b95485-52bf-4f78-9338-4d0bae67d89c'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:23.012902 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-22b95485-52bf-4f78-9338-4d0bae67d89c admin admin] The token cache is being invalidate because project b97071a6268c43dca1cd52de1bbb8695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:13:23.013206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-22b95485-52bf-4f78-9338-4d0bae67d89c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:23.013834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-22b95485-52bf-4f78-9338-4d0bae67d89c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:23.015422 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1408/2796] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:13:22 2022] DELETE /identity/v3/projects/b97071a6268c43dca1cd52de1bbb8695 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:23.020464 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32190cb7-420a-46d5-acd3-8fc86be34aec None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:23.021035 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32190cb7-420a-46d5-acd3-8fc86be34aec None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:23.021035 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32190cb7-420a-46d5-acd3-8fc86be34aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:23.042392 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-32190cb7-420a-46d5-acd3-8fc86be34aec None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:23.043577 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-32190cb7-420a-46d5-acd3-8fc86be34aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:23.108491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1389/2797] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:23.116506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9cdc8-1cf6-4f95-a5ce-9f596b0fd929 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:23.116800 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9cdc8-1cf6-4f95-a5ce-9f596b0fd929 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:23.117074 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9cdc8-1cf6-4f95-a5ce-9f596b0fd929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:23.139132 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-39f9cdc8-1cf6-4f95-a5ce-9f596b0fd929 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:23.140409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-39f9cdc8-1cf6-4f95-a5ce-9f596b0fd929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:23.148615 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1409/2798] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:23.153562 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32190cb7-420a-46d5-acd3-8fc86be34aec None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:23.163721 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32190cb7-420a-46d5-acd3-8fc86be34aec None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:23.168616 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967db970-7900-45ad-8bc7-cf5c294c5616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:23.169255 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967db970-7900-45ad-8bc7-cf5c294c5616 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:23.169519 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967db970-7900-45ad-8bc7-cf5c294c5616 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:23.169796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967db970-7900-45ad-8bc7-cf5c294c5616 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:23.170500 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967db970-7900-45ad-8bc7-cf5c294c5616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:13:23.170810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967db970-7900-45ad-8bc7-cf5c294c5616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:23.172461 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967db970-7900-45ad-8bc7-cf5c294c5616 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:23.184283 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1390/2799] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:13:23.189101 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9cdc8-1cf6-4f95-a5ce-9f596b0fd929 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:23.202495 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9cdc8-1cf6-4f95-a5ce-9f596b0fd929 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:23.207515 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2471a1-6ef3-4613-a880-ddab422019cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:23.208159 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2471a1-6ef3-4613-a880-ddab422019cd admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:23.208441 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2471a1-6ef3-4613-a880-ddab422019cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:23.208720 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2471a1-6ef3-4613-a880-ddab422019cd admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:23.209412 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2471a1-6ef3-4613-a880-ddab422019cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:23.211415 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2471a1-6ef3-4613-a880-ddab422019cd admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:23.292144 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:23.299662 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1410/2800] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:13:23 2022] POST /identity/v3/projects => generated 403 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:23.303726 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967db970-7900-45ad-8bc7-cf5c294c5616 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:23.314409 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967db970-7900-45ad-8bc7-cf5c294c5616 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:23.335924 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:23.373604 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6b3d1-3d2a-4d7d-a06b-97ba35f27170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:23.374210 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6b3d1-3d2a-4d7d-a06b-97ba35f27170 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:23.374494 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6b3d1-3d2a-4d7d-a06b-97ba35f27170 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:23.374772 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6b3d1-3d2a-4d7d-a06b-97ba35f27170 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:23.375500 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6b3d1-3d2a-4d7d-a06b-97ba35f27170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:23.377693 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6b3d1-3d2a-4d7d-a06b-97ba35f27170 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:23.475146 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1391/2801] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:13:23 2022] POST /identity/v3/users => generated 302 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:23.479276 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2471a1-6ef3-4613-a880-ddab422019cd admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:23.489891 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2471a1-6ef3-4613-a880-ddab422019cd admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:23.496351 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf981c-2d4d-4d56-902d-59d970ac983d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:23.496999 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf981c-2d4d-4d56-902d-59d970ac983d admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:23.497279 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf981c-2d4d-4d56-902d-59d970ac983d admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:23.497554 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf981c-2d4d-4d56-902d-59d970ac983d admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:23.498255 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf981c-2d4d-4d56-902d-59d970ac983d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:23.500009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf981c-2d4d-4d56-902d-59d970ac983d admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:23.511130 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1411/2802] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:23.516296 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6b3d1-3d2a-4d7d-a06b-97ba35f27170 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:23.526914 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6b3d1-3d2a-4d7d-a06b-97ba35f27170 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:23.532035 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7e9e3-7b2e-4c61-82b7-96af29a00175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:23.532673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7e9e3-7b2e-4c61-82b7-96af29a00175 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:23.532948 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7e9e3-7b2e-4c61-82b7-96af29a00175 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:23.533228 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7e9e3-7b2e-4c61-82b7-96af29a00175 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:23.533996 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7e9e3-7b2e-4c61-82b7-96af29a00175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:23.535636 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7e9e3-7b2e-4c61-82b7-96af29a00175 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:23.546798 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1392/2803] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:13:23.551283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf981c-2d4d-4d56-902d-59d970ac983d admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:23.563992 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf981c-2d4d-4d56-902d-59d970ac983d admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:23.570235 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847e7c0-3817-4b49-a0b4-ca653023cdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:23.571488 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847e7c0-3817-4b49-a0b4-ca653023cdcd admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:23.571790 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847e7c0-3817-4b49-a0b4-ca653023cdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:23.572067 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847e7c0-3817-4b49-a0b4-ca653023cdcd admin admin] PATH_INFO: `/v3/projects/e1ed4f656f0b4b1eb4f4c8425d4196be/users/35962297b71f46538fa7724b0ab4c1a5/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:23.589236 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847e7c0-3817-4b49-a0b4-ca653023cdcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ed4f656f0b4b1eb4f4c8425d4196be, user_id=35962297b71f46538fa7724b0ab4c1a5, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:23.592091 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847e7c0-3817-4b49-a0b4-ca653023cdcd admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:23.724410 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1412/2804] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:13:23 2022] PUT /identity/v3/projects/e1ed4f656f0b4b1eb4f4c8425d4196be/users/35962297b71f46538fa7724b0ab4c1a5/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:23.729888 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba26744-57c1-4688-8518-bd863a435037 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:23.730177 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba26744-57c1-4688-8518-bd863a435037 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:23.730457 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba26744-57c1-4688-8518-bd863a435037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:23.750437 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-6ba26744-57c1-4688-8518-bd863a435037 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:23.751971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-6ba26744-57c1-4688-8518-bd863a435037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:23.817434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1393/2805] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:23.825126 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847e7c0-3817-4b49-a0b4-ca653023cdcd admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:23.827046 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-1847e7c0-3817-4b49-a0b4-ca653023cdcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:23.891628 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847e7c0-3817-4b49-a0b4-ca653023cdcd admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:23.895664 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf17d8-5133-410d-86c7-07aa7ad410f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:23.896373 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf17d8-5133-410d-86c7-07aa7ad410f7 service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:23.897059 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf17d8-5133-410d-86c7-07aa7ad410f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:23.897332 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf17d8-5133-410d-86c7-07aa7ad410f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:23.909878 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf17d8-5133-410d-86c7-07aa7ad410f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:23.911314 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf17d8-5133-410d-86c7-07aa7ad410f7 service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:23.922542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1413/2806] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:25.283063 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401ab2a-b997-4e55-ae0f-4c5e6d50fb31 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:25.283672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401ab2a-b997-4e55-ae0f-4c5e6d50fb31 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:25.283672 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401ab2a-b997-4e55-ae0f-4c5e6d50fb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:25.315733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-c401ab2a-b997-4e55-ae0f-4c5e6d50fb31 None None] MFA Rules not processed for user `35962297b71f46538fa7724b0ab4c1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:25.316984 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c401ab2a-b997-4e55-ae0f-4c5e6d50fb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:25.393623 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1394/2807] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:25.398262 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf17d8-5133-410d-86c7-07aa7ad410f7 service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:25.408531 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf17d8-5133-410d-86c7-07aa7ad410f7 service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:25.413344 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb99194-c059-453b-aed7-d068b062d6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:25.413995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb99194-c059-453b-aed7-d068b062d6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:25.414279 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb99194-c059-453b-aed7-d068b062d6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:25.415142 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb99194-c059-453b-aed7-d068b062d6f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:25.415982 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb99194-c059-453b-aed7-d068b062d6f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:25.417935 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb99194-c059-453b-aed7-d068b062d6f7 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:25.561701 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1414/2808] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:13:25 2022] POST /identity/v3/projects => generated 403 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:25.568489 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401ab2a-b997-4e55-ae0f-4c5e6d50fb31 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:25.578552 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401ab2a-b997-4e55-ae0f-4c5e6d50fb31 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:25.614331 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:25.641408 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3771c42-abc7-43a5-9a3f-c61fbfdc3425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:25.642032 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3771c42-abc7-43a5-9a3f-c61fbfdc3425 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:25.642311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3771c42-abc7-43a5-9a3f-c61fbfdc3425 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:25.642583 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3771c42-abc7-43a5-9a3f-c61fbfdc3425 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:25.643256 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3771c42-abc7-43a5-9a3f-c61fbfdc3425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:25.645238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3771c42-abc7-43a5-9a3f-c61fbfdc3425 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:25.778210 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1395/2809] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:13:25 2022] POST /identity/v3/users => generated 308 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:25.782223 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb99194-c059-453b-aed7-d068b062d6f7 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:25.793793 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb99194-c059-453b-aed7-d068b062d6f7 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:25.798562 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dade6a6-5a9e-449a-aa12-a2a742e0720e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:25.799295 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dade6a6-5a9e-449a-aa12-a2a742e0720e admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:25.799618 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dade6a6-5a9e-449a-aa12-a2a742e0720e admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:25.799906 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dade6a6-5a9e-449a-aa12-a2a742e0720e admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:25.800612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dade6a6-5a9e-449a-aa12-a2a742e0720e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:25.802230 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dade6a6-5a9e-449a-aa12-a2a742e0720e admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:25.813628 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1415/2810] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:25.817913 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3771c42-abc7-43a5-9a3f-c61fbfdc3425 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:25.829475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3771c42-abc7-43a5-9a3f-c61fbfdc3425 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:25.834571 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642e640-9b41-4d03-8a07-ffa0ff57c66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:25.835363 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642e640-9b41-4d03-8a07-ffa0ff57c66c admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:25.835598 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642e640-9b41-4d03-8a07-ffa0ff57c66c admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:25.835880 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642e640-9b41-4d03-8a07-ffa0ff57c66c admin admin] PATH_INFO: `/v3/projects/f68e31ab02844b8e853f6f1fd95fe37e/users/8f713c18dc8d4699a395d2686c8f9d99/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:25.854056 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642e640-9b41-4d03-8a07-ffa0ff57c66c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f68e31ab02844b8e853f6f1fd95fe37e, user_id=8f713c18dc8d4699a395d2686c8f9d99, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:25.856861 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642e640-9b41-4d03-8a07-ffa0ff57c66c admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:25.925869 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1396/2811] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:13:25 2022] PUT /identity/v3/projects/f68e31ab02844b8e853f6f1fd95fe37e/users/8f713c18dc8d4699a395d2686c8f9d99/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:25.929812 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dade6a6-5a9e-449a-aa12-a2a742e0720e admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:25.940838 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dade6a6-5a9e-449a-aa12-a2a742e0720e admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:26.000832 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63766e17-d3a0-4a6e-aad0-f3fc0d2bbc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:26.001735 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63766e17-d3a0-4a6e-aad0-f3fc0d2bbc7f admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:26.002015 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63766e17-d3a0-4a6e-aad0-f3fc0d2bbc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:26.002291 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63766e17-d3a0-4a6e-aad0-f3fc0d2bbc7f admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:26.002989 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63766e17-d3a0-4a6e-aad0-f3fc0d2bbc7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:26.004659 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63766e17-d3a0-4a6e-aad0-f3fc0d2bbc7f admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:26.015165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1416/2812] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:26.019416 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642e640-9b41-4d03-8a07-ffa0ff57c66c admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:26.030834 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642e640-9b41-4d03-8a07-ffa0ff57c66c admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:26.035579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3dc204-112b-486d-a7da-882dc3054d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:26.039085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3dc204-112b-486d-a7da-882dc3054d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:26.039085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3dc204-112b-486d-a7da-882dc3054d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:26.039085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3dc204-112b-486d-a7da-882dc3054d3a admin admin] PATH_INFO: `/v3/projects/f68e31ab02844b8e853f6f1fd95fe37e/users/8f713c18dc8d4699a395d2686c8f9d99/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:26.039085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3dc204-112b-486d-a7da-882dc3054d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f68e31ab02844b8e853f6f1fd95fe37e, user_id=8f713c18dc8d4699a395d2686c8f9d99, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:26.042186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3dc204-112b-486d-a7da-882dc3054d3a admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:26.053495 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1397/2813] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:13:26 2022] PUT /identity/v3/projects/f68e31ab02844b8e853f6f1fd95fe37e/users/8f713c18dc8d4699a395d2686c8f9d99/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:27.479080 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8d4c5-a83b-48e6-92c2-217cadea7b8f None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:27.479688 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8d4c5-a83b-48e6-92c2-217cadea7b8f None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:27.479688 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8d4c5-a83b-48e6-92c2-217cadea7b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:27.511831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-e0a8d4c5-a83b-48e6-92c2-217cadea7b8f None None] MFA Rules not processed for user `8f713c18dc8d4699a395d2686c8f9d99`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:27.513065 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e0a8d4c5-a83b-48e6-92c2-217cadea7b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:27.530544 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:27.587113 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1417/2814] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:28.947425 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3dc204-112b-486d-a7da-882dc3054d3a admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:29.012370 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3dc204-112b-486d-a7da-882dc3054d3a admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:29.017111 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bdfac-8fdd-4b02-b911-9583ca29f4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:29.017755 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bdfac-8fdd-4b02-b911-9583ca29f4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:29.018035 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bdfac-8fdd-4b02-b911-9583ca29f4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:29.018312 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bdfac-8fdd-4b02-b911-9583ca29f4a0 admin admin] PATH_INFO: `/v3/users/35962297b71f46538fa7724b0ab4c1a5` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:29.019517 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bdfac-8fdd-4b02-b911-9583ca29f4a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35962297b71f46538fa7724b0ab4c1a5)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:29.021477 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bdfac-8fdd-4b02-b911-9583ca29f4a0 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:29.213506 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-154bdfac-8fdd-4b02-b911-9583ca29f4a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35962297b71f46538fa7724b0ab4c1a5'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:29.214082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-154bdfac-8fdd-4b02-b911-9583ca29f4a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35962297b71f46538fa7724b0ab4c1a5'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:29.296807 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-154bdfac-8fdd-4b02-b911-9583ca29f4a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35962297b71f46538fa7724b0ab4c1a5'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:29.304578 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-154bdfac-8fdd-4b02-b911-9583ca29f4a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35962297b71f46538fa7724b0ab4c1a5'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:29.316471 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-154bdfac-8fdd-4b02-b911-9583ca29f4a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35962297b71f46538fa7724b0ab4c1a5'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:29.322857 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1398/2815] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:13:28 2022] DELETE /identity/v3/users/35962297b71f46538fa7724b0ab4c1a5 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:29.599627 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8d4c5-a83b-48e6-92c2-217cadea7b8f None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:29.610935 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8d4c5-a83b-48e6-92c2-217cadea7b8f None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:29.669520 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935fbfc-1530-4e0d-9efd-1dc0e4da7f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:29.670173 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935fbfc-1530-4e0d-9efd-1dc0e4da7f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:29.670456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935fbfc-1530-4e0d-9efd-1dc0e4da7f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:29.670731 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935fbfc-1530-4e0d-9efd-1dc0e4da7f9e admin admin] PATH_INFO: `/v3/projects/e1ed4f656f0b4b1eb4f4c8425d4196be` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:29.671994 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935fbfc-1530-4e0d-9efd-1dc0e4da7f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ed4f656f0b4b1eb4f4c8425d4196be)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:29.673915 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935fbfc-1530-4e0d-9efd-1dc0e4da7f9e admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:29.796081 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4935fbfc-1530-4e0d-9efd-1dc0e4da7f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ed4f656f0b4b1eb4f4c8425d4196be', 'request_id': 'req-4935fbfc-1530-4e0d-9efd-1dc0e4da7f9e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:29.868548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4935fbfc-1530-4e0d-9efd-1dc0e4da7f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ed4f656f0b4b1eb4f4c8425d4196be', 'request_id': 'req-4935fbfc-1530-4e0d-9efd-1dc0e4da7f9e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:29.874545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4935fbfc-1530-4e0d-9efd-1dc0e4da7f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ed4f656f0b4b1eb4f4c8425d4196be', 'request_id': 'req-4935fbfc-1530-4e0d-9efd-1dc0e4da7f9e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:29.885909 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4935fbfc-1530-4e0d-9efd-1dc0e4da7f9e admin admin] The token cache is being invalidate because project e1ed4f656f0b4b1eb4f4c8425d4196be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:13:29.888428 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4935fbfc-1530-4e0d-9efd-1dc0e4da7f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:29.888428 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4935fbfc-1530-4e0d-9efd-1dc0e4da7f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:29.888428 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1418/2816] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:13:29 2022] DELETE /identity/v3/projects/e1ed4f656f0b4b1eb4f4c8425d4196be => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:29.892421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bdfac-8fdd-4b02-b911-9583ca29f4a0 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:29.893816 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-154bdfac-8fdd-4b02-b911-9583ca29f4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:29.904403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:29.908324 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bdfac-8fdd-4b02-b911-9583ca29f4a0 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:29.965706 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192797e5-7426-463e-9b1c-348e90140f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:29.966389 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192797e5-7426-463e-9b1c-348e90140f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:29.966673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192797e5-7426-463e-9b1c-348e90140f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:29.966953 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192797e5-7426-463e-9b1c-348e90140f3f admin admin] PATH_INFO: `/v3/users/8f713c18dc8d4699a395d2686c8f9d99` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:29.968166 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192797e5-7426-463e-9b1c-348e90140f3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f713c18dc8d4699a395d2686c8f9d99)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:29.970149 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192797e5-7426-463e-9b1c-348e90140f3f admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:30.174726 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-192797e5-7426-463e-9b1c-348e90140f3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f713c18dc8d4699a395d2686c8f9d99'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:30.175365 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-192797e5-7426-463e-9b1c-348e90140f3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f713c18dc8d4699a395d2686c8f9d99'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:30.291783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-192797e5-7426-463e-9b1c-348e90140f3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f713c18dc8d4699a395d2686c8f9d99'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:30.299947 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-192797e5-7426-463e-9b1c-348e90140f3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f713c18dc8d4699a395d2686c8f9d99'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:30.312570 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-192797e5-7426-463e-9b1c-348e90140f3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f713c18dc8d4699a395d2686c8f9d99'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:30.318580 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1399/2817] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:13:29 2022] DELETE /identity/v3/users/8f713c18dc8d4699a395d2686c8f9d99 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:30.579009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935fbfc-1530-4e0d-9efd-1dc0e4da7f9e admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:30.581580 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-4935fbfc-1530-4e0d-9efd-1dc0e4da7f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:30.597153 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935fbfc-1530-4e0d-9efd-1dc0e4da7f9e admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:30.640900 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:30.655915 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c6bb7-177b-47ec-bf40-0bcfe24f8845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:30.656558 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c6bb7-177b-47ec-bf40-0bcfe24f8845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:30.656836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c6bb7-177b-47ec-bf40-0bcfe24f8845 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:30.657108 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c6bb7-177b-47ec-bf40-0bcfe24f8845 admin admin] PATH_INFO: `/v3/projects/f68e31ab02844b8e853f6f1fd95fe37e` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:30.658260 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c6bb7-177b-47ec-bf40-0bcfe24f8845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f68e31ab02844b8e853f6f1fd95fe37e)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:30.660204 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c6bb7-177b-47ec-bf40-0bcfe24f8845 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:30.795685 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-f41c6bb7-177b-47ec-bf40-0bcfe24f8845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f68e31ab02844b8e853f6f1fd95fe37e', 'request_id': 'req-f41c6bb7-177b-47ec-bf40-0bcfe24f8845'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:30.868898 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-f41c6bb7-177b-47ec-bf40-0bcfe24f8845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f68e31ab02844b8e853f6f1fd95fe37e', 'request_id': 'req-f41c6bb7-177b-47ec-bf40-0bcfe24f8845'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:30.875217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-f41c6bb7-177b-47ec-bf40-0bcfe24f8845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f68e31ab02844b8e853f6f1fd95fe37e', 'request_id': 'req-f41c6bb7-177b-47ec-bf40-0bcfe24f8845'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:30.886730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-f41c6bb7-177b-47ec-bf40-0bcfe24f8845 admin admin] The token cache is being invalidate because project f68e31ab02844b8e853f6f1fd95fe37e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:13:30.901446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-f41c6bb7-177b-47ec-bf40-0bcfe24f8845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:30.901446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-f41c6bb7-177b-47ec-bf40-0bcfe24f8845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:30.901446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1419/2818] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:13:30 2022] DELETE /identity/v3/projects/f68e31ab02844b8e853f6f1fd95fe37e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:30.901794 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9eb7c-388b-4376-9253-611d78b50765 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:30.901794 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9eb7c-388b-4376-9253-611d78b50765 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:30.901794 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9eb7c-388b-4376-9253-611d78b50765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:30.915900 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-6fa9eb7c-388b-4376-9253-611d78b50765 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:30.917138 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-6fa9eb7c-388b-4376-9253-611d78b50765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:30.976968 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1400/2819] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:30.985167 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302a5e8-bd81-4106-bd2e-f7b1305b83d4 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:30.985451 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302a5e8-bd81-4106-bd2e-f7b1305b83d4 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:30.985730 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302a5e8-bd81-4106-bd2e-f7b1305b83d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:31.006382 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-7302a5e8-bd81-4106-bd2e-f7b1305b83d4 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:31.007647 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-7302a5e8-bd81-4106-bd2e-f7b1305b83d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:31.016400 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1420/2820] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:13:31.020903 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9eb7c-388b-4376-9253-611d78b50765 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:31.031189 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9eb7c-388b-4376-9253-611d78b50765 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:31.035750 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c55a6-ca0a-40cc-99c7-4ce9914fcf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:31.036413 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c55a6-ca0a-40cc-99c7-4ce9914fcf48 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:31.036638 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c55a6-ca0a-40cc-99c7-4ce9914fcf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:31.036910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c55a6-ca0a-40cc-99c7-4ce9914fcf48 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:31.037603 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c55a6-ca0a-40cc-99c7-4ce9914fcf48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:13:31.037910 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c55a6-ca0a-40cc-99c7-4ce9914fcf48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:31.039743 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c55a6-ca0a-40cc-99c7-4ce9914fcf48 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:31.051633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1401/2821] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:13:31.056723 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302a5e8-bd81-4106-bd2e-f7b1305b83d4 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:31.066069 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302a5e8-bd81-4106-bd2e-f7b1305b83d4 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:31.070761 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edfab7-25b1-4af0-95f8-e39098d2eb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:31.072055 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edfab7-25b1-4af0-95f8-e39098d2eb4a admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:31.072338 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edfab7-25b1-4af0-95f8-e39098d2eb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:31.072612 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edfab7-25b1-4af0-95f8-e39098d2eb4a admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:31.073283 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edfab7-25b1-4af0-95f8-e39098d2eb4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:31.075218 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edfab7-25b1-4af0-95f8-e39098d2eb4a admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:31.175447 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1421/2822] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:13:31 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:31.176585 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c55a6-ca0a-40cc-99c7-4ce9914fcf48 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:31.187424 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c55a6-ca0a-40cc-99c7-4ce9914fcf48 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:31.195251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:31.245397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6680245-323d-408c-adc7-7157e6ead5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:31.246019 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6680245-323d-408c-adc7-7157e6ead5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:31.246299 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6680245-323d-408c-adc7-7157e6ead5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:31.246574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6680245-323d-408c-adc7-7157e6ead5e8 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:31.247251 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6680245-323d-408c-adc7-7157e6ead5e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:31.249302 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6680245-323d-408c-adc7-7157e6ead5e8 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:31.377149 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1402/2823] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:13:31 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:13:31.381092 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edfab7-25b1-4af0-95f8-e39098d2eb4a admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:31.391940 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edfab7-25b1-4af0-95f8-e39098d2eb4a admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:31.396678 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624cc73-fe36-4bb7-abeb-8cf318727a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:31.397348 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624cc73-fe36-4bb7-abeb-8cf318727a1b admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:31.397687 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624cc73-fe36-4bb7-abeb-8cf318727a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:31.397973 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624cc73-fe36-4bb7-abeb-8cf318727a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:31.398662 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624cc73-fe36-4bb7-abeb-8cf318727a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:31.400434 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624cc73-fe36-4bb7-abeb-8cf318727a1b admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:31.410656 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1422/2824] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:31.415243 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6680245-323d-408c-adc7-7157e6ead5e8 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:31.425391 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6680245-323d-408c-adc7-7157e6ead5e8 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:31.430036 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07dd70-3295-49d1-8fed-7331c6015c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:31.431533 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07dd70-3295-49d1-8fed-7331c6015c9d admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:31.431818 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07dd70-3295-49d1-8fed-7331c6015c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:31.432092 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07dd70-3295-49d1-8fed-7331c6015c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:31.432850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07dd70-3295-49d1-8fed-7331c6015c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:31.434442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07dd70-3295-49d1-8fed-7331c6015c9d admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:31.445445 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1403/2825] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:31.449860 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624cc73-fe36-4bb7-abeb-8cf318727a1b admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:31.460320 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624cc73-fe36-4bb7-abeb-8cf318727a1b admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:31.465590 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e388e5-44fc-4d09-b8a5-5c5b6687fe97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:31.466219 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e388e5-44fc-4d09-b8a5-5c5b6687fe97 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:31.466494 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e388e5-44fc-4d09-b8a5-5c5b6687fe97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:31.466767 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e388e5-44fc-4d09-b8a5-5c5b6687fe97 admin admin] PATH_INFO: `/v3/projects/a54413dfb12b44b2a8a06d21a7298a72/users/87754c27cb924991a1c580514d0b80a6/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:31.482306 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e388e5-44fc-4d09-b8a5-5c5b6687fe97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a54413dfb12b44b2a8a06d21a7298a72, user_id=87754c27cb924991a1c580514d0b80a6, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:31.484999 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e388e5-44fc-4d09-b8a5-5c5b6687fe97 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:31.588502 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1423/2826] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:13:31 2022] PUT /identity/v3/projects/a54413dfb12b44b2a8a06d21a7298a72/users/87754c27cb924991a1c580514d0b80a6/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:31.599859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e27298-26c2-4490-a02c-fb5166dc3241 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:31.600152 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e27298-26c2-4490-a02c-fb5166dc3241 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:31.600434 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e27298-26c2-4490-a02c-fb5166dc3241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:31.630253 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-a0e27298-26c2-4490-a02c-fb5166dc3241 None None] MFA Rules not processed for user `87754c27cb924991a1c580514d0b80a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:31.631431 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a0e27298-26c2-4490-a02c-fb5166dc3241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:31.698310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1404/2827] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:31.702803 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e388e5-44fc-4d09-b8a5-5c5b6687fe97 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:31.768806 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e388e5-44fc-4d09-b8a5-5c5b6687fe97 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:31.773423 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800639b-6f40-4e5e-84ba-004909cf22b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:31.774572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800639b-6f40-4e5e-84ba-004909cf22b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:31.774859 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800639b-6f40-4e5e-84ba-004909cf22b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:31.775346 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800639b-6f40-4e5e-84ba-004909cf22b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:31.776033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800639b-6f40-4e5e-84ba-004909cf22b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:31.777939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800639b-6f40-4e5e-84ba-004909cf22b4 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:31.796190 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:31.925739 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1424/2828] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:13:31 2022] POST /identity/v3/projects => generated 379 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:13:31.929729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e27298-26c2-4490-a02c-fb5166dc3241 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:31.941096 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e27298-26c2-4490-a02c-fb5166dc3241 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:31.998829 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c867085-57e4-4e25-b7e7-a82a4f86f5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:31.999738 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c867085-57e4-4e25-b7e7-a82a4f86f5d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:31.999738 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c867085-57e4-4e25-b7e7-a82a4f86f5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:31.999998 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c867085-57e4-4e25-b7e7-a82a4f86f5d1 admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:32.000680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c867085-57e4-4e25-b7e7-a82a4f86f5d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:32.002843 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c867085-57e4-4e25-b7e7-a82a4f86f5d1 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:32.085422 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1405/2829] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:13:31 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:32.089664 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800639b-6f40-4e5e-84ba-004909cf22b4 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:32.100231 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800639b-6f40-4e5e-84ba-004909cf22b4 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:32.105995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694765ad-a2d6-4bf9-be9d-4cac0de2aa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:32.106624 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694765ad-a2d6-4bf9-be9d-4cac0de2aa66 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:32.106901 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694765ad-a2d6-4bf9-be9d-4cac0de2aa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:32.107192 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694765ad-a2d6-4bf9-be9d-4cac0de2aa66 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:32.108190 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694765ad-a2d6-4bf9-be9d-4cac0de2aa66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:32.109766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694765ad-a2d6-4bf9-be9d-4cac0de2aa66 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:32.121966 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1425/2830] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:13:32.126329 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c867085-57e4-4e25-b7e7-a82a4f86f5d1 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:32.136426 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c867085-57e4-4e25-b7e7-a82a4f86f5d1 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:32.141186 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e88bc4-82fb-400d-b1b0-516501bb26f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:32.141802 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88bc4-82fb-400d-b1b0-516501bb26f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:32.142085 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88bc4-82fb-400d-b1b0-516501bb26f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:32.142363 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e88bc4-82fb-400d-b1b0-516501bb26f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:32.143059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e88bc4-82fb-400d-b1b0-516501bb26f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:32.144704 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e88bc4-82fb-400d-b1b0-516501bb26f8 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:32.146747 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:32.154928 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1406/2831] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:32.163799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694765ad-a2d6-4bf9-be9d-4cac0de2aa66 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:32.174522 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694765ad-a2d6-4bf9-be9d-4cac0de2aa66 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:32.179162 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f1203-e52e-4575-89ad-78cd6bec3aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:32.179787 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f1203-e52e-4575-89ad-78cd6bec3aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:32.180775 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f1203-e52e-4575-89ad-78cd6bec3aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:32.181213 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f1203-e52e-4575-89ad-78cd6bec3aa2 admin admin] PATH_INFO: `/v3/projects/2f9d098c2bfb43799f420a3919b3acf3/users/1b27cea76de74586bcb3d981a761975d/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:32.195517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f1203-e52e-4575-89ad-78cd6bec3aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9d098c2bfb43799f420a3919b3acf3, user_id=1b27cea76de74586bcb3d981a761975d, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:32.198835 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f1203-e52e-4575-89ad-78cd6bec3aa2 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:32.271948 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1426/2832] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:13:32 2022] PUT /identity/v3/projects/2f9d098c2bfb43799f420a3919b3acf3/users/1b27cea76de74586bcb3d981a761975d/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:32.338386 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4dfaf-3766-4526-a108-038285a29934 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:32.338673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4dfaf-3766-4526-a108-038285a29934 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:32.338953 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4dfaf-3766-4526-a108-038285a29934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:32.367407 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-a5b4dfaf-3766-4526-a108-038285a29934 None None] MFA Rules not processed for user `1b27cea76de74586bcb3d981a761975d`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:32.369244 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a5b4dfaf-3766-4526-a108-038285a29934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:32.432475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1407/2833] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:32.436957 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f1203-e52e-4575-89ad-78cd6bec3aa2 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:32.498096 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f1203-e52e-4575-89ad-78cd6bec3aa2 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:32.503131 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555430df-3818-437e-bd32-bfea03a666c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:32.503786 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555430df-3818-437e-bd32-bfea03a666c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:32.504085 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555430df-3818-437e-bd32-bfea03a666c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:32.504347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555430df-3818-437e-bd32-bfea03a666c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:32.505009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555430df-3818-437e-bd32-bfea03a666c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:32.506990 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555430df-3818-437e-bd32-bfea03a666c3 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:32.593941 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1427/2834] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:13:32 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:32.598154 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4dfaf-3766-4526-a108-038285a29934 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:32.609650 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4dfaf-3766-4526-a108-038285a29934 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:32.666286 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98727866-c312-4782-a216-58ea8402888e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:32.666912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98727866-c312-4782-a216-58ea8402888e admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:32.667193 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98727866-c312-4782-a216-58ea8402888e admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:32.667511 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98727866-c312-4782-a216-58ea8402888e admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:32.668236 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98727866-c312-4782-a216-58ea8402888e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:32.670141 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98727866-c312-4782-a216-58ea8402888e admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:32.769818 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1408/2835] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:13:32 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:32.773348 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555430df-3818-437e-bd32-bfea03a666c3 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:32.784708 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555430df-3818-437e-bd32-bfea03a666c3 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:32.790186 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d8bef-b5ba-44fa-a26c-bdeca517d993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:32.790928 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d8bef-b5ba-44fa-a26c-bdeca517d993 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:32.791045 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d8bef-b5ba-44fa-a26c-bdeca517d993 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:32.791218 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d8bef-b5ba-44fa-a26c-bdeca517d993 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:32.791948 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d8bef-b5ba-44fa-a26c-bdeca517d993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:32.793559 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d8bef-b5ba-44fa-a26c-bdeca517d993 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:32.804491 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1428/2836] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 04:13:32.808994 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98727866-c312-4782-a216-58ea8402888e admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:32.819037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98727866-c312-4782-a216-58ea8402888e admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:32.824280 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbac75-e3aa-4c77-ad9d-b8046fa61ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:32.824942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbac75-e3aa-4c77-ad9d-b8046fa61ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:32.825222 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbac75-e3aa-4c77-ad9d-b8046fa61ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:32.825497 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbac75-e3aa-4c77-ad9d-b8046fa61ae4 admin admin] PATH_INFO: `/v3/projects/f78a6a277eb541fe939395eb142e3f9a/users/9093fff49c774a6eb898d66956fc343c/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:32.840830 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbac75-e3aa-4c77-ad9d-b8046fa61ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78a6a277eb541fe939395eb142e3f9a, user_id=9093fff49c774a6eb898d66956fc343c, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:32.843573 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbac75-e3aa-4c77-ad9d-b8046fa61ae4 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:32.914083 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1409/2837] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:13:32 2022] PUT /identity/v3/projects/f78a6a277eb541fe939395eb142e3f9a/users/9093fff49c774a6eb898d66956fc343c/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:32.918309 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d8bef-b5ba-44fa-a26c-bdeca517d993 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:32.928399 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d8bef-b5ba-44fa-a26c-bdeca517d993 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:32.983777 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa258e-09dc-4376-99ab-30265fe08250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:32.984394 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa258e-09dc-4376-99ab-30265fe08250 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:32.984670 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa258e-09dc-4376-99ab-30265fe08250 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:32.984942 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa258e-09dc-4376-99ab-30265fe08250 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:32.985621 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa258e-09dc-4376-99ab-30265fe08250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:32.987214 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa258e-09dc-4376-99ab-30265fe08250 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:32.997347 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1429/2838] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:33.001775 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbac75-e3aa-4c77-ad9d-b8046fa61ae4 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:33.012753 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbac75-e3aa-4c77-ad9d-b8046fa61ae4 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:33.017711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a16a77-dc48-40cc-a9cc-cd88ab11d3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:33.018367 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a16a77-dc48-40cc-a9cc-cd88ab11d3ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:33.018648 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a16a77-dc48-40cc-a9cc-cd88ab11d3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:33.018929 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a16a77-dc48-40cc-a9cc-cd88ab11d3ee admin admin] PATH_INFO: `/v3/projects/f78a6a277eb541fe939395eb142e3f9a/users/9093fff49c774a6eb898d66956fc343c/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:33.020971 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a16a77-dc48-40cc-a9cc-cd88ab11d3ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78a6a277eb541fe939395eb142e3f9a, user_id=9093fff49c774a6eb898d66956fc343c, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:33.023576 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a16a77-dc48-40cc-a9cc-cd88ab11d3ee admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:33.034332 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1410/2839] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:13:33 2022] PUT /identity/v3/projects/f78a6a277eb541fe939395eb142e3f9a/users/9093fff49c774a6eb898d66956fc343c/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:33.044878 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcba6f-a793-4015-9191-eba6c05cd560 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:33.045170 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcba6f-a793-4015-9191-eba6c05cd560 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:33.045452 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcba6f-a793-4015-9191-eba6c05cd560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:33.074982 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-07dcba6f-a793-4015-9191-eba6c05cd560 None None] MFA Rules not processed for user `9093fff49c774a6eb898d66956fc343c`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:33.076532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-07dcba6f-a793-4015-9191-eba6c05cd560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:33.095658 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:33.147253 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1430/2840] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:33.159177 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a16a77-dc48-40cc-a9cc-cd88ab11d3ee admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:33.160942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-a1a16a77-dc48-40cc-a9cc-cd88ab11d3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:33.207457 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:33.221393 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a16a77-dc48-40cc-a9cc-cd88ab11d3ee admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:33.225115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a2a60-a098-4145-9454-838ebe8878ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:33.225728 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a2a60-a098-4145-9454-838ebe8878ce service cinder] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:33.226008 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a2a60-a098-4145-9454-838ebe8878ce service cinder] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:33.226279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a2a60-a098-4145-9454-838ebe8878ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:33.235875 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a2a60-a098-4145-9454-838ebe8878ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:33.237303 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a2a60-a098-4145-9454-838ebe8878ce service cinder] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:33.248632 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1411/2841] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:13:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:33.390950 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcba6f-a793-4015-9191-eba6c05cd560 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:33.392388 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-07dcba6f-a793-4015-9191-eba6c05cd560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:33.404656 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcba6f-a793-4015-9191-eba6c05cd560 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:33.408277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc1b8e-9d81-4952-8a5e-c01531d8c40e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:33.408886 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc1b8e-9d81-4952-8a5e-c01531d8c40e service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:33.409165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc1b8e-9d81-4952-8a5e-c01531d8c40e service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:33.409437 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc1b8e-9d81-4952-8a5e-c01531d8c40e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:33.466364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc1b8e-9d81-4952-8a5e-c01531d8c40e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:33.467854 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc1b8e-9d81-4952-8a5e-c01531d8c40e service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:33.476724 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1431/2842] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:13:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:37.587473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a2a60-a098-4145-9454-838ebe8878ce service cinder] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:37.659416 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a2a60-a098-4145-9454-838ebe8878ce service cinder] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:37.663989 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44659b79-f9df-49aa-b05f-bf3430cdb7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:37.664686 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44659b79-f9df-49aa-b05f-bf3430cdb7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:37.664966 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44659b79-f9df-49aa-b05f-bf3430cdb7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:37.665240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44659b79-f9df-49aa-b05f-bf3430cdb7ea admin admin] PATH_INFO: `/v3/users/87754c27cb924991a1c580514d0b80a6` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:37.666634 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44659b79-f9df-49aa-b05f-bf3430cdb7ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=87754c27cb924991a1c580514d0b80a6)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:37.668668 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44659b79-f9df-49aa-b05f-bf3430cdb7ea admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:37.863107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-44659b79-f9df-49aa-b05f-bf3430cdb7ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87754c27cb924991a1c580514d0b80a6'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:37.863783 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-44659b79-f9df-49aa-b05f-bf3430cdb7ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87754c27cb924991a1c580514d0b80a6'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:37.930574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-44659b79-f9df-49aa-b05f-bf3430cdb7ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87754c27cb924991a1c580514d0b80a6'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:37.938049 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-44659b79-f9df-49aa-b05f-bf3430cdb7ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87754c27cb924991a1c580514d0b80a6'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:37.950731 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-44659b79-f9df-49aa-b05f-bf3430cdb7ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87754c27cb924991a1c580514d0b80a6'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:37.957083 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1412/2843] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:13:37 2022] DELETE /identity/v3/users/87754c27cb924991a1c580514d0b80a6 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:37.961649 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd65f2-0761-4068-8eca-511ac177b1fd None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:37.962116 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd65f2-0761-4068-8eca-511ac177b1fd None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:37.962212 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd65f2-0761-4068-8eca-511ac177b1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:37.982829 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-24fd65f2-0761-4068-8eca-511ac177b1fd None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:37.984088 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-24fd65f2-0761-4068-8eca-511ac177b1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:38.050395 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1432/2844] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:38.060859 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44659b79-f9df-49aa-b05f-bf3430cdb7ea admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:38.062314 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-44659b79-f9df-49aa-b05f-bf3430cdb7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:38.122020 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44659b79-f9df-49aa-b05f-bf3430cdb7ea admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:38.125988 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc1685-04e9-4fbd-aa85-71cec1e91d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:38.126623 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc1685-04e9-4fbd-aa85-71cec1e91d3c service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:38.126900 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc1685-04e9-4fbd-aa85-71cec1e91d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:38.127172 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc1685-04e9-4fbd-aa85-71cec1e91d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:38.137095 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc1685-04e9-4fbd-aa85-71cec1e91d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:38.138560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc1685-04e9-4fbd-aa85-71cec1e91d3c service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:38.148235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1413/2845] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:38.732432 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd65f2-0761-4068-8eca-511ac177b1fd None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:38.733908 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-24fd65f2-0761-4068-8eca-511ac177b1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:38.746079 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd65f2-0761-4068-8eca-511ac177b1fd None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:38.753472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285f81b-77cf-4c5c-8aad-fb1c4409e459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:38.753472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285f81b-77cf-4c5c-8aad-fb1c4409e459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:38.753472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285f81b-77cf-4c5c-8aad-fb1c4409e459 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:38.753472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285f81b-77cf-4c5c-8aad-fb1c4409e459 admin admin] PATH_INFO: `/v3/projects/a54413dfb12b44b2a8a06d21a7298a72` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:38.753938 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285f81b-77cf-4c5c-8aad-fb1c4409e459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a54413dfb12b44b2a8a06d21a7298a72)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:38.756066 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285f81b-77cf-4c5c-8aad-fb1c4409e459 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:38.903507 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-3285f81b-77cf-4c5c-8aad-fb1c4409e459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a54413dfb12b44b2a8a06d21a7298a72', 'request_id': 'req-3285f81b-77cf-4c5c-8aad-fb1c4409e459'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:38.905219 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:38.985792 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-3285f81b-77cf-4c5c-8aad-fb1c4409e459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a54413dfb12b44b2a8a06d21a7298a72', 'request_id': 'req-3285f81b-77cf-4c5c-8aad-fb1c4409e459'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:38.991672 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-3285f81b-77cf-4c5c-8aad-fb1c4409e459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a54413dfb12b44b2a8a06d21a7298a72', 'request_id': 'req-3285f81b-77cf-4c5c-8aad-fb1c4409e459'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:39.003898 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-3285f81b-77cf-4c5c-8aad-fb1c4409e459 admin admin] The token cache is being invalidate because project a54413dfb12b44b2a8a06d21a7298a72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:13:39.004188 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-3285f81b-77cf-4c5c-8aad-fb1c4409e459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:39.004836 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-3285f81b-77cf-4c5c-8aad-fb1c4409e459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:39.006355 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1433/2846] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:13:38 2022] DELETE /identity/v3/projects/a54413dfb12b44b2a8a06d21a7298a72 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:39.011422 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc1685-04e9-4fbd-aa85-71cec1e91d3c service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:39.017537 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:39.021446 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc1685-04e9-4fbd-aa85-71cec1e91d3c service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:39.079010 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72da98b-853e-471f-82d5-aeb5d23e83b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:39.080020 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72da98b-853e-471f-82d5-aeb5d23e83b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:39.080302 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72da98b-853e-471f-82d5-aeb5d23e83b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:39.080600 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72da98b-853e-471f-82d5-aeb5d23e83b3 admin admin] PATH_INFO: `/v3/users/1b27cea76de74586bcb3d981a761975d` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:39.081879 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72da98b-853e-471f-82d5-aeb5d23e83b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b27cea76de74586bcb3d981a761975d)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:39.083839 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72da98b-853e-471f-82d5-aeb5d23e83b3 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:39.275420 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b72da98b-853e-471f-82d5-aeb5d23e83b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b27cea76de74586bcb3d981a761975d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:39.276180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b72da98b-853e-471f-82d5-aeb5d23e83b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b27cea76de74586bcb3d981a761975d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:39.371198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b72da98b-853e-471f-82d5-aeb5d23e83b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b27cea76de74586bcb3d981a761975d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:39.379134 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b72da98b-853e-471f-82d5-aeb5d23e83b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b27cea76de74586bcb3d981a761975d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:39.391097 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-b72da98b-853e-471f-82d5-aeb5d23e83b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b27cea76de74586bcb3d981a761975d'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:39.397041 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1414/2847] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:13:39 2022] DELETE /identity/v3/users/1b27cea76de74586bcb3d981a761975d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:39.827693 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285f81b-77cf-4c5c-8aad-fb1c4409e459 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:39.832878 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-3285f81b-77cf-4c5c-8aad-fb1c4409e459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:39.846719 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285f81b-77cf-4c5c-8aad-fb1c4409e459 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:39.906074 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12a846-dd44-4e89-ba57-1090ac83625e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:39.906782 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12a846-dd44-4e89-ba57-1090ac83625e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:39.907063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12a846-dd44-4e89-ba57-1090ac83625e admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:39.907368 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12a846-dd44-4e89-ba57-1090ac83625e admin admin] PATH_INFO: `/v3/projects/2f9d098c2bfb43799f420a3919b3acf3` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:39.908555 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12a846-dd44-4e89-ba57-1090ac83625e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f9d098c2bfb43799f420a3919b3acf3)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:39.910466 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12a846-dd44-4e89-ba57-1090ac83625e admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:40.028995 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ad12a846-dd44-4e89-ba57-1090ac83625e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f9d098c2bfb43799f420a3919b3acf3', 'request_id': 'req-ad12a846-dd44-4e89-ba57-1090ac83625e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:40.096569 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ad12a846-dd44-4e89-ba57-1090ac83625e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f9d098c2bfb43799f420a3919b3acf3', 'request_id': 'req-ad12a846-dd44-4e89-ba57-1090ac83625e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:40.102505 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ad12a846-dd44-4e89-ba57-1090ac83625e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f9d098c2bfb43799f420a3919b3acf3', 'request_id': 'req-ad12a846-dd44-4e89-ba57-1090ac83625e'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:40.114215 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ad12a846-dd44-4e89-ba57-1090ac83625e admin admin] The token cache is being invalidate because project 2f9d098c2bfb43799f420a3919b3acf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:13:40.114499 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ad12a846-dd44-4e89-ba57-1090ac83625e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:40.115136 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-ad12a846-dd44-4e89-ba57-1090ac83625e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:40.116665 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1434/2848] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:13:39 2022] DELETE /identity/v3/projects/2f9d098c2bfb43799f420a3919b3acf3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:40.121660 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72da98b-853e-471f-82d5-aeb5d23e83b3 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:40.123108 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b72da98b-853e-471f-82d5-aeb5d23e83b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:40.137103 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72da98b-853e-471f-82d5-aeb5d23e83b3 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:40.193467 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ededa1-b903-4b36-82b4-ce34bfd035dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:40.194115 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ededa1-b903-4b36-82b4-ce34bfd035dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:40.194403 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ededa1-b903-4b36-82b4-ce34bfd035dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:40.194682 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ededa1-b903-4b36-82b4-ce34bfd035dd admin admin] PATH_INFO: `/v3/users/9093fff49c774a6eb898d66956fc343c` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:40.195873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ededa1-b903-4b36-82b4-ce34bfd035dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9093fff49c774a6eb898d66956fc343c)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:40.198469 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ededa1-b903-4b36-82b4-ce34bfd035dd admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:40.314198 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:40.412868 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-78ededa1-b903-4b36-82b4-ce34bfd035dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9093fff49c774a6eb898d66956fc343c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:40.413463 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-78ededa1-b903-4b36-82b4-ce34bfd035dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9093fff49c774a6eb898d66956fc343c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:40.496565 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-78ededa1-b903-4b36-82b4-ce34bfd035dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9093fff49c774a6eb898d66956fc343c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:40.504279 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-78ededa1-b903-4b36-82b4-ce34bfd035dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9093fff49c774a6eb898d66956fc343c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:40.516850 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-78ededa1-b903-4b36-82b4-ce34bfd035dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9093fff49c774a6eb898d66956fc343c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:40.522760 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1415/2849] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:13:40 2022] DELETE /identity/v3/users/9093fff49c774a6eb898d66956fc343c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:40.938830 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12a846-dd44-4e89-ba57-1090ac83625e admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:40.940388 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-ad12a846-dd44-4e89-ba57-1090ac83625e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:40.953475 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12a846-dd44-4e89-ba57-1090ac83625e admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:41.010545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0567a53-df19-46c7-bdab-5e4c0e5cd468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:41.011280 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0567a53-df19-46c7-bdab-5e4c0e5cd468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:41.011591 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0567a53-df19-46c7-bdab-5e4c0e5cd468 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:41.011871 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0567a53-df19-46c7-bdab-5e4c0e5cd468 admin admin] PATH_INFO: `/v3/projects/f78a6a277eb541fe939395eb142e3f9a` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:41.013050 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0567a53-df19-46c7-bdab-5e4c0e5cd468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f78a6a277eb541fe939395eb142e3f9a)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:41.014969 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0567a53-df19-46c7-bdab-5e4c0e5cd468 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:41.025573 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:41.103840 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b0567a53-df19-46c7-bdab-5e4c0e5cd468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f78a6a277eb541fe939395eb142e3f9a', 'request_id': 'req-b0567a53-df19-46c7-bdab-5e4c0e5cd468'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:41.164997 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b0567a53-df19-46c7-bdab-5e4c0e5cd468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f78a6a277eb541fe939395eb142e3f9a', 'request_id': 'req-b0567a53-df19-46c7-bdab-5e4c0e5cd468'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:41.171131 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b0567a53-df19-46c7-bdab-5e4c0e5cd468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f78a6a277eb541fe939395eb142e3f9a', 'request_id': 'req-b0567a53-df19-46c7-bdab-5e4c0e5cd468'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:41.184398 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b0567a53-df19-46c7-bdab-5e4c0e5cd468 admin admin] The token cache is being invalidate because project f78a6a277eb541fe939395eb142e3f9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:13:41.184593 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b0567a53-df19-46c7-bdab-5e4c0e5cd468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:41.185445 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-b0567a53-df19-46c7-bdab-5e4c0e5cd468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:13:41.187009 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1435/2850] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:13:40 2022] DELETE /identity/v3/projects/f78a6a277eb541fe939395eb142e3f9a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:41.193225 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd9f7d-2194-42d4-a7e3-9e0dbd20f03c None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:41.193685 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd9f7d-2194-42d4-a7e3-9e0dbd20f03c None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:41.193816 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd9f7d-2194-42d4-a7e3-9e0dbd20f03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:41.218350 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-21cd9f7d-2194-42d4-a7e3-9e0dbd20f03c None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:41.223225 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-21cd9f7d-2194-42d4-a7e3-9e0dbd20f03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:41.284156 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1416/2851] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 04:13:41.293988 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6d7e1-5cb8-4efe-9cfc-d4f9d839a643 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:41.294277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6d7e1-5cb8-4efe-9cfc-d4f9d839a643 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:41.294554 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6d7e1-5cb8-4efe-9cfc-d4f9d839a643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:41.315193 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-87c6d7e1-5cb8-4efe-9cfc-d4f9d839a643 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:41.316477 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-87c6d7e1-5cb8-4efe-9cfc-d4f9d839a643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:41.325759 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1436/2852] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:41.330118 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd9f7d-2194-42d4-a7e3-9e0dbd20f03c None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:41.340773 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd9f7d-2194-42d4-a7e3-9e0dbd20f03c None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:41.345604 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfce5d-e0f6-4a72-9ffe-d78942998131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:41.346226 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfce5d-e0f6-4a72-9ffe-d78942998131 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:41.346509 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfce5d-e0f6-4a72-9ffe-d78942998131 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:41.346812 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfce5d-e0f6-4a72-9ffe-d78942998131 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:41.347565 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfce5d-e0f6-4a72-9ffe-d78942998131 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:13:41.347873 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfce5d-e0f6-4a72-9ffe-d78942998131 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:41.349482 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfce5d-e0f6-4a72-9ffe-d78942998131 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:41.362442 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1417/2853] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:13:41.367277 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6d7e1-5cb8-4efe-9cfc-d4f9d839a643 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:41.376856 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6d7e1-5cb8-4efe-9cfc-d4f9d839a643 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:41.381585 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d240ee4-3738-48aa-8e5d-f4b9f0d28619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:41.382195 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d240ee4-3738-48aa-8e5d-f4b9f0d28619 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:41.382470 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d240ee4-3738-48aa-8e5d-f4b9f0d28619 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:41.382740 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d240ee4-3738-48aa-8e5d-f4b9f0d28619 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:41.383435 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d240ee4-3738-48aa-8e5d-f4b9f0d28619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:41.385314 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d240ee4-3738-48aa-8e5d-f4b9f0d28619 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:41.481205 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1437/2854] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:13:41 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:13:41.485515 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfce5d-e0f6-4a72-9ffe-d78942998131 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:41.496273 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfce5d-e0f6-4a72-9ffe-d78942998131 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:41.551973 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61276a-d5bf-413f-9f30-f6d711d2becc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:41.552592 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61276a-d5bf-413f-9f30-f6d711d2becc admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:41.552875 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61276a-d5bf-413f-9f30-f6d711d2becc admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:41.553149 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61276a-d5bf-413f-9f30-f6d711d2becc admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:41.553808 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61276a-d5bf-413f-9f30-f6d711d2becc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:41.555810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61276a-d5bf-413f-9f30-f6d711d2becc admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:41.650883 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1418/2855] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:13:41 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:41.655105 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d240ee4-3738-48aa-8e5d-f4b9f0d28619 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:41.665749 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d240ee4-3738-48aa-8e5d-f4b9f0d28619 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:41.671147 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bbaf2-9992-40f6-880e-1c2b968c57bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:41.671795 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bbaf2-9992-40f6-880e-1c2b968c57bd admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:41.672076 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bbaf2-9992-40f6-880e-1c2b968c57bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:41.672364 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bbaf2-9992-40f6-880e-1c2b968c57bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:41.673046 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bbaf2-9992-40f6-880e-1c2b968c57bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:41.674676 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bbaf2-9992-40f6-880e-1c2b968c57bd admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:41.685312 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1438/2856] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:41.689284 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61276a-d5bf-413f-9f30-f6d711d2becc admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:41.699594 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61276a-d5bf-413f-9f30-f6d711d2becc admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:41.704239 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73cd6d-b348-475f-80e2-c26334e3f0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:41.704848 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73cd6d-b348-475f-80e2-c26334e3f0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:41.705136 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73cd6d-b348-475f-80e2-c26334e3f0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:41.705416 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73cd6d-b348-475f-80e2-c26334e3f0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:41.706112 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73cd6d-b348-475f-80e2-c26334e3f0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:41.707823 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73cd6d-b348-475f-80e2-c26334e3f0e5 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:41.718683 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1419/2857] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:41.722803 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bbaf2-9992-40f6-880e-1c2b968c57bd admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:41.733591 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bbaf2-9992-40f6-880e-1c2b968c57bd admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:41.738415 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb82f6c-5b81-455d-9bd3-078c790ed284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:41.738890 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb82f6c-5b81-455d-9bd3-078c790ed284 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:41.739175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb82f6c-5b81-455d-9bd3-078c790ed284 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:41.739499 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb82f6c-5b81-455d-9bd3-078c790ed284 admin admin] PATH_INFO: `/v3/projects/83975fdf524e49d39baf1236121fe713/users/e6d7f03d8f5d441e8a3e48947c240333/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:41.755600 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb82f6c-5b81-455d-9bd3-078c790ed284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83975fdf524e49d39baf1236121fe713, user_id=e6d7f03d8f5d441e8a3e48947c240333, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:41.758309 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb82f6c-5b81-455d-9bd3-078c790ed284 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:41.862661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1439/2858] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:13:41 2022] PUT /identity/v3/projects/83975fdf524e49d39baf1236121fe713/users/e6d7f03d8f5d441e8a3e48947c240333/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:41.867966 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267a152-abd4-4724-ad01-b3b43623846e None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:41.868280 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267a152-abd4-4724-ad01-b3b43623846e None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:41.868616 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267a152-abd4-4724-ad01-b3b43623846e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:41.887964 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-4267a152-abd4-4724-ad01-b3b43623846e None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:41.889176 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-4267a152-abd4-4724-ad01-b3b43623846e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:41.893168 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:41.950104 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1420/2859] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:41.959766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb82f6c-5b81-455d-9bd3-078c790ed284 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:41.961464 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-dbb82f6c-5b81-455d-9bd3-078c790ed284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:42.021648 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb82f6c-5b81-455d-9bd3-078c790ed284 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:42.025225 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61d99b-f82a-4c29-bb89-5517a338b16d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:42.025859 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61d99b-f82a-4c29-bb89-5517a338b16d service neutron] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:42.026143 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61d99b-f82a-4c29-bb89-5517a338b16d service neutron] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:42.026419 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61d99b-f82a-4c29-bb89-5517a338b16d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:42.035684 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61d99b-f82a-4c29-bb89-5517a338b16d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:42.037123 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f61d99b-f82a-4c29-bb89-5517a338b16d service neutron] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:42.046626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1440/2860] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:43.309592 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2065d-5fec-4c4a-aeb9-0015f0a1d02e None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:43.315496 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2065d-5fec-4c4a-aeb9-0015f0a1d02e None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:43.315496 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2065d-5fec-4c4a-aeb9-0015f0a1d02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:43.337611 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-65d2065d-5fec-4c4a-aeb9-0015f0a1d02e None None] MFA Rules not processed for user `e6d7f03d8f5d441e8a3e48947c240333`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:43.339522 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-65d2065d-5fec-4c4a-aeb9-0015f0a1d02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:43.408574 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1421/2861] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:43.413489 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61d99b-f82a-4c29-bb89-5517a338b16d service neutron] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:43.424044 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61d99b-f82a-4c29-bb89-5517a338b16d service neutron] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:43.428465 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bec8b-b08c-444b-a637-6b49cc923e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:43.429067 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bec8b-b08c-444b-a637-6b49cc923e70 admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:43.429359 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bec8b-b08c-444b-a637-6b49cc923e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:43.429614 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bec8b-b08c-444b-a637-6b49cc923e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:43.430275 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bec8b-b08c-444b-a637-6b49cc923e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:43.432213 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bec8b-b08c-444b-a637-6b49cc923e70 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:43.520979 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1441/2862] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:13:43 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:43.525045 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2065d-5fec-4c4a-aeb9-0015f0a1d02e None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:43.536896 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2065d-5fec-4c4a-aeb9-0015f0a1d02e None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:43.592809 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e68f2e-29b6-4267-9f6f-d37cdf652abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:43.593447 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e68f2e-29b6-4267-9f6f-d37cdf652abe admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:43.593729 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e68f2e-29b6-4267-9f6f-d37cdf652abe admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:43.594011 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e68f2e-29b6-4267-9f6f-d37cdf652abe admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:43.594681 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e68f2e-29b6-4267-9f6f-d37cdf652abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:43.596804 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e68f2e-29b6-4267-9f6f-d37cdf652abe admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:43.696558 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1422/2863] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:13:43 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:13:43.701210 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bec8b-b08c-444b-a637-6b49cc923e70 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:43.711555 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bec8b-b08c-444b-a637-6b49cc923e70 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:43.716846 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4ad2b-36a6-40a8-bac8-b9ab03d2179e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:43.717505 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4ad2b-36a6-40a8-bac8-b9ab03d2179e admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:43.717780 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4ad2b-36a6-40a8-bac8-b9ab03d2179e admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:43.718054 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4ad2b-36a6-40a8-bac8-b9ab03d2179e admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:43.718765 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4ad2b-36a6-40a8-bac8-b9ab03d2179e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:43.720391 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4ad2b-36a6-40a8-bac8-b9ab03d2179e admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:43.731479 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1442/2864] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:43.735822 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e68f2e-29b6-4267-9f6f-d37cdf652abe admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:43.746560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e68f2e-29b6-4267-9f6f-d37cdf652abe admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:43.751560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45f86c-768e-4a9e-b198-185f84fddd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:43.752224 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45f86c-768e-4a9e-b198-185f84fddd43 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:43.752509 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45f86c-768e-4a9e-b198-185f84fddd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:43.752788 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45f86c-768e-4a9e-b198-185f84fddd43 admin admin] PATH_INFO: `/v3/projects/0659ba1a0c0e4bbcaf226f7371d6a6c9/users/c55785451b8540ee9e55fc0a88e2549c/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:43.768688 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45f86c-768e-4a9e-b198-185f84fddd43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0659ba1a0c0e4bbcaf226f7371d6a6c9, user_id=c55785451b8540ee9e55fc0a88e2549c, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:43.771459 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45f86c-768e-4a9e-b198-185f84fddd43 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:43.845796 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1423/2865] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:13:43 2022] PUT /identity/v3/projects/0659ba1a0c0e4bbcaf226f7371d6a6c9/users/c55785451b8540ee9e55fc0a88e2549c/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:43.849921 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4ad2b-36a6-40a8-bac8-b9ab03d2179e admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:43.857073 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:43.861049 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4ad2b-36a6-40a8-bac8-b9ab03d2179e admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:43.917206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5aec25-6450-455e-a2b6-365698d8f865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:43.918363 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5aec25-6450-455e-a2b6-365698d8f865 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:43.918853 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5aec25-6450-455e-a2b6-365698d8f865 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:43.919388 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5aec25-6450-455e-a2b6-365698d8f865 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:43.920498 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5aec25-6450-455e-a2b6-365698d8f865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:43.922179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5aec25-6450-455e-a2b6-365698d8f865 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:43.932056 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1443/2866] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:13:43.937427 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45f86c-768e-4a9e-b198-185f84fddd43 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:43.944282 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:43.948238 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45f86c-768e-4a9e-b198-185f84fddd43 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:43.953237 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673ed93-016f-4930-b8cf-7b757c6df385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:43.955389 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673ed93-016f-4930-b8cf-7b757c6df385 admin admin] REQUEST_METHOD: `PUT` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:43.955389 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673ed93-016f-4930-b8cf-7b757c6df385 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:43.955389 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673ed93-016f-4930-b8cf-7b757c6df385 admin admin] PATH_INFO: `/v3/projects/0659ba1a0c0e4bbcaf226f7371d6a6c9/users/c55785451b8540ee9e55fc0a88e2549c/roles/8a5766c4aef44773834941d1bdbd1e98` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:43.957055 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673ed93-016f-4930-b8cf-7b757c6df385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0659ba1a0c0e4bbcaf226f7371d6a6c9, user_id=c55785451b8540ee9e55fc0a88e2549c, role_id=8a5766c4aef44773834941d1bdbd1e98)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:43.959782 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673ed93-016f-4930-b8cf-7b757c6df385 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:43.970264 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1424/2867] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:13:43 2022] PUT /identity/v3/projects/0659ba1a0c0e4bbcaf226f7371d6a6c9/users/c55785451b8540ee9e55fc0a88e2549c/roles/8a5766c4aef44773834941d1bdbd1e98 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:13:45.143485 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac517b-d903-4083-891f-a52dcd52d478 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:45.144061 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac517b-d903-4083-891f-a52dcd52d478 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:45.144061 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac517b-d903-4083-891f-a52dcd52d478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:45.174915 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-e6ac517b-d903-4083-891f-a52dcd52d478 None None] MFA Rules not processed for user `c55785451b8540ee9e55fc0a88e2549c`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:45.176172 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e6ac517b-d903-4083-891f-a52dcd52d478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:45.247661 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1444/2868] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:45 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:45.260518 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64531b48-531c-45de-a857-81c845bcdb9a None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:45.261302 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64531b48-531c-45de-a857-81c845bcdb9a None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:45.261639 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64531b48-531c-45de-a857-81c845bcdb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:45.281657 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-64531b48-531c-45de-a857-81c845bcdb9a None None] MFA Rules not processed for user `e6d7f03d8f5d441e8a3e48947c240333`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:13:45.282978 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-64531b48-531c-45de-a857-81c845bcdb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:45.337980 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1425/2869] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:13:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:13:45.349809 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac517b-d903-4083-891f-a52dcd52d478 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:45.351248 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-e6ac517b-d903-4083-891f-a52dcd52d478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:45.425374 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac517b-d903-4083-891f-a52dcd52d478 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:45.430951 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3d3be-c91f-402e-9a81-a643de837df9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:45.431721 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3d3be-c91f-402e-9a81-a643de837df9 service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:45.432000 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3d3be-c91f-402e-9a81-a643de837df9 service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:45.433053 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3d3be-c91f-402e-9a81-a643de837df9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:45.440863 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3d3be-c91f-402e-9a81-a643de837df9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:45.442490 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3d3be-c91f-402e-9a81-a643de837df9 service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:45.452064 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1445/2870] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:13:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:45.702107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64531b48-531c-45de-a857-81c845bcdb9a None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:45.703639 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-64531b48-531c-45de-a857-81c845bcdb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:45.761051 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64531b48-531c-45de-a857-81c845bcdb9a None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:45.764776 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51553cc-7782-4868-9ccb-f04b314bcd30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:45.765400 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51553cc-7782-4868-9ccb-f04b314bcd30 service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:45.765680 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51553cc-7782-4868-9ccb-f04b314bcd30 service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:45.765952 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51553cc-7782-4868-9ccb-f04b314bcd30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:45.767801 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-b51553cc-7782-4868-9ccb-f04b314bcd30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:45.778240 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51553cc-7782-4868-9ccb-f04b314bcd30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:45.779731 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51553cc-7782-4868-9ccb-f04b314bcd30 service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:45.788579 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1426/2871] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:13:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:48.246526 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3d3be-c91f-402e-9a81-a643de837df9 service nova] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:48.248627 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-a0e3d3be-c91f-402e-9a81-a643de837df9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:48.262365 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=100 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:48.320322 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3d3be-c91f-402e-9a81-a643de837df9 service nova] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:48.325797 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09166f8a-b517-456a-ad35-1dfaf486cebe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f2584622a48bba21e1bf31c1aef30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:48.326545 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09166f8a-b517-456a-ad35-1dfaf486cebe service placement] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:48.326831 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09166f8a-b517-456a-ad35-1dfaf486cebe service placement] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:48.327110 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09166f8a-b517-456a-ad35-1dfaf486cebe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:48.328947 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-09166f8a-b517-456a-ad35-1dfaf486cebe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:48.341175 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09166f8a-b517-456a-ad35-1dfaf486cebe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:48.343258 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09166f8a-b517-456a-ad35-1dfaf486cebe service placement] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:48.354435 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1446/2872] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:13:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:54.378810 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51553cc-7782-4868-9ccb-f04b314bcd30 service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:54.387549 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51553cc-7782-4868-9ccb-f04b314bcd30 service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:54.391798 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25187a0b-e72a-495b-a1ec-999aefd1769a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:54.392412 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25187a0b-e72a-495b-a1ec-999aefd1769a service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:54.392696 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25187a0b-e72a-495b-a1ec-999aefd1769a service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:54.392974 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25187a0b-e72a-495b-a1ec-999aefd1769a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:54.394744 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-25187a0b-e72a-495b-a1ec-999aefd1769a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:54.405135 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25187a0b-e72a-495b-a1ec-999aefd1769a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:54.406570 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25187a0b-e72a-495b-a1ec-999aefd1769a service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:54.414631 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1427/2873] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:13:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:13:55.230472 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09166f8a-b517-456a-ad35-1dfaf486cebe service placement] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:13:55.232165 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-09166f8a-b517-456a-ad35-1dfaf486cebe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:55.248844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09166f8a-b517-456a-ad35-1dfaf486cebe service placement] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:13:55.254517 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b1900-6d80-4d73-b534-d18a885a51b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:13:55.255135 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b1900-6d80-4d73-b534-d18a885a51b6 service nova] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:13:55.255446 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b1900-6d80-4d73-b534-d18a885a51b6 service nova] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:13:55.255724 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b1900-6d80-4d73-b534-d18a885a51b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:13:55.257453 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f00b1900-6d80-4d73-b534-d18a885a51b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:13:55.270131 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b1900-6d80-4d73-b534-d18a885a51b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:13:55.274657 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b1900-6d80-4d73-b534-d18a885a51b6 service nova] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:13:55.283187 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1447/2874] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:13:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:14:00.964942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25187a0b-e72a-495b-a1ec-999aefd1769a service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:00.978846 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25187a0b-e72a-495b-a1ec-999aefd1769a service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:00.984351 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d4d71-3630-4d20-95da-bbfeb734c966 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5133abf4c32a45b0b2188f71496c572b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:00.984957 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d4d71-3630-4d20-95da-bbfeb734c966 service nova] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:00.985237 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d4d71-3630-4d20-95da-bbfeb734c966 service nova] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:00.985520 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d4d71-3630-4d20-95da-bbfeb734c966 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:00.987265 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-696d4d71-3630-4d20-95da-bbfeb734c966 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:01.000691 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d4d71-3630-4d20-95da-bbfeb734c966 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:01.002323 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d4d71-3630-4d20-95da-bbfeb734c966 service nova] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:01.013321 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1428/2875] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:14:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:14:05.277986 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=33 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:05.487799 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b1900-6d80-4d73-b534-d18a885a51b6 service nova] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:05.490820 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f00b1900-6d80-4d73-b534-d18a885a51b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:05.547204 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b1900-6d80-4d73-b534-d18a885a51b6 service nova] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:05.551111 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc85442-e5d9-497e-939e-c04464750d62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:05.551772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85442-e5d9-497e-939e-c04464750d62 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:05.552052 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85442-e5d9-497e-939e-c04464750d62 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:05.552330 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85442-e5d9-497e-939e-c04464750d62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:05.561587 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc85442-e5d9-497e-939e-c04464750d62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:05.576939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc85442-e5d9-497e-939e-c04464750d62 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:05.576939 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1448/2876] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:14:05 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:14:11.008673 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=66,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:15.568369 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=26 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:28.987256 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d4d71-3630-4d20-95da-bbfeb734c966 service nova] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:29.053296 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d4d71-3630-4d20-95da-bbfeb734c966 service nova] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:29.061473 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0585a2f-d4f8-46fd-a9df-1ce1a98498e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:29.062587 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0585a2f-d4f8-46fd-a9df-1ce1a98498e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:29.063092 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0585a2f-d4f8-46fd-a9df-1ce1a98498e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:29.063637 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0585a2f-d4f8-46fd-a9df-1ce1a98498e6 admin admin] PATH_INFO: `/v3/users/e6d7f03d8f5d441e8a3e48947c240333` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:29.065711 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0585a2f-d4f8-46fd-a9df-1ce1a98498e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d7f03d8f5d441e8a3e48947c240333)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:29.069552 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0585a2f-d4f8-46fd-a9df-1ce1a98498e6 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:29.228051 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c0585a2f-d4f8-46fd-a9df-1ce1a98498e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d7f03d8f5d441e8a3e48947c240333'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:29.228976 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c0585a2f-d4f8-46fd-a9df-1ce1a98498e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d7f03d8f5d441e8a3e48947c240333'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:29.278028 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c0585a2f-d4f8-46fd-a9df-1ce1a98498e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d7f03d8f5d441e8a3e48947c240333'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:29.285965 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c0585a2f-d4f8-46fd-a9df-1ce1a98498e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d7f03d8f5d441e8a3e48947c240333'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:29.298053 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-c0585a2f-d4f8-46fd-a9df-1ce1a98498e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d7f03d8f5d441e8a3e48947c240333'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:29.304087 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1429/2877] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:14:28 2022] DELETE /identity/v3/users/e6d7f03d8f5d441e8a3e48947c240333 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:29.575843 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc85442-e5d9-497e-939e-c04464750d62 service cinder] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:29.589406 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc85442-e5d9-497e-939e-c04464750d62 service cinder] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:29.647766 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aca97-2973-48b3-9ca2-2ddf9b009323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:29.648420 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aca97-2973-48b3-9ca2-2ddf9b009323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:29.648700 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aca97-2973-48b3-9ca2-2ddf9b009323 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:29.649004 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aca97-2973-48b3-9ca2-2ddf9b009323 admin admin] PATH_INFO: `/v3/projects/83975fdf524e49d39baf1236121fe713` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:29.650191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11aca97-2973-48b3-9ca2-2ddf9b009323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83975fdf524e49d39baf1236121fe713)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:29.652238 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11aca97-2973-48b3-9ca2-2ddf9b009323 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:29.780063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-c11aca97-2973-48b3-9ca2-2ddf9b009323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83975fdf524e49d39baf1236121fe713', 'request_id': 'req-c11aca97-2973-48b3-9ca2-2ddf9b009323'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:29.872606 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-c11aca97-2973-48b3-9ca2-2ddf9b009323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83975fdf524e49d39baf1236121fe713', 'request_id': 'req-c11aca97-2973-48b3-9ca2-2ddf9b009323'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:29.879252 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-c11aca97-2973-48b3-9ca2-2ddf9b009323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83975fdf524e49d39baf1236121fe713', 'request_id': 'req-c11aca97-2973-48b3-9ca2-2ddf9b009323'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:29.891409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-c11aca97-2973-48b3-9ca2-2ddf9b009323 admin admin] The token cache is being invalidate because project 83975fdf524e49d39baf1236121fe713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:14:29.891698 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-c11aca97-2973-48b3-9ca2-2ddf9b009323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:29.892405 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-c11aca97-2973-48b3-9ca2-2ddf9b009323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:29.893927 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1449/2878] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:14:29 2022] DELETE /identity/v3/projects/83975fdf524e49d39baf1236121fe713 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:29.897864 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0585a2f-d4f8-46fd-a9df-1ce1a98498e6 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:29.899357 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-c0585a2f-d4f8-46fd-a9df-1ce1a98498e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:29.912823 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0585a2f-d4f8-46fd-a9df-1ce1a98498e6 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:29.970145 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68311d8-fada-4951-9f21-2a0009a7b6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:29.970792 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68311d8-fada-4951-9f21-2a0009a7b6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:29.971076 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68311d8-fada-4951-9f21-2a0009a7b6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:29.971374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68311d8-fada-4951-9f21-2a0009a7b6bf admin admin] PATH_INFO: `/v3/users/c55785451b8540ee9e55fc0a88e2549c` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:29.972560 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68311d8-fada-4951-9f21-2a0009a7b6bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c55785451b8540ee9e55fc0a88e2549c)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:29.974479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68311d8-fada-4951-9f21-2a0009a7b6bf admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:29.996824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:30.195421 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-a68311d8-fada-4951-9f21-2a0009a7b6bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c55785451b8540ee9e55fc0a88e2549c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:30.196055 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-a68311d8-fada-4951-9f21-2a0009a7b6bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c55785451b8540ee9e55fc0a88e2549c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:30.255007 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-a68311d8-fada-4951-9f21-2a0009a7b6bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c55785451b8540ee9e55fc0a88e2549c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:30.262540 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-a68311d8-fada-4951-9f21-2a0009a7b6bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c55785451b8540ee9e55fc0a88e2549c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:30.274397 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-a68311d8-fada-4951-9f21-2a0009a7b6bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c55785451b8540ee9e55fc0a88e2549c'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:30.280481 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1430/2879] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:14:29 2022] DELETE /identity/v3/users/c55785451b8540ee9e55fc0a88e2549c => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:30.531535 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aca97-2973-48b3-9ca2-2ddf9b009323 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:30.533289 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-c11aca97-2973-48b3-9ca2-2ddf9b009323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:30.548097 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aca97-2973-48b3-9ca2-2ddf9b009323 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:30.606464 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf56822-72ac-4b36-bea1-89c09622ff13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:30.607123 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf56822-72ac-4b36-bea1-89c09622ff13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.607409 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf56822-72ac-4b36-bea1-89c09622ff13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.607683 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf56822-72ac-4b36-bea1-89c09622ff13 admin admin] PATH_INFO: `/v3/projects/0659ba1a0c0e4bbcaf226f7371d6a6c9` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.609006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf56822-72ac-4b36-bea1-89c09622ff13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0659ba1a0c0e4bbcaf226f7371d6a6c9)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:30.611006 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf56822-72ac-4b36-bea1-89c09622ff13 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:30.700757 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:30.712068 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-8bf56822-72ac-4b36-bea1-89c09622ff13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0659ba1a0c0e4bbcaf226f7371d6a6c9', 'request_id': 'req-8bf56822-72ac-4b36-bea1-89c09622ff13'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:30.790796 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-8bf56822-72ac-4b36-bea1-89c09622ff13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0659ba1a0c0e4bbcaf226f7371d6a6c9', 'request_id': 'req-8bf56822-72ac-4b36-bea1-89c09622ff13'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:30.797606 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-8bf56822-72ac-4b36-bea1-89c09622ff13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0659ba1a0c0e4bbcaf226f7371d6a6c9', 'request_id': 'req-8bf56822-72ac-4b36-bea1-89c09622ff13'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:30.809237 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-8bf56822-72ac-4b36-bea1-89c09622ff13 admin admin] The token cache is being invalidate because project 0659ba1a0c0e4bbcaf226f7371d6a6c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:14:30.809527 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-8bf56822-72ac-4b36-bea1-89c09622ff13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:30.810180 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-8bf56822-72ac-4b36-bea1-89c09622ff13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:30.811760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1450/2880] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:14:30 2022] DELETE /identity/v3/projects/0659ba1a0c0e4bbcaf226f7371d6a6c9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:30.817750 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e07e2-e5f9-48c1-9836-110da7d09161 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.822717 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e07e2-e5f9-48c1-9836-110da7d09161 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.822717 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e07e2-e5f9-48c1-9836-110da7d09161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.839338 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-445e07e2-e5f9-48c1-9836-110da7d09161 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:30.840645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-445e07e2-e5f9-48c1-9836-110da7d09161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:30.904899 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1431/2881] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:14:30.913183 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02fb5e-5407-4646-8f5a-a129bb90c0bc None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.913474 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02fb5e-5407-4646-8f5a-a129bb90c0bc None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.913752 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02fb5e-5407-4646-8f5a-a129bb90c0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.933620 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-5e02fb5e-5407-4646-8f5a-a129bb90c0bc None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:30.934834 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-5e02fb5e-5407-4646-8f5a-a129bb90c0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:30.942681 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1451/2882] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:14:30.947611 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e07e2-e5f9-48c1-9836-110da7d09161 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:30.957737 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e07e2-e5f9-48c1-9836-110da7d09161 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:30.962170 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d841c14-83fc-445b-8b91-68ed6c1a10da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:30.963933 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d841c14-83fc-445b-8b91-68ed6c1a10da admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.964236 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d841c14-83fc-445b-8b91-68ed6c1a10da admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.964491 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d841c14-83fc-445b-8b91-68ed6c1a10da admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.965180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d841c14-83fc-445b-8b91-68ed6c1a10da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:14:30.965480 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d841c14-83fc-445b-8b91-68ed6c1a10da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:30.967070 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d841c14-83fc-445b-8b91-68ed6c1a10da admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:30.978928 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1432/2883] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:14:30.982785 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02fb5e-5407-4646-8f5a-a129bb90c0bc None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:30.992132 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02fb5e-5407-4646-8f5a-a129bb90c0bc None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:30.996992 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c092d-d899-4dea-8a96-132cd731e30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:30.997626 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c092d-d899-4dea-8a96-132cd731e30e admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:30.997904 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c092d-d899-4dea-8a96-132cd731e30e admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:30.998176 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c092d-d899-4dea-8a96-132cd731e30e admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:30.998844 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c092d-d899-4dea-8a96-132cd731e30e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:31.001063 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c092d-d899-4dea-8a96-132cd731e30e admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:31.114351 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1452/2884] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:14:30 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:14:31.118644 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d841c14-83fc-445b-8b91-68ed6c1a10da admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:31.129793 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d841c14-83fc-445b-8b91-68ed6c1a10da admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:31.187831 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9930c-a691-4c76-bcc0-4b7ce303e2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:31.188453 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9930c-a691-4c76-bcc0-4b7ce303e2cd admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:31.188736 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9930c-a691-4c76-bcc0-4b7ce303e2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:31.189013 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9930c-a691-4c76-bcc0-4b7ce303e2cd admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:31.189679 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9930c-a691-4c76-bcc0-4b7ce303e2cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:31.191619 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9930c-a691-4c76-bcc0-4b7ce303e2cd admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:31.261194 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1433/2885] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:14:31 2022] POST /identity/v3/users => generated 285 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:14:31.265542 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c092d-d899-4dea-8a96-132cd731e30e admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:31.276513 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c092d-d899-4dea-8a96-132cd731e30e admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:31.281214 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924d634-85a4-49c0-be63-6d056096a628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:31.281828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924d634-85a4-49c0-be63-6d056096a628 admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:31.282111 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924d634-85a4-49c0-be63-6d056096a628 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:31.282385 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924d634-85a4-49c0-be63-6d056096a628 admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:31.283083 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924d634-85a4-49c0-be63-6d056096a628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:31.284761 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924d634-85a4-49c0-be63-6d056096a628 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:31.297946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1453/2886] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:14:31.302206 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9930c-a691-4c76-bcc0-4b7ce303e2cd admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:31.312752 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9930c-a691-4c76-bcc0-4b7ce303e2cd admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:31.317475 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6941545-a68d-4dfe-9f0f-957bab56cb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:31.318090 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6941545-a68d-4dfe-9f0f-957bab56cb02 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:31.318376 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6941545-a68d-4dfe-9f0f-957bab56cb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:31.318716 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6941545-a68d-4dfe-9f0f-957bab56cb02 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:31.319479 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6941545-a68d-4dfe-9f0f-957bab56cb02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:31.321073 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6941545-a68d-4dfe-9f0f-957bab56cb02 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:31.331922 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1434/2887] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:14:31.336340 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924d634-85a4-49c0-be63-6d056096a628 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:31.347142 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924d634-85a4-49c0-be63-6d056096a628 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:31.352256 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7b522-59cb-45ef-9283-d22448418b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:31.352926 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7b522-59cb-45ef-9283-d22448418b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:31.353209 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7b522-59cb-45ef-9283-d22448418b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:31.354079 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7b522-59cb-45ef-9283-d22448418b8c admin admin] PATH_INFO: `/v3/projects/f32a511d04f94fb7849a3c522118f265/users/40db0b4b4c594b6990059caa72a6c364/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:31.368456 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7b522-59cb-45ef-9283-d22448418b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f32a511d04f94fb7849a3c522118f265, user_id=40db0b4b4c594b6990059caa72a6c364, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:31.371049 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7b522-59cb-45ef-9283-d22448418b8c admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:31.438223 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1454/2888] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:14:31 2022] PUT /identity/v3/projects/f32a511d04f94fb7849a3c522118f265/users/40db0b4b4c594b6990059caa72a6c364/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:31.459259 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea5b3c-e4d7-41d9-8a55-1ebc2a24d693 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:31.459594 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea5b3c-e4d7-41d9-8a55-1ebc2a24d693 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:31.459871 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea5b3c-e4d7-41d9-8a55-1ebc2a24d693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:31.469278 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:31.490037 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-faea5b3c-e4d7-41d9-8a55-1ebc2a24d693 None None] MFA Rules not processed for user `40db0b4b4c594b6990059caa72a6c364`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:31.491309 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-faea5b3c-e4d7-41d9-8a55-1ebc2a24d693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:31.556015 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1435/2889] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:14:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:14:31.567703 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7b522-59cb-45ef-9283-d22448418b8c admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:31.569392 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-17e7b522-59cb-45ef-9283-d22448418b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:31.649217 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7b522-59cb-45ef-9283-d22448418b8c admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:31.653883 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee930c09-4396-4ad0-a267-11cc1995f493 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bfc1fe981424313aecce5af443c8a9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:31.654499 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee930c09-4396-4ad0-a267-11cc1995f493 service glance] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:31.654773 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee930c09-4396-4ad0-a267-11cc1995f493 service glance] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:31.655042 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee930c09-4396-4ad0-a267-11cc1995f493 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:31.663341 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee930c09-4396-4ad0-a267-11cc1995f493 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:31.664767 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee930c09-4396-4ad0-a267-11cc1995f493 service glance] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:31.673946 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1455/2890] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:14:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:14:41.579180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=30 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:41.670005 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=74,keystone:DELETE=5,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:56.120163 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea5b3c-e4d7-41d9-8a55-1ebc2a24d693 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:56.181381 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea5b3c-e4d7-41d9-8a55-1ebc2a24d693 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:56.185914 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ebfea-d798-472b-b2cb-13d3edb3b0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:56.186558 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ebfea-d798-472b-b2cb-13d3edb3b0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:56.186840 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ebfea-d798-472b-b2cb-13d3edb3b0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:56.187117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ebfea-d798-472b-b2cb-13d3edb3b0e6 admin admin] PATH_INFO: `/v3/users/40db0b4b4c594b6990059caa72a6c364` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:56.188311 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ebfea-d798-472b-b2cb-13d3edb3b0e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40db0b4b4c594b6990059caa72a6c364)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:56.190234 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ebfea-d798-472b-b2cb-13d3edb3b0e6 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:56.372120 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5f5ebfea-d798-472b-b2cb-13d3edb3b0e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40db0b4b4c594b6990059caa72a6c364'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:56.372740 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5f5ebfea-d798-472b-b2cb-13d3edb3b0e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40db0b4b4c594b6990059caa72a6c364'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:56.449020 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5f5ebfea-d798-472b-b2cb-13d3edb3b0e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40db0b4b4c594b6990059caa72a6c364'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:56.456474 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5f5ebfea-d798-472b-b2cb-13d3edb3b0e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40db0b4b4c594b6990059caa72a6c364'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:56.469310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-5f5ebfea-d798-472b-b2cb-13d3edb3b0e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40db0b4b4c594b6990059caa72a6c364'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:56.475575 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1436/2891] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:14:56 2022] DELETE /identity/v3/users/40db0b4b4c594b6990059caa72a6c364 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:56.480244 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cb9ba-43f2-426b-8e02-fe3b5619eea6 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:56.481033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cb9ba-43f2-426b-8e02-fe3b5619eea6 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:56.481033 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cb9ba-43f2-426b-8e02-fe3b5619eea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:56.500845 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-375cb9ba-43f2-426b-8e02-fe3b5619eea6 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:56.502056 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-375cb9ba-43f2-426b-8e02-fe3b5619eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:56.561532 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1456/2892] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:14:56.572246 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ebfea-d798-472b-b2cb-13d3edb3b0e6 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:56.573762 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-5f5ebfea-d798-472b-b2cb-13d3edb3b0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:56.631209 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ebfea-d798-472b-b2cb-13d3edb3b0e6 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:56.634733 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497a188-17e9-4611-bf43-2a23f4d8531f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:56.635370 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497a188-17e9-4611-bf43-2a23f4d8531f service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:56.635650 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497a188-17e9-4611-bf43-2a23f4d8531f service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:56.635922 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497a188-17e9-4611-bf43-2a23f4d8531f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:56.644817 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497a188-17e9-4611-bf43-2a23f4d8531f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:56.646967 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497a188-17e9-4611-bf43-2a23f4d8531f service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:56.656418 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1437/2893] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:14:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:14:57.055079 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cb9ba-43f2-426b-8e02-fe3b5619eea6 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:57.056700 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-375cb9ba-43f2-426b-8e02-fe3b5619eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:57.070187 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cb9ba-43f2-426b-8e02-fe3b5619eea6 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:57.074983 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190dbff-a7ab-41cd-ac10-930a3ec8396d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:57.075852 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190dbff-a7ab-41cd-ac10-930a3ec8396d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:57.076150 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190dbff-a7ab-41cd-ac10-930a3ec8396d admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:57.076406 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190dbff-a7ab-41cd-ac10-930a3ec8396d admin admin] PATH_INFO: `/v3/projects/f32a511d04f94fb7849a3c522118f265` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:57.077807 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190dbff-a7ab-41cd-ac10-930a3ec8396d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f32a511d04f94fb7849a3c522118f265)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:57.079827 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190dbff-a7ab-41cd-ac10-930a3ec8396d admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:57.203299 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4190dbff-a7ab-41cd-ac10-930a3ec8396d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f32a511d04f94fb7849a3c522118f265', 'request_id': 'req-4190dbff-a7ab-41cd-ac10-930a3ec8396d'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:57.275675 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4190dbff-a7ab-41cd-ac10-930a3ec8396d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f32a511d04f94fb7849a3c522118f265', 'request_id': 'req-4190dbff-a7ab-41cd-ac10-930a3ec8396d'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:57.282016 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4190dbff-a7ab-41cd-ac10-930a3ec8396d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f32a511d04f94fb7849a3c522118f265', 'request_id': 'req-4190dbff-a7ab-41cd-ac10-930a3ec8396d'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:57.293566 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4190dbff-a7ab-41cd-ac10-930a3ec8396d admin admin] The token cache is being invalidate because project f32a511d04f94fb7849a3c522118f265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:14:57.293851 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4190dbff-a7ab-41cd-ac10-930a3ec8396d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:57.294486 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-4190dbff-a7ab-41cd-ac10-930a3ec8396d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:14:57.296099 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1457/2894] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:14:57 2022] DELETE /identity/v3/projects/f32a511d04f94fb7849a3c522118f265 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:57.301824 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72bb43-b5a3-4e80-ba34-09f50be2f112 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:57.306615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72bb43-b5a3-4e80-ba34-09f50be2f112 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:57.306615 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72bb43-b5a3-4e80-ba34-09f50be2f112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:57.322090 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-2a72bb43-b5a3-4e80-ba34-09f50be2f112 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:57.323295 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-2a72bb43-b5a3-4e80-ba34-09f50be2f112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:57.341130 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:57.385937 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1438/2895] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:14:57.393920 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbee5d-c062-4738-ba75-44c97db090a2 None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:57.394206 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbee5d-c062-4738-ba75-44c97db090a2 None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:57.394482 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbee5d-c062-4738-ba75-44c97db090a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:57.414972 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-27dbee5d-c062-4738-ba75-44c97db090a2 None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:57.416330 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-27dbee5d-c062-4738-ba75-44c97db090a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:57.424179 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1458/2896] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:14:57.429051 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72bb43-b5a3-4e80-ba34-09f50be2f112 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:57.438676 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72bb43-b5a3-4e80-ba34-09f50be2f112 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:57.443369 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a06658-6757-4305-b63d-80bec3d1a362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:57.447059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a06658-6757-4305-b63d-80bec3d1a362 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:57.447059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a06658-6757-4305-b63d-80bec3d1a362 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:57.447059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a06658-6757-4305-b63d-80bec3d1a362 admin admin] PATH_INFO: `/v3/domains` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:57.447059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a06658-6757-4305-b63d-80bec3d1a362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86894) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 04:14:57.447059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a06658-6757-4305-b63d-80bec3d1a362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:57.447059 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a06658-6757-4305-b63d-80bec3d1a362 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:57.459277 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1439/2897] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Jul 28 04:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 04:14:57.463572 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbee5d-c062-4738-ba75-44c97db090a2 None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:57.473524 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbee5d-c062-4738-ba75-44c97db090a2 None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:57.479867 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd64c2-79c5-4182-a358-d20496950e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:57.480548 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd64c2-79c5-4182-a358-d20496950e7c admin admin] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:57.481185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd64c2-79c5-4182-a358-d20496950e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:57.481185 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd64c2-79c5-4182-a358-d20496950e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:57.481772 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd64c2-79c5-4182-a358-d20496950e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:57.483714 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd64c2-79c5-4182-a358-d20496950e7c admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:57.591874 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1459/2898] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Jul 28 04:14:57 2022] POST /identity/v3/projects => generated 389 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 04:14:57.596203 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a06658-6757-4305-b63d-80bec3d1a362 admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:57.607431 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a06658-6757-4305-b63d-80bec3d1a362 admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:57.666568 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b889b-7496-49aa-8449-934f516d8f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:57.667207 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b889b-7496-49aa-8449-934f516d8f9e admin admin] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:57.667528 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b889b-7496-49aa-8449-934f516d8f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:57.667815 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b889b-7496-49aa-8449-934f516d8f9e admin admin] PATH_INFO: `/v3/users` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:57.668502 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b889b-7496-49aa-8449-934f516d8f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:57.670433 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b889b-7496-49aa-8449-934f516d8f9e admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:57.797686 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1440/2899] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 28 04:14:57 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 04:14:57.802476 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd64c2-79c5-4182-a358-d20496950e7c admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:57.812710 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd64c2-79c5-4182-a358-d20496950e7c admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:57.818430 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc7531-3c20-4432-bf65-18d130ab577e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:57.819119 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc7531-3c20-4432-bf65-18d130ab577e admin admin] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:57.819428 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc7531-3c20-4432-bf65-18d130ab577e admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:57.819702 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc7531-3c20-4432-bf65-18d130ab577e admin admin] PATH_INFO: `/v3/roles` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:57.820388 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc7531-3c20-4432-bf65-18d130ab577e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:57.821984 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc7531-3c20-4432-bf65-18d130ab577e admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:57.831998 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1460/2900] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:14:57.836117 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b889b-7496-49aa-8449-934f516d8f9e admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:57.846227 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b889b-7496-49aa-8449-934f516d8f9e admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:57.851180 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292c440-3014-430d-983a-46c0fe60cab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:57.851820 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292c440-3014-430d-983a-46c0fe60cab0 admin admin] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:57.852102 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292c440-3014-430d-983a-46c0fe60cab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:57.852374 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292c440-3014-430d-983a-46c0fe60cab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:57.853063 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292c440-3014-430d-983a-46c0fe60cab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:57.854642 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292c440-3014-430d-983a-46c0fe60cab0 admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:57.866306 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1441/2901] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Jul 28 04:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 04:14:57.870474 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc7531-3c20-4432-bf65-18d130ab577e admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:57.881893 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc7531-3c20-4432-bf65-18d130ab577e admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:57.886465 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90392e4-48a6-4d58-b225-b3172f9a29c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:57.887125 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90392e4-48a6-4d58-b225-b3172f9a29c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:57.887434 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90392e4-48a6-4d58-b225-b3172f9a29c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:57.887714 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90392e4-48a6-4d58-b225-b3172f9a29c3 admin admin] PATH_INFO: `/v3/projects/562580c5ab724f3bbf3fc653733df1ae/users/d68e0230bc804d26a976195fc56075b2/roles/43f173da338d498382fba44911238254` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:57.902805 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90392e4-48a6-4d58-b225-b3172f9a29c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=562580c5ab724f3bbf3fc653733df1ae, user_id=d68e0230bc804d26a976195fc56075b2, role_id=43f173da338d498382fba44911238254)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:57.905525 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90392e4-48a6-4d58-b225-b3172f9a29c3 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:57.984451 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1461/2902] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Jul 28 04:14:57 2022] PUT /identity/v3/projects/562580c5ab724f3bbf3fc653733df1ae/users/d68e0230bc804d26a976195fc56075b2/roles/43f173da338d498382fba44911238254 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:14:57.996359 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb3b5a-9885-4e2a-9a21-39fa5fea0919 None None] REQUEST_METHOD: `POST` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:57.996645 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb3b5a-9885-4e2a-9a21-39fa5fea0919 None None] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:57.996915 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb3b5a-9885-4e2a-9a21-39fa5fea0919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:58.025105 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.auth.core [None req-99fb3b5a-9885-4e2a-9a21-39fa5fea0919 None None] MFA Rules not processed for user `d68e0230bc804d26a976195fc56075b2`. Rule list: `[]` (Enabled: `True`). {{(pid=86894) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:14:58.026296 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-99fb3b5a-9885-4e2a-9a21-39fa5fea0919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:58.092858 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1442/2903] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:14:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:14:58.104675 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90392e4-48a6-4d58-b225-b3172f9a29c3 admin admin] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:14:58.106415 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-f90392e4-48a6-4d58-b225-b3172f9a29c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:14:58.128738 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:58.165305 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90392e4-48a6-4d58-b225-b3172f9a29c3 admin admin] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:14:58.169019 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e9baf-bc5f-41a6-8b94-a7eb761f8550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd31134e1f8545b0bbbe3c223b165df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:14:58.169645 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e9baf-bc5f-41a6-8b94-a7eb761f8550 service cinder] REQUEST_METHOD: `GET` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:14:58.169925 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e9baf-bc5f-41a6-8b94-a7eb761f8550 service cinder] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:14:58.170201 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e9baf-bc5f-41a6-8b94-a7eb761f8550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:14:58.179606 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e9baf-bc5f-41a6-8b94-a7eb761f8550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:14:58.181052 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e9baf-bc5f-41a6-8b94-a7eb761f8550 service cinder] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:14:58.189912 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1462/2904] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:14:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:15:08.089731 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:15:08.231679 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=17 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:15:09.618700 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb3b5a-9885-4e2a-9a21-39fa5fea0919 None None] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:15:09.680082 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb3b5a-9885-4e2a-9a21-39fa5fea0919 None None] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:15:09.684628 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9fcc4-1319-4412-8641-c408fe6f184f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:15:09.685274 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9fcc4-1319-4412-8641-c408fe6f184f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:15:09.685555 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9fcc4-1319-4412-8641-c408fe6f184f admin admin] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:15:09.685832 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9fcc4-1319-4412-8641-c408fe6f184f admin admin] PATH_INFO: `/v3/users/d68e0230bc804d26a976195fc56075b2` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:15:09.686994 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9fcc4-1319-4412-8641-c408fe6f184f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68e0230bc804d26a976195fc56075b2)` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:15:09.688942 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9fcc4-1319-4412-8641-c408fe6f184f admin admin] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:15:09.862318 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-90b9fcc4-1319-4412-8641-c408fe6f184f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68e0230bc804d26a976195fc56075b2'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:09.862996 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-90b9fcc4-1319-4412-8641-c408fe6f184f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68e0230bc804d26a976195fc56075b2'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:09.974107 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-90b9fcc4-1319-4412-8641-c408fe6f184f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68e0230bc804d26a976195fc56075b2'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:09.981948 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-90b9fcc4-1319-4412-8641-c408fe6f184f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68e0230bc804d26a976195fc56075b2'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:09.993674 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.notifications [None req-90b9fcc4-1319-4412-8641-c408fe6f184f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68e0230bc804d26a976195fc56075b2'} {{(pid=86894) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:10.000112 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1443/2905] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Jul 28 04:15:09 2022] DELETE /identity/v3/users/d68e0230bc804d26a976195fc56075b2 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 04:15:10.004699 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604013b1-7c4e-4995-9336-b6c973fb30aa None None] REQUEST_METHOD: `POST` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:15:10.005160 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604013b1-7c4e-4995-9336-b6c973fb30aa None None] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:15:10.005270 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604013b1-7c4e-4995-9336-b6c973fb30aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:15:10.025191 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.auth.core [None req-604013b1-7c4e-4995-9336-b6c973fb30aa None None] MFA Rules not processed for user `3f3fe43cd62f4e5186fa1917f6943de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86895) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 04:15:10.026396 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-604013b1-7c4e-4995-9336-b6c973fb30aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:15:10.085377 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1463/2906] 10.222.0.64 () {58 vars in 958 bytes} [Thu Jul 28 04:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 04:15:10.095912 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9fcc4-1319-4412-8641-c408fe6f184f admin admin] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:15:10.097330 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-90b9fcc4-1319-4412-8641-c408fe6f184f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:15:10.156751 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9fcc4-1319-4412-8641-c408fe6f184f admin admin] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:15:10.160331 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4c1c6-5fc5-49fa-af1a-156abbadcf6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03742c23cae849d9bf4ce0b432edd1cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:15:10.160955 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4c1c6-5fc5-49fa-af1a-156abbadcf6f service neutron] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:15:10.161243 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4c1c6-5fc5-49fa-af1a-156abbadcf6f service neutron] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:15:10.161524 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4c1c6-5fc5-49fa-af1a-156abbadcf6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:15:10.171306 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4c1c6-5fc5-49fa-af1a-156abbadcf6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:15:10.172778 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4c1c6-5fc5-49fa-af1a-156abbadcf6f service neutron] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:15:10.182284 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1444/2907] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:15:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:15:10.622842 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604013b1-7c4e-4995-9336-b6c973fb30aa None None] Authenticating user token {{(pid=86895) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:15:10.624560 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.fernet_utils [None req-604013b1-7c4e-4995-9336-b6c973fb30aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86895) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:15:10.636506 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604013b1-7c4e-4995-9336-b6c973fb30aa None None] Validating token access rules against request {{(pid=86895) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:15:10.642298 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ebbd6-9159-44db-800b-bedf3fb55078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f3fe43cd62f4e5186fa1917f6943de6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ea31e38f3a74a13b1debf11d300a6d6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86895) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:15:10.643131 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ebbd6-9159-44db-800b-bedf3fb55078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:15:10.643449 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ebbd6-9159-44db-800b-bedf3fb55078 admin admin] SCRIPT_NAME: `/identity` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:15:10.643731 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ebbd6-9159-44db-800b-bedf3fb55078 admin admin] PATH_INFO: `/v3/projects/562580c5ab724f3bbf3fc653733df1ae` {{(pid=86895) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:15:10.645011 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ebbd6-9159-44db-800b-bedf3fb55078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=562580c5ab724f3bbf3fc653733df1ae)` {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:15:10.647863 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ebbd6-9159-44db-800b-bedf3fb55078 admin admin] RBAC: Authorization granted {{(pid=86895) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:15:10.905652 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-9c7ebbd6-9159-44db-800b-bedf3fb55078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '562580c5ab724f3bbf3fc653733df1ae', 'request_id': 'req-9c7ebbd6-9159-44db-800b-bedf3fb55078'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:10.974077 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-9c7ebbd6-9159-44db-800b-bedf3fb55078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '562580c5ab724f3bbf3fc653733df1ae', 'request_id': 'req-9c7ebbd6-9159-44db-800b-bedf3fb55078'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:10.980760 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-9c7ebbd6-9159-44db-800b-bedf3fb55078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '562580c5ab724f3bbf3fc653733df1ae', 'request_id': 'req-9c7ebbd6-9159-44db-800b-bedf3fb55078'} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:10.991828 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-9c7ebbd6-9159-44db-800b-bedf3fb55078 admin admin] The token cache is being invalidate because project 562580c5ab724f3bbf3fc653733df1ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86895) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 28 04:15:10.992112 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-9c7ebbd6-9159-44db-800b-bedf3fb55078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:10.992741 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG keystone.notifications [None req-9c7ebbd6-9159-44db-800b-bedf3fb55078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86895) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 28 04:15:10.994297 dv-cinder-851279-1-smb devstack@keystone.service[86895]: [pid: 86895|app: 0|req: 1464/2908] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Jul 28 04:15:10 2022] DELETE /identity/v3/projects/562580c5ab724f3bbf3fc653733df1ae => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 04:15:20.178093 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:15:20.988919 dv-cinder-851279-1-smb devstack@keystone.service[86895]: DEBUG dbcounter [-] [86895] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:16:16.706881 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4c1c6-5fc5-49fa-af1a-156abbadcf6f service neutron] Authenticating user token {{(pid=86894) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 04:16:16.708318 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-52d4c1c6-5fc5-49fa-af1a-156abbadcf6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:16:16.777633 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4c1c6-5fc5-49fa-af1a-156abbadcf6f service neutron] Validating token access rules against request {{(pid=86894) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 04:16:16.837269 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7eb4ad-7894-47d3-b919-3b9deba297a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e91f2584622a48bba21e1bf31c1aef30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28b7995e83524b9293d1c6fc319e5a85', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86894) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 04:16:16.837886 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7eb4ad-7894-47d3-b919-3b9deba297a8 service placement] REQUEST_METHOD: `GET` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 04:16:16.838173 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7eb4ad-7894-47d3-b919-3b9deba297a8 service placement] SCRIPT_NAME: `/identity` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 04:16:16.838449 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7eb4ad-7894-47d3-b919-3b9deba297a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86894) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 04:16:16.840235 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.fernet_utils [None req-cd7eb4ad-7894-47d3-b919-3b9deba297a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86894) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 04:16:16.852310 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7eb4ad-7894-47d3-b919-3b9deba297a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 04:16:16.853888 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7eb4ad-7894-47d3-b919-3b9deba297a8 service placement] RBAC: Authorization granted {{(pid=86894) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 04:16:16.864568 dv-cinder-851279-1-smb devstack@keystone.service[86894]: [pid: 86894|app: 0|req: 1445/2909] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 28 04:16:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 04:16:26.859514 dv-cinder-851279-1-smb devstack@keystone.service[86894]: DEBUG dbcounter [-] [86894] Writing DB stats keystone:SELECT=58 {{(pid=86894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}